2026-03-09T00:24:37.824 INFO:root:teuthology version: 1.2.4.dev6+g1c580df7a 2026-03-09T00:24:37.829 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-09T00:24:37.853 INFO:teuthology.run:Config: archive_path: /archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/312 branch: squid description: orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} email: null first_in_suite: false flavor: default job_id: '312' last_in_suite: false machine_type: vps name: kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ansible.cephlab: branch: main skip_tags: nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs vars: timezone: UTC ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd mclock iops capacity threshold hdd: 49000 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - CEPHADM_STRAY_DAEMON log-only-match: - CEPHADM_ sha1: e911bdebe5c8faa3800735d1568fcdca65db60df ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: e911bdebe5c8faa3800735d1568fcdca65db60df extra_packages: - cephadm extra_system_packages: deb: - python3-xmltodict - python3-jmespath rpm: - bzip2 - perl-Test-Harness - python3-xmltodict - python3-jmespath selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: tt-squid sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 owner: kyr priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 8017 sha1: e911bdebe5c8faa3800735d1568fcdca65db60df sleep_before_teardown: 0 subset: 1/64 suite: orch:cephadm suite_branch: tt-squid suite_path: /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa suite_relpath: qa suite_repo: https://github.com/kshtsk/ceph.git suite_sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 targets: vm09.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnGr6rHpZmvhbPVoI0ROKxwKsjL82r4sqaK1tmqk6kcw19CBOmLqKPHBuSnCdba2LnHdKc2O5+rc22TvpVyQ6M= vm11.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDW9+0B3rCM9S7h5TFfR5FFP0NRRIgMu1x5EBPff8sfgtWnL9F5ccIKb6qBbcFgylUMKlumTr42LZbzIhIfFWd0= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: clyso-debian-13 teuthology_repo: https://github.com/clyso/teuthology teuthology_sha1: 1c580df7a9c7c2aadc272da296344fd99f27c444 timestamp: 2026-03-08_22:22:45 tube: vps user: kyr verbose: false worker_log: /home/teuthos/.teuthology/dispatcher/dispatcher.vps.611473 2026-03-09T00:24:37.853 INFO:teuthology.run:suite_path is set to /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa; will attempt to use it 2026-03-09T00:24:37.853 INFO:teuthology.run:Found tasks at /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa/tasks 2026-03-09T00:24:37.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-03-09T00:24:37.854 INFO:teuthology.task.internal:Checking packages... 2026-03-09T00:24:37.854 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e911bdebe5c8faa3800735d1568fcdca65db60df' 2026-03-09T00:24:37.854 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-03-09T00:24:37.854 INFO:teuthology.packaging:ref: None 2026-03-09T00:24:37.854 INFO:teuthology.packaging:tag: None 2026-03-09T00:24:37.854 INFO:teuthology.packaging:branch: squid 2026-03-09T00:24:37.854 INFO:teuthology.packaging:sha1: e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:24:37.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-03-09T00:24:38.678 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-678.ge911bdeb 2026-03-09T00:24:38.679 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-03-09T00:24:38.680 INFO:teuthology.task.internal:no buildpackages task found 2026-03-09T00:24:38.680 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-03-09T00:24:38.680 INFO:teuthology.task.internal:Saving configuration 2026-03-09T00:24:38.685 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-03-09T00:24:38.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-03-09T00:24:38.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm09.local', 'description': '/archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/312', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 00:22:59.807976', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:09', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnGr6rHpZmvhbPVoI0ROKxwKsjL82r4sqaK1tmqk6kcw19CBOmLqKPHBuSnCdba2LnHdKc2O5+rc22TvpVyQ6M='} 2026-03-09T00:24:38.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm11.local', 'description': '/archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/312', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 00:22:59.808407', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:0b', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDW9+0B3rCM9S7h5TFfR5FFP0NRRIgMu1x5EBPff8sfgtWnL9F5ccIKb6qBbcFgylUMKlumTr42LZbzIhIfFWd0='} 2026-03-09T00:24:38.698 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-03-09T00:24:38.699 INFO:teuthology.task.internal:roles: ubuntu@vm09.local - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2026-03-09T00:24:38.699 INFO:teuthology.task.internal:roles: ubuntu@vm11.local - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2026-03-09T00:24:38.699 INFO:teuthology.run_tasks:Running task console_log... 2026-03-09T00:24:38.706 DEBUG:teuthology.task.console_log:vm09 does not support IPMI; excluding 2026-03-09T00:24:38.712 DEBUG:teuthology.task.console_log:vm11 does not support IPMI; excluding 2026-03-09T00:24:38.713 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6919d8b80>, signals=[15]) 2026-03-09T00:24:38.713 INFO:teuthology.run_tasks:Running task internal.connect... 2026-03-09T00:24:38.713 INFO:teuthology.task.internal:Opening connections... 2026-03-09T00:24:38.714 DEBUG:teuthology.task.internal:connecting to ubuntu@vm09.local 2026-03-09T00:24:38.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm09.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T00:24:38.775 DEBUG:teuthology.task.internal:connecting to ubuntu@vm11.local 2026-03-09T00:24:38.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm11.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T00:24:38.836 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-03-09T00:24:38.837 DEBUG:teuthology.orchestra.run.vm09:> uname -m 2026-03-09T00:24:38.899 INFO:teuthology.orchestra.run.vm09.stdout:x86_64 2026-03-09T00:24:38.899 DEBUG:teuthology.orchestra.run.vm09:> cat /etc/os-release 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:NAME="CentOS Stream" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:VERSION="9" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:ID="centos" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:ID_LIKE="rhel fedora" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:VERSION_ID="9" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:PLATFORM_ID="platform:el9" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:ANSI_COLOR="0;31" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:LOGO="fedora-logo-icon" 2026-03-09T00:24:38.955 INFO:teuthology.orchestra.run.vm09.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T00:24:38.956 INFO:teuthology.orchestra.run.vm09.stdout:HOME_URL="https://centos.org/" 2026-03-09T00:24:38.956 INFO:teuthology.orchestra.run.vm09.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T00:24:38.956 INFO:teuthology.orchestra.run.vm09.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T00:24:38.956 INFO:teuthology.orchestra.run.vm09.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T00:24:38.956 INFO:teuthology.lock.ops:Updating vm09.local on lock server 2026-03-09T00:24:38.961 DEBUG:teuthology.orchestra.run.vm11:> uname -m 2026-03-09T00:24:38.977 INFO:teuthology.orchestra.run.vm11.stdout:x86_64 2026-03-09T00:24:38.978 DEBUG:teuthology.orchestra.run.vm11:> cat /etc/os-release 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:NAME="CentOS Stream" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:VERSION="9" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:ID="centos" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:ID_LIKE="rhel fedora" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:VERSION_ID="9" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:PLATFORM_ID="platform:el9" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:ANSI_COLOR="0;31" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:LOGO="fedora-logo-icon" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:HOME_URL="https://centos.org/" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T00:24:39.033 INFO:teuthology.orchestra.run.vm11.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T00:24:39.033 INFO:teuthology.lock.ops:Updating vm11.local on lock server 2026-03-09T00:24:39.049 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-03-09T00:24:39.051 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-03-09T00:24:39.074 INFO:teuthology.task.internal:Checking for old test directory... 2026-03-09T00:24:39.074 DEBUG:teuthology.orchestra.run.vm09:> test '!' -e /home/ubuntu/cephtest 2026-03-09T00:24:39.076 DEBUG:teuthology.orchestra.run.vm11:> test '!' -e /home/ubuntu/cephtest 2026-03-09T00:24:39.092 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-03-09T00:24:39.099 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-03-09T00:24:39.099 DEBUG:teuthology.orchestra.run.vm09:> test -z $(ls -A /var/lib/ceph) 2026-03-09T00:24:39.133 DEBUG:teuthology.orchestra.run.vm11:> test -z $(ls -A /var/lib/ceph) 2026-03-09T00:24:39.148 INFO:teuthology.orchestra.run.vm09.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T00:24:39.149 INFO:teuthology.orchestra.run.vm11.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T00:24:39.149 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-03-09T00:24:39.157 DEBUG:teuthology.orchestra.run.vm09:> test -e /ceph-qa-ready 2026-03-09T00:24:39.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:24:39.485 DEBUG:teuthology.orchestra.run.vm11:> test -e /ceph-qa-ready 2026-03-09T00:24:39.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:24:39.704 INFO:teuthology.run_tasks:Running task internal.base... 2026-03-09T00:24:39.706 INFO:teuthology.task.internal:Creating test directory... 2026-03-09T00:24:39.706 DEBUG:teuthology.orchestra.run.vm09:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T00:24:39.708 DEBUG:teuthology.orchestra.run.vm11:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T00:24:39.725 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-03-09T00:24:39.726 INFO:teuthology.run_tasks:Running task internal.archive... 2026-03-09T00:24:39.742 INFO:teuthology.task.internal:Creating archive directory... 2026-03-09T00:24:39.742 DEBUG:teuthology.orchestra.run.vm09:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T00:24:39.765 DEBUG:teuthology.orchestra.run.vm11:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T00:24:39.818 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-03-09T00:24:39.839 INFO:teuthology.task.internal:Enabling coredump saving... 2026-03-09T00:24:39.839 DEBUG:teuthology.orchestra.run.vm09:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T00:24:39.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:24:39.864 DEBUG:teuthology.orchestra.run.vm11:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T00:24:39.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:24:39.878 DEBUG:teuthology.orchestra.run.vm09:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T00:24:39.907 DEBUG:teuthology.orchestra.run.vm11:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T00:24:39.931 INFO:teuthology.orchestra.run.vm09.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T00:24:39.945 INFO:teuthology.orchestra.run.vm11.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T00:24:39.948 INFO:teuthology.orchestra.run.vm09.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T00:24:39.955 INFO:teuthology.orchestra.run.vm11.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T00:24:39.956 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-03-09T00:24:39.958 INFO:teuthology.task.internal:Configuring sudo... 2026-03-09T00:24:39.958 DEBUG:teuthology.orchestra.run.vm09:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T00:24:39.994 DEBUG:teuthology.orchestra.run.vm11:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T00:24:40.028 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-03-09T00:24:40.030 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-03-09T00:24:40.030 DEBUG:teuthology.orchestra.run.vm09:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T00:24:40.066 DEBUG:teuthology.orchestra.run.vm11:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T00:24:40.088 DEBUG:teuthology.orchestra.run.vm09:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T00:24:40.149 DEBUG:teuthology.orchestra.run.vm09:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T00:24:40.209 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:24:40.209 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T00:24:40.275 DEBUG:teuthology.orchestra.run.vm11:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T00:24:40.300 DEBUG:teuthology.orchestra.run.vm11:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T00:24:40.362 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:24:40.362 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T00:24:40.431 DEBUG:teuthology.orchestra.run.vm09:> sudo service rsyslog restart 2026-03-09T00:24:40.433 DEBUG:teuthology.orchestra.run.vm11:> sudo service rsyslog restart 2026-03-09T00:24:40.466 INFO:teuthology.orchestra.run.vm09.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T00:24:40.501 INFO:teuthology.orchestra.run.vm11.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T00:24:40.950 INFO:teuthology.run_tasks:Running task internal.timer... 2026-03-09T00:24:40.952 INFO:teuthology.task.internal:Starting timer... 2026-03-09T00:24:40.952 INFO:teuthology.run_tasks:Running task pcp... 2026-03-09T00:24:40.955 INFO:teuthology.run_tasks:Running task selinux... 2026-03-09T00:24:40.957 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-03-09T00:24:40.958 INFO:teuthology.task.selinux:Excluding vm09: VMs are not yet supported 2026-03-09T00:24:40.958 INFO:teuthology.task.selinux:Excluding vm11: VMs are not yet supported 2026-03-09T00:24:40.958 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-03-09T00:24:40.958 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-03-09T00:24:40.958 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-03-09T00:24:40.958 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-03-09T00:24:40.959 DEBUG:teuthology.task:Applying overrides for task ansible.cephlab: {'branch': 'main', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'UTC'}} 2026-03-09T00:24:40.959 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph-cm-ansible.git 2026-03-09T00:24:40.961 INFO:teuthology.repo_utils:Fetching github.com_ceph_ceph-cm-ansible_main from origin 2026-03-09T00:24:41.423 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main to origin/main 2026-03-09T00:24:41.431 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-03-09T00:24:41.431 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu", "timezone": "UTC"}' -i /tmp/teuth_ansible_inventorytk4ds21c --limit vm09.local,vm11.local /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main/cephlab.yml --skip-tags nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs 2026-03-09T00:26:18.774 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@vm09.local'), Remote(name='ubuntu@vm11.local')] 2026-03-09T00:26:18.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm09.local' 2026-03-09T00:26:18.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm09.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T00:26:18.840 DEBUG:teuthology.orchestra.run.vm09:> true 2026-03-09T00:26:18.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm09.local' 2026-03-09T00:26:18.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm11.local' 2026-03-09T00:26:18.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm11.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T00:26:18.985 DEBUG:teuthology.orchestra.run.vm11:> true 2026-03-09T00:26:19.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm11.local' 2026-03-09T00:26:19.067 INFO:teuthology.run_tasks:Running task clock... 2026-03-09T00:26:19.070 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-03-09T00:26:19.070 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T00:26:19.070 DEBUG:teuthology.orchestra.run.vm09:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T00:26:19.072 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T00:26:19.072 DEBUG:teuthology.orchestra.run.vm11:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T00:26:19.110 INFO:teuthology.orchestra.run.vm09.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T00:26:19.126 INFO:teuthology.orchestra.run.vm09.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T00:26:19.143 INFO:teuthology.orchestra.run.vm11.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T00:26:19.155 INFO:teuthology.orchestra.run.vm09.stderr:sudo: ntpd: command not found 2026-03-09T00:26:19.156 INFO:teuthology.orchestra.run.vm11.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T00:26:19.166 INFO:teuthology.orchestra.run.vm09.stdout:506 Cannot talk to daemon 2026-03-09T00:26:19.182 INFO:teuthology.orchestra.run.vm09.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T00:26:19.183 INFO:teuthology.orchestra.run.vm11.stderr:sudo: ntpd: command not found 2026-03-09T00:26:19.195 INFO:teuthology.orchestra.run.vm11.stdout:506 Cannot talk to daemon 2026-03-09T00:26:19.197 INFO:teuthology.orchestra.run.vm09.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T00:26:19.211 INFO:teuthology.orchestra.run.vm11.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T00:26:19.227 INFO:teuthology.orchestra.run.vm11.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T00:26:19.243 INFO:teuthology.orchestra.run.vm09.stderr:bash: line 1: ntpq: command not found 2026-03-09T00:26:19.248 INFO:teuthology.orchestra.run.vm09.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T00:26:19.248 INFO:teuthology.orchestra.run.vm09.stdout:=============================================================================== 2026-03-09T00:26:19.248 INFO:teuthology.orchestra.run.vm09.stdout:^? ns1.2053.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.248 INFO:teuthology.orchestra.run.vm09.stdout:^? 193.158.22.13 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.248 INFO:teuthology.orchestra.run.vm09.stdout:^? 139-162-156-95.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.248 INFO:teuthology.orchestra.run.vm09.stdout:^? ntp5.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.283 INFO:teuthology.orchestra.run.vm11.stderr:bash: line 1: ntpq: command not found 2026-03-09T00:26:19.286 INFO:teuthology.orchestra.run.vm11.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T00:26:19.286 INFO:teuthology.orchestra.run.vm11.stdout:=============================================================================== 2026-03-09T00:26:19.286 INFO:teuthology.orchestra.run.vm11.stdout:^? 139-162-156-95.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.286 INFO:teuthology.orchestra.run.vm11.stdout:^? ntp5.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.286 INFO:teuthology.orchestra.run.vm11.stdout:^? ns1.2053.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.286 INFO:teuthology.orchestra.run.vm11.stdout:^? 193.158.22.13 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T00:26:19.287 INFO:teuthology.run_tasks:Running task pexec... 2026-03-09T00:26:19.289 INFO:teuthology.task.pexec:Executing custom commands... 2026-03-09T00:26:19.289 DEBUG:teuthology.orchestra.run.vm09:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T00:26:19.289 DEBUG:teuthology.orchestra.run.vm11:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T00:26:19.291 DEBUG:teuthology.task.pexec:ubuntu@vm09.local< sudo dnf remove nvme-cli -y 2026-03-09T00:26:19.291 DEBUG:teuthology.task.pexec:ubuntu@vm09.local< sudo dnf install nvmetcli nvme-cli -y 2026-03-09T00:26:19.291 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm09.local 2026-03-09T00:26:19.291 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T00:26:19.291 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-03-09T00:26:19.330 DEBUG:teuthology.task.pexec:ubuntu@vm11.local< sudo dnf remove nvme-cli -y 2026-03-09T00:26:19.330 DEBUG:teuthology.task.pexec:ubuntu@vm11.local< sudo dnf install nvmetcli nvme-cli -y 2026-03-09T00:26:19.330 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm11.local 2026-03-09T00:26:19.330 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T00:26:19.330 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-03-09T00:26:19.533 INFO:teuthology.orchestra.run.vm09.stdout:No match for argument: nvme-cli 2026-03-09T00:26:19.533 INFO:teuthology.orchestra.run.vm09.stderr:No packages marked for removal. 2026-03-09T00:26:19.536 INFO:teuthology.orchestra.run.vm09.stdout:Dependencies resolved. 2026-03-09T00:26:19.537 INFO:teuthology.orchestra.run.vm09.stdout:Nothing to do. 2026-03-09T00:26:19.537 INFO:teuthology.orchestra.run.vm09.stdout:Complete! 2026-03-09T00:26:19.571 INFO:teuthology.orchestra.run.vm11.stdout:No match for argument: nvme-cli 2026-03-09T00:26:19.571 INFO:teuthology.orchestra.run.vm11.stderr:No packages marked for removal. 2026-03-09T00:26:19.574 INFO:teuthology.orchestra.run.vm11.stdout:Dependencies resolved. 2026-03-09T00:26:19.575 INFO:teuthology.orchestra.run.vm11.stdout:Nothing to do. 2026-03-09T00:26:19.575 INFO:teuthology.orchestra.run.vm11.stdout:Complete! 2026-03-09T00:26:20.005 INFO:teuthology.orchestra.run.vm09.stdout:Last metadata expiration check: 0:01:06 ago on Mon 09 Mar 2026 12:25:14 AM UTC. 2026-03-09T00:26:20.026 INFO:teuthology.orchestra.run.vm11.stdout:Last metadata expiration check: 0:01:05 ago on Mon 09 Mar 2026 12:25:15 AM UTC. 2026-03-09T00:26:20.146 INFO:teuthology.orchestra.run.vm09.stdout:Dependencies resolved. 2026-03-09T00:26:20.147 INFO:teuthology.orchestra.run.vm09.stdout:================================================================================ 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: Package Architecture Version Repository Size 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:================================================================================ 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Installing: 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Installing dependencies: 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Transaction Summary 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:================================================================================ 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Install 6 Packages 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Total download size: 2.3 M 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Installed size: 11 M 2026-03-09T00:26:20.148 INFO:teuthology.orchestra.run.vm09.stdout:Downloading Packages: 2026-03-09T00:26:20.160 INFO:teuthology.orchestra.run.vm11.stdout:Dependencies resolved. 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:================================================================================ 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: Package Architecture Version Repository Size 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:================================================================================ 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Installing: 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Installing dependencies: 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Transaction Summary 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:================================================================================ 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Install 6 Packages 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Total download size: 2.3 M 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Installed size: 11 M 2026-03-09T00:26:20.161 INFO:teuthology.orchestra.run.vm11.stdout:Downloading Packages: 2026-03-09T00:26:20.365 INFO:teuthology.orchestra.run.vm11.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 436 kB/s | 44 kB 00:00 2026-03-09T00:26:20.494 INFO:teuthology.orchestra.run.vm11.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 312 kB/s | 72 kB 00:00 2026-03-09T00:26:20.579 INFO:teuthology.orchestra.run.vm11.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 394 kB/s | 84 kB 00:00 2026-03-09T00:26:20.728 INFO:teuthology.orchestra.run.vm09.stdout:(1/6): python3-configshell-1.1.30-1.el9.noarch. 581 kB/s | 72 kB 00:00 2026-03-09T00:26:20.754 INFO:teuthology.orchestra.run.vm09.stdout:(2/6): nvmetcli-0.8-3.el9.noarch.rpm 290 kB/s | 44 kB 00:00 2026-03-09T00:26:20.767 INFO:teuthology.orchestra.run.vm09.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 2.1 MB/s | 84 kB 00:00 2026-03-09T00:26:20.812 INFO:teuthology.orchestra.run.vm09.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.6 MB/s | 150 kB 00:00 2026-03-09T00:26:20.828 INFO:teuthology.orchestra.run.vm09.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 5.1 MB/s | 1.2 MB 00:00 2026-03-09T00:26:20.859 INFO:teuthology.orchestra.run.vm09.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 9.1 MB/s | 837 kB 00:00 2026-03-09T00:26:20.859 INFO:teuthology.orchestra.run.vm09.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:26:20.859 INFO:teuthology.orchestra.run.vm09.stdout:Total 3.2 MB/s | 2.3 MB 00:00 2026-03-09T00:26:20.946 INFO:teuthology.orchestra.run.vm09.stdout:Running transaction check 2026-03-09T00:26:20.957 INFO:teuthology.orchestra.run.vm09.stdout:Transaction check succeeded. 2026-03-09T00:26:20.958 INFO:teuthology.orchestra.run.vm09.stdout:Running transaction test 2026-03-09T00:26:21.021 INFO:teuthology.orchestra.run.vm09.stdout:Transaction test succeeded. 2026-03-09T00:26:21.021 INFO:teuthology.orchestra.run.vm09.stdout:Running transaction 2026-03-09T00:26:21.043 INFO:teuthology.orchestra.run.vm11.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 275 kB/s | 150 kB 00:00 2026-03-09T00:26:21.213 INFO:teuthology.orchestra.run.vm09.stdout: Preparing : 1/1 2026-03-09T00:26:21.227 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-03-09T00:26:21.241 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-03-09T00:26:21.250 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T00:26:21.262 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T00:26:21.264 INFO:teuthology.orchestra.run.vm09.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T00:26:21.425 INFO:teuthology.orchestra.run.vm11.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 1.0 MB/s | 1.2 MB 00:01 2026-03-09T00:26:21.478 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T00:26:21.484 INFO:teuthology.orchestra.run.vm09.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T00:26:21.572 INFO:teuthology.orchestra.run.vm11.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 843 kB/s | 837 kB 00:00 2026-03-09T00:26:21.572 INFO:teuthology.orchestra.run.vm11.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:26:21.572 INFO:teuthology.orchestra.run.vm11.stdout:Total 1.6 MB/s | 2.3 MB 00:01 2026-03-09T00:26:21.656 INFO:teuthology.orchestra.run.vm11.stdout:Running transaction check 2026-03-09T00:26:21.667 INFO:teuthology.orchestra.run.vm11.stdout:Transaction check succeeded. 2026-03-09T00:26:21.667 INFO:teuthology.orchestra.run.vm11.stdout:Running transaction test 2026-03-09T00:26:21.736 INFO:teuthology.orchestra.run.vm11.stdout:Transaction test succeeded. 2026-03-09T00:26:21.736 INFO:teuthology.orchestra.run.vm11.stdout:Running transaction 2026-03-09T00:26:21.927 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T00:26:21.927 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T00:26:21.927 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:21.945 INFO:teuthology.orchestra.run.vm11.stdout: Preparing : 1/1 2026-03-09T00:26:21.960 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-03-09T00:26:21.977 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-03-09T00:26:21.987 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T00:26:21.994 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T00:26:21.996 INFO:teuthology.orchestra.run.vm11.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T00:26:22.238 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T00:26:22.243 INFO:teuthology.orchestra.run.vm11.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T00:26:22.552 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-03-09T00:26:22.552 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-03-09T00:26:22.552 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T00:26:22.552 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T00:26:22.552 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-03-09T00:26:22.662 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-03-09T00:26:22.662 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:22.662 INFO:teuthology.orchestra.run.vm09.stdout:Installed: 2026-03-09T00:26:22.662 INFO:teuthology.orchestra.run.vm09.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T00:26:22.663 INFO:teuthology.orchestra.run.vm09.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T00:26:22.663 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T00:26:22.663 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:22.663 INFO:teuthology.orchestra.run.vm09.stdout:Complete! 2026-03-09T00:26:22.684 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T00:26:22.684 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T00:26:22.684 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:22.753 DEBUG:teuthology.parallel:result is None 2026-03-09T00:26:23.286 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-03-09T00:26:23.286 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-03-09T00:26:23.286 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T00:26:23.286 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T00:26:23.286 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout:Installed: 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:23.387 INFO:teuthology.orchestra.run.vm11.stdout:Complete! 2026-03-09T00:26:23.464 DEBUG:teuthology.parallel:result is None 2026-03-09T00:26:23.464 INFO:teuthology.run_tasks:Running task install... 2026-03-09T00:26:23.466 DEBUG:teuthology.task.install:project ceph 2026-03-09T00:26:23.467 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df'}, 'extra_packages': ['cephadm'], 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}} 2026-03-09T00:26:23.467 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}} 2026-03-09T00:26:23.467 INFO:teuthology.task.install:Using flavor: default 2026-03-09T00:26:23.469 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-03-09T00:26:23.469 INFO:teuthology.task.install:extra packages: [] 2026-03-09T00:26:23.469 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'tag': None, 'wait_for_package': False} 2026-03-09T00:26:23.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:26:23.470 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'tag': None, 'wait_for_package': False} 2026-03-09T00:26:23.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:26:24.137 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/ 2026-03-09T00:26:24.137 INFO:teuthology.task.install.rpm:Package version is 19.2.3-678.ge911bdeb 2026-03-09T00:26:24.198 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/ 2026-03-09T00:26:24.198 INFO:teuthology.task.install.rpm:Package version is 19.2.3-678.ge911bdeb 2026-03-09T00:26:24.662 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-03-09T00:26:24.662 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:26:24.662 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-03-09T00:26:24.699 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, python3-xmltodict, python3-jmespath on remote rpm x86_64 2026-03-09T00:26:24.699 DEBUG:teuthology.orchestra.run.vm09:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e911bdebe5c8faa3800735d1568fcdca65db60df/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-03-09T00:26:24.713 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-03-09T00:26:24.713 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:26:24.713 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-03-09T00:26:24.748 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, python3-xmltodict, python3-jmespath on remote rpm x86_64 2026-03-09T00:26:24.748 DEBUG:teuthology.orchestra.run.vm11:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e911bdebe5c8faa3800735d1568fcdca65db60df/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-03-09T00:26:24.772 DEBUG:teuthology.orchestra.run.vm09:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-03-09T00:26:24.823 DEBUG:teuthology.orchestra.run.vm11:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-03-09T00:26:24.856 DEBUG:teuthology.orchestra.run.vm09:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-03-09T00:26:24.889 INFO:teuthology.orchestra.run.vm09.stdout:check_obsoletes = 1 2026-03-09T00:26:24.890 DEBUG:teuthology.orchestra.run.vm09:> sudo yum clean all 2026-03-09T00:26:24.907 DEBUG:teuthology.orchestra.run.vm11:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-03-09T00:26:24.980 INFO:teuthology.orchestra.run.vm11.stdout:check_obsoletes = 1 2026-03-09T00:26:24.982 DEBUG:teuthology.orchestra.run.vm11:> sudo yum clean all 2026-03-09T00:26:25.091 INFO:teuthology.orchestra.run.vm09.stdout:41 files removed 2026-03-09T00:26:25.120 DEBUG:teuthology.orchestra.run.vm09:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bzip2 perl-Test-Harness python3-xmltodict python3-jmespath 2026-03-09T00:26:25.196 INFO:teuthology.orchestra.run.vm11.stdout:41 files removed 2026-03-09T00:26:25.228 DEBUG:teuthology.orchestra.run.vm11:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bzip2 perl-Test-Harness python3-xmltodict python3-jmespath 2026-03-09T00:26:26.499 INFO:teuthology.orchestra.run.vm09.stdout:ceph packages for x86_64 71 kB/s | 84 kB 00:01 2026-03-09T00:26:26.647 INFO:teuthology.orchestra.run.vm11.stdout:ceph packages for x86_64 69 kB/s | 84 kB 00:01 2026-03-09T00:26:27.482 INFO:teuthology.orchestra.run.vm09.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2026-03-09T00:26:27.624 INFO:teuthology.orchestra.run.vm11.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2026-03-09T00:26:28.456 INFO:teuthology.orchestra.run.vm09.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2026-03-09T00:26:28.612 INFO:teuthology.orchestra.run.vm11.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2026-03-09T00:26:28.974 INFO:teuthology.orchestra.run.vm09.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.9 MB 00:00 2026-03-09T00:26:29.720 INFO:teuthology.orchestra.run.vm11.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.9 MB 00:01 2026-03-09T00:26:30.792 INFO:teuthology.orchestra.run.vm09.stdout:CentOS Stream 9 - AppStream 23 MB/s | 27 MB 00:01 2026-03-09T00:26:33.150 INFO:teuthology.orchestra.run.vm11.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-03-09T00:26:34.633 INFO:teuthology.orchestra.run.vm09.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 8.0 MB 00:01 2026-03-09T00:26:35.849 INFO:teuthology.orchestra.run.vm09.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 20 kB 00:00 2026-03-09T00:26:36.319 INFO:teuthology.orchestra.run.vm09.stdout:Extra Packages for Enterprise Linux 51 MB/s | 20 MB 00:00 2026-03-09T00:26:37.474 INFO:teuthology.orchestra.run.vm11.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 8.0 MB 00:01 2026-03-09T00:26:38.594 INFO:teuthology.orchestra.run.vm11.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 20 kB 00:00 2026-03-09T00:26:39.056 INFO:teuthology.orchestra.run.vm11.stdout:Extra Packages for Enterprise Linux 53 MB/s | 20 MB 00:00 2026-03-09T00:26:41.020 INFO:teuthology.orchestra.run.vm09.stdout:lab-extras 63 kB/s | 50 kB 00:00 2026-03-09T00:26:42.449 INFO:teuthology.orchestra.run.vm09.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T00:26:42.449 INFO:teuthology.orchestra.run.vm09.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T00:26:42.453 INFO:teuthology.orchestra.run.vm09.stdout:Package bzip2-1.0.8-11.el9.x86_64 is already installed. 2026-03-09T00:26:42.453 INFO:teuthology.orchestra.run.vm09.stdout:Package perl-Test-Harness-1:3.42-461.el9.noarch is already installed. 2026-03-09T00:26:42.484 INFO:teuthology.orchestra.run.vm09.stdout:Dependencies resolved. 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout:====================================================================================== 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: Package Arch Version Repository Size 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout:====================================================================================== 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout:Installing: 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 6.5 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.5 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.2 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 145 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.1 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 150 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 3.8 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 7.4 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 49 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 11 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 50 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 299 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 769 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 34 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.0 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 127 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 165 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 323 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 303 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 100 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 85 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.1 M 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 171 k 2026-03-09T00:26:42.489 INFO:teuthology.orchestra.run.vm09.stdout:Upgrading: 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.4 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.2 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout:Installing dependencies: 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 22 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 31 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 2.4 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 253 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 4.7 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 17 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 17 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 25 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 163 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 503 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.4 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-03-09T00:26:42.490 INFO:teuthology.orchestra.run.vm09.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 45 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 142 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-03-09T00:26:42.491 INFO:teuthology.orchestra.run.vm09.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:Installing weak dependencies: 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:Transaction Summary 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:====================================================================================== 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:Install 134 Packages 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:Upgrade 2 Packages 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:Total download size: 210 M 2026-03-09T00:26:42.492 INFO:teuthology.orchestra.run.vm09.stdout:Downloading Packages: 2026-03-09T00:26:43.699 INFO:teuthology.orchestra.run.vm11.stdout:lab-extras 64 kB/s | 50 kB 00:00 2026-03-09T00:26:45.081 INFO:teuthology.orchestra.run.vm09.stdout:(1/136): ceph-19.2.3-678.ge911bdeb.el9.x86_64.r 14 kB/s | 6.5 kB 00:00 2026-03-09T00:26:45.086 INFO:teuthology.orchestra.run.vm11.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T00:26:45.087 INFO:teuthology.orchestra.run.vm11.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T00:26:45.091 INFO:teuthology.orchestra.run.vm11.stdout:Package bzip2-1.0.8-11.el9.x86_64 is already installed. 2026-03-09T00:26:45.092 INFO:teuthology.orchestra.run.vm11.stdout:Package perl-Test-Harness-1:3.42-461.el9.noarch is already installed. 2026-03-09T00:26:45.120 INFO:teuthology.orchestra.run.vm11.stdout:Dependencies resolved. 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout:====================================================================================== 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: Package Arch Version Repository Size 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout:====================================================================================== 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout:Installing: 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 6.5 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.5 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.2 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 145 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.1 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 150 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 3.8 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 7.4 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 49 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 11 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 50 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 299 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 769 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 34 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.0 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 127 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 165 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 323 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 303 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 100 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 85 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.1 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 171 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout:Upgrading: 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.4 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.2 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout:Installing dependencies: 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 22 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 31 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 2.4 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 253 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 4.7 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 17 M 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 17 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 25 k 2026-03-09T00:26:45.125 INFO:teuthology.orchestra.run.vm11.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 163 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 503 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.4 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 45 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 142 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-03-09T00:26:45.126 INFO:teuthology.orchestra.run.vm11.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:Installing weak dependencies: 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:Transaction Summary 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:====================================================================================== 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:Install 134 Packages 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:Upgrade 2 Packages 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:Total download size: 210 M 2026-03-09T00:26:45.127 INFO:teuthology.orchestra.run.vm11.stdout:Downloading Packages: 2026-03-09T00:26:46.248 INFO:teuthology.orchestra.run.vm09.stdout:(2/136): ceph-fuse-19.2.3-678.ge911bdeb.el9.x86 1.0 MB/s | 1.2 MB 00:01 2026-03-09T00:26:46.370 INFO:teuthology.orchestra.run.vm09.stdout:(3/136): ceph-immutable-object-cache-19.2.3-678 1.2 MB/s | 145 kB 00:00 2026-03-09T00:26:46.458 INFO:teuthology.orchestra.run.vm11.stdout:(1/136): ceph-19.2.3-678.ge911bdeb.el9.x86_64.r 14 kB/s | 6.5 kB 00:00 2026-03-09T00:26:47.517 INFO:teuthology.orchestra.run.vm11.stdout:(2/136): ceph-fuse-19.2.3-678.ge911bdeb.el9.x86 1.1 MB/s | 1.2 MB 00:01 2026-03-09T00:26:47.551 INFO:teuthology.orchestra.run.vm09.stdout:(4/136): ceph-mds-19.2.3-678.ge911bdeb.el9.x86_ 2.0 MB/s | 2.4 MB 00:01 2026-03-09T00:26:47.590 INFO:teuthology.orchestra.run.vm09.stdout:(5/136): ceph-base-19.2.3-678.ge911bdeb.el9.x86 1.8 MB/s | 5.5 MB 00:02 2026-03-09T00:26:47.637 INFO:teuthology.orchestra.run.vm11.stdout:(3/136): ceph-immutable-object-cache-19.2.3-678 1.2 MB/s | 145 kB 00:00 2026-03-09T00:26:48.021 INFO:teuthology.orchestra.run.vm09.stdout:(6/136): ceph-mgr-19.2.3-678.ge911bdeb.el9.x86_ 2.3 MB/s | 1.1 MB 00:00 2026-03-09T00:26:48.601 INFO:teuthology.orchestra.run.vm09.stdout:(7/136): ceph-mon-19.2.3-678.ge911bdeb.el9.x86_ 4.7 MB/s | 4.7 MB 00:01 2026-03-09T00:26:48.815 INFO:teuthology.orchestra.run.vm11.stdout:(4/136): ceph-mds-19.2.3-678.ge911bdeb.el9.x86_ 2.1 MB/s | 2.4 MB 00:01 2026-03-09T00:26:49.126 INFO:teuthology.orchestra.run.vm11.stdout:(5/136): ceph-base-19.2.3-678.ge911bdeb.el9.x86 1.7 MB/s | 5.5 MB 00:03 2026-03-09T00:26:49.287 INFO:teuthology.orchestra.run.vm11.stdout:(6/136): ceph-mgr-19.2.3-678.ge911bdeb.el9.x86_ 2.3 MB/s | 1.1 MB 00:00 2026-03-09T00:26:50.114 INFO:teuthology.orchestra.run.vm09.stdout:(8/136): ceph-radosgw-19.2.3-678.ge911bdeb.el9. 7.1 MB/s | 11 MB 00:01 2026-03-09T00:26:50.192 INFO:teuthology.orchestra.run.vm11.stdout:(7/136): ceph-mon-19.2.3-678.ge911bdeb.el9.x86_ 4.4 MB/s | 4.7 MB 00:01 2026-03-09T00:26:50.226 INFO:teuthology.orchestra.run.vm09.stdout:(9/136): ceph-selinux-19.2.3-678.ge911bdeb.el9. 223 kB/s | 25 kB 00:00 2026-03-09T00:26:50.380 INFO:teuthology.orchestra.run.vm09.stdout:(10/136): ceph-common-19.2.3-678.ge911bdeb.el9. 3.8 MB/s | 22 MB 00:05 2026-03-09T00:26:50.507 INFO:teuthology.orchestra.run.vm09.stdout:(11/136): libcephfs-devel-19.2.3-678.ge911bdeb. 263 kB/s | 34 kB 00:00 2026-03-09T00:26:50.678 INFO:teuthology.orchestra.run.vm09.stdout:(12/136): libcephfs2-19.2.3-678.ge911bdeb.el9.x 5.7 MB/s | 1.0 MB 00:00 2026-03-09T00:26:50.818 INFO:teuthology.orchestra.run.vm09.stdout:(13/136): libcephsqlite-19.2.3-678.ge911bdeb.el 1.1 MB/s | 163 kB 00:00 2026-03-09T00:26:50.908 INFO:teuthology.orchestra.run.vm09.stdout:(14/136): ceph-osd-19.2.3-678.ge911bdeb.el9.x86 5.9 MB/s | 17 MB 00:02 2026-03-09T00:26:50.978 INFO:teuthology.orchestra.run.vm09.stdout:(15/136): librados-devel-19.2.3-678.ge911bdeb.e 792 kB/s | 127 kB 00:00 2026-03-09T00:26:51.040 INFO:teuthology.orchestra.run.vm09.stdout:(16/136): libradosstriper1-19.2.3-678.ge911bdeb 3.7 MB/s | 503 kB 00:00 2026-03-09T00:26:51.165 INFO:teuthology.orchestra.run.vm09.stdout:(17/136): python3-ceph-argparse-19.2.3-678.ge91 362 kB/s | 45 kB 00:00 2026-03-09T00:26:51.296 INFO:teuthology.orchestra.run.vm09.stdout:(18/136): python3-ceph-common-19.2.3-678.ge911b 1.1 MB/s | 142 kB 00:00 2026-03-09T00:26:51.425 INFO:teuthology.orchestra.run.vm09.stdout:(19/136): python3-cephfs-19.2.3-678.ge911bdeb.e 1.2 MB/s | 165 kB 00:00 2026-03-09T00:26:51.501 INFO:teuthology.orchestra.run.vm11.stdout:(8/136): ceph-common-19.2.3-678.ge911bdeb.el9.x 3.9 MB/s | 22 MB 00:05 2026-03-09T00:26:51.551 INFO:teuthology.orchestra.run.vm09.stdout:(20/136): python3-rados-19.2.3-678.ge911bdeb.el 2.5 MB/s | 323 kB 00:00 2026-03-09T00:26:51.592 INFO:teuthology.orchestra.run.vm09.stdout:(21/136): librgw2-19.2.3-678.ge911bdeb.el9.x86_ 8.8 MB/s | 5.4 MB 00:00 2026-03-09T00:26:51.623 INFO:teuthology.orchestra.run.vm11.stdout:(9/136): ceph-selinux-19.2.3-678.ge911bdeb.el9. 206 kB/s | 25 kB 00:00 2026-03-09T00:26:51.694 INFO:teuthology.orchestra.run.vm09.stdout:(22/136): python3-rbd-19.2.3-678.ge911bdeb.el9. 2.1 MB/s | 303 kB 00:00 2026-03-09T00:26:51.713 INFO:teuthology.orchestra.run.vm09.stdout:(23/136): python3-rgw-19.2.3-678.ge911bdeb.el9. 822 kB/s | 100 kB 00:00 2026-03-09T00:26:51.759 INFO:teuthology.orchestra.run.vm11.stdout:(10/136): ceph-radosgw-19.2.3-678.ge911bdeb.el9 6.9 MB/s | 11 MB 00:01 2026-03-09T00:26:51.814 INFO:teuthology.orchestra.run.vm09.stdout:(24/136): rbd-fuse-19.2.3-678.ge911bdeb.el9.x86 707 kB/s | 85 kB 00:00 2026-03-09T00:26:51.911 INFO:teuthology.orchestra.run.vm11.stdout:(11/136): libcephfs-devel-19.2.3-678.ge911bdeb. 222 kB/s | 34 kB 00:00 2026-03-09T00:26:51.940 INFO:teuthology.orchestra.run.vm09.stdout:(25/136): rbd-nbd-19.2.3-678.ge911bdeb.el9.x86_ 1.3 MB/s | 171 kB 00:00 2026-03-09T00:26:52.047 INFO:teuthology.orchestra.run.vm11.stdout:(12/136): libcephfs2-19.2.3-678.ge911bdeb.el9.x 7.2 MB/s | 1.0 MB 00:00 2026-03-09T00:26:52.060 INFO:teuthology.orchestra.run.vm09.stdout:(26/136): ceph-grafana-dashboards-19.2.3-678.ge 259 kB/s | 31 kB 00:00 2026-03-09T00:26:52.077 INFO:teuthology.orchestra.run.vm09.stdout:(27/136): rbd-mirror-19.2.3-678.ge911bdeb.el9.x 8.6 MB/s | 3.1 MB 00:00 2026-03-09T00:26:52.195 INFO:teuthology.orchestra.run.vm09.stdout:(28/136): ceph-mgr-cephadm-19.2.3-678.ge911bdeb 1.1 MB/s | 150 kB 00:00 2026-03-09T00:26:52.195 INFO:teuthology.orchestra.run.vm11.stdout:(13/136): ceph-osd-19.2.3-678.ge911bdeb.el9.x86 5.9 MB/s | 17 MB 00:02 2026-03-09T00:26:52.198 INFO:teuthology.orchestra.run.vm11.stdout:(14/136): libcephsqlite-19.2.3-678.ge911bdeb.el 1.1 MB/s | 163 kB 00:00 2026-03-09T00:26:52.893 INFO:teuthology.orchestra.run.vm11.stdout:(15/136): librados-devel-19.2.3-678.ge911bdeb.e 182 kB/s | 127 kB 00:00 2026-03-09T00:26:52.903 INFO:teuthology.orchestra.run.vm09.stdout:(29/136): ceph-mgr-dashboard-19.2.3-678.ge911bd 4.6 MB/s | 3.8 MB 00:00 2026-03-09T00:26:53.006 INFO:teuthology.orchestra.run.vm11.stdout:(16/136): libradosstriper1-19.2.3-678.ge911bdeb 624 kB/s | 503 kB 00:00 2026-03-09T00:26:53.037 INFO:teuthology.orchestra.run.vm09.stdout:(30/136): ceph-mgr-modules-core-19.2.3-678.ge91 1.9 MB/s | 253 kB 00:00 2026-03-09T00:26:53.123 INFO:teuthology.orchestra.run.vm11.stdout:(17/136): python3-ceph-argparse-19.2.3-678.ge91 386 kB/s | 45 kB 00:00 2026-03-09T00:26:53.123 INFO:teuthology.orchestra.run.vm09.stdout:(31/136): ceph-mgr-diskprediction-local-19.2.3- 8.0 MB/s | 7.4 MB 00:00 2026-03-09T00:26:53.161 INFO:teuthology.orchestra.run.vm09.stdout:(32/136): ceph-mgr-rook-19.2.3-678.ge911bdeb.el 397 kB/s | 49 kB 00:00 2026-03-09T00:26:53.241 INFO:teuthology.orchestra.run.vm11.stdout:(18/136): python3-ceph-common-19.2.3-678.ge911b 1.2 MB/s | 142 kB 00:00 2026-03-09T00:26:53.259 INFO:teuthology.orchestra.run.vm09.stdout:(33/136): ceph-prometheus-alerts-19.2.3-678.ge9 124 kB/s | 17 kB 00:00 2026-03-09T00:26:53.292 INFO:teuthology.orchestra.run.vm09.stdout:(34/136): ceph-volume-19.2.3-678.ge911bdeb.el9. 2.2 MB/s | 299 kB 00:00 2026-03-09T00:26:53.360 INFO:teuthology.orchestra.run.vm11.stdout:(19/136): python3-cephfs-19.2.3-678.ge911bdeb.e 1.4 MB/s | 165 kB 00:00 2026-03-09T00:26:53.415 INFO:teuthology.orchestra.run.vm09.stdout:(35/136): cephadm-19.2.3-678.ge911bdeb.el9.noar 4.8 MB/s | 769 kB 00:00 2026-03-09T00:26:53.480 INFO:teuthology.orchestra.run.vm11.stdout:(20/136): python3-rados-19.2.3-678.ge911bdeb.el 2.6 MB/s | 323 kB 00:00 2026-03-09T00:26:53.506 INFO:teuthology.orchestra.run.vm09.stdout:(36/136): ledmon-libs-1.1.0-3.el9.x86_64.rpm 448 kB/s | 40 kB 00:00 2026-03-09T00:26:53.537 INFO:teuthology.orchestra.run.vm09.stdout:(37/136): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.4 MB/s | 351 kB 00:00 2026-03-09T00:26:53.568 INFO:teuthology.orchestra.run.vm09.stdout:(38/136): libconfig-1.7.2-9.el9.x86_64.rpm 1.1 MB/s | 72 kB 00:00 2026-03-09T00:26:53.600 INFO:teuthology.orchestra.run.vm11.stdout:(21/136): python3-rbd-19.2.3-678.ge911bdeb.el9. 2.5 MB/s | 303 kB 00:00 2026-03-09T00:26:53.688 INFO:teuthology.orchestra.run.vm09.stdout:(39/136): libgfortran-11.5.0-14.el9.x86_64.rpm 5.1 MB/s | 794 kB 00:00 2026-03-09T00:26:53.718 INFO:teuthology.orchestra.run.vm11.stdout:(22/136): python3-rgw-19.2.3-678.ge911bdeb.el9. 847 kB/s | 100 kB 00:00 2026-03-09T00:26:53.736 INFO:teuthology.orchestra.run.vm11.stdout:(23/136): librgw2-19.2.3-678.ge911bdeb.el9.x86_ 6.4 MB/s | 5.4 MB 00:00 2026-03-09T00:26:53.737 INFO:teuthology.orchestra.run.vm09.stdout:(40/136): mailcap-2.1.49-5.el9.noarch.rpm 688 kB/s | 33 kB 00:00 2026-03-09T00:26:53.765 INFO:teuthology.orchestra.run.vm09.stdout:(41/136): libquadmath-11.5.0-14.el9.x86_64.rpm 941 kB/s | 184 kB 00:00 2026-03-09T00:26:53.765 INFO:teuthology.orchestra.run.vm09.stdout:(42/136): pciutils-3.7.0-7.el9.x86_64.rpm 3.2 MB/s | 93 kB 00:00 2026-03-09T00:26:53.842 INFO:teuthology.orchestra.run.vm11.stdout:(24/136): rbd-fuse-19.2.3-678.ge911bdeb.el9.x86 683 kB/s | 85 kB 00:00 2026-03-09T00:26:53.847 INFO:teuthology.orchestra.run.vm09.stdout:(43/136): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2026-03-09T00:26:53.876 INFO:teuthology.orchestra.run.vm09.stdout:(44/136): python3-ply-3.11-14.el9.noarch.rpm 3.6 MB/s | 106 kB 00:00 2026-03-09T00:26:53.913 INFO:teuthology.orchestra.run.vm09.stdout:(45/136): python3-cryptography-36.0.1-5.el9.x86 8.4 MB/s | 1.2 MB 00:00 2026-03-09T00:26:53.940 INFO:teuthology.orchestra.run.vm09.stdout:(46/136): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 135 kB 00:00 2026-03-09T00:26:53.942 INFO:teuthology.orchestra.run.vm09.stdout:(47/136): python3-requests-2.25.1-10.el9.noarch 4.3 MB/s | 126 kB 00:00 2026-03-09T00:26:53.961 INFO:teuthology.orchestra.run.vm11.stdout:(25/136): rbd-nbd-19.2.3-678.ge911bdeb.el9.x86_ 1.4 MB/s | 171 kB 00:00 2026-03-09T00:26:54.094 INFO:teuthology.orchestra.run.vm11.stdout:(26/136): ceph-grafana-dashboards-19.2.3-678.ge 235 kB/s | 31 kB 00:00 2026-03-09T00:26:54.094 INFO:teuthology.orchestra.run.vm09.stdout:(48/136): ceph-test-19.2.3-678.ge911bdeb.el9.x8 13 MB/s | 50 MB 00:03 2026-03-09T00:26:54.095 INFO:teuthology.orchestra.run.vm09.stdout:(49/136): unzip-6.0-59.el9.x86_64.rpm 1.2 MB/s | 182 kB 00:00 2026-03-09T00:26:54.097 INFO:teuthology.orchestra.run.vm09.stdout:(50/136): python3-urllib3-1.26.5-7.el9.noarch.r 1.4 MB/s | 218 kB 00:00 2026-03-09T00:26:54.103 INFO:teuthology.orchestra.run.vm11.stdout:(27/136): rbd-mirror-19.2.3-678.ge911bdeb.el9.x 8.5 MB/s | 3.1 MB 00:00 2026-03-09T00:26:54.213 INFO:teuthology.orchestra.run.vm11.stdout:(28/136): ceph-mgr-cephadm-19.2.3-678.ge911bdeb 1.2 MB/s | 150 kB 00:00 2026-03-09T00:26:54.263 INFO:teuthology.orchestra.run.vm09.stdout:(51/136): zip-3.0-35.el9.x86_64.rpm 1.5 MB/s | 266 kB 00:00 2026-03-09T00:26:54.399 INFO:teuthology.orchestra.run.vm09.stdout:(52/136): flexiblas-3.0.4-9.el9.x86_64.rpm 98 kB/s | 30 kB 00:00 2026-03-09T00:26:54.457 INFO:teuthology.orchestra.run.vm09.stdout:(53/136): flexiblas-openblas-openmp-3.0.4-9.el9 258 kB/s | 15 kB 00:00 2026-03-09T00:26:54.486 INFO:teuthology.orchestra.run.vm11.stdout:(29/136): ceph-mgr-dashboard-19.2.3-678.ge911bd 9.9 MB/s | 3.8 MB 00:00 2026-03-09T00:26:54.503 INFO:teuthology.orchestra.run.vm09.stdout:(54/136): boost-program-options-1.75.0-13.el9.x 256 kB/s | 104 kB 00:00 2026-03-09T00:26:54.617 INFO:teuthology.orchestra.run.vm11.stdout:(30/136): ceph-mgr-modules-core-19.2.3-678.ge91 1.9 MB/s | 253 kB 00:00 2026-03-09T00:26:54.656 INFO:teuthology.orchestra.run.vm09.stdout:(55/136): libnbd-1.20.3-4.el9.x86_64.rpm 824 kB/s | 164 kB 00:00 2026-03-09T00:26:54.680 INFO:teuthology.orchestra.run.vm09.stdout:(56/136): libpmemobj-1.12.1-1.el9.x86_64.rpm 908 kB/s | 160 kB 00:00 2026-03-09T00:26:54.736 INFO:teuthology.orchestra.run.vm11.stdout:(31/136): ceph-mgr-rook-19.2.3-678.ge911bdeb.el 415 kB/s | 49 kB 00:00 2026-03-09T00:26:54.749 INFO:teuthology.orchestra.run.vm09.stdout:(57/136): librabbitmq-0.11.0-7.el9.x86_64.rpm 485 kB/s | 45 kB 00:00 2026-03-09T00:26:54.805 INFO:teuthology.orchestra.run.vm09.stdout:(58/136): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2026-03-09T00:26:54.855 INFO:teuthology.orchestra.run.vm09.stdout:(59/136): libxslt-1.1.34-12.el9.x86_64.rpm 4.5 MB/s | 233 kB 00:00 2026-03-09T00:26:54.856 INFO:teuthology.orchestra.run.vm11.stdout:(32/136): ceph-prometheus-alerts-19.2.3-678.ge9 140 kB/s | 17 kB 00:00 2026-03-09T00:26:54.856 INFO:teuthology.orchestra.run.vm09.stdout:(60/136): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.2 MB/s | 246 kB 00:00 2026-03-09T00:26:54.884 INFO:teuthology.orchestra.run.vm09.stdout:(61/136): flexiblas-netlib-3.0.4-9.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2026-03-09T00:26:54.933 INFO:teuthology.orchestra.run.vm09.stdout:(62/136): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 292 kB 00:00 2026-03-09T00:26:54.973 INFO:teuthology.orchestra.run.vm09.stdout:(63/136): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2026-03-09T00:26:54.977 INFO:teuthology.orchestra.run.vm11.stdout:(33/136): ceph-volume-19.2.3-678.ge911bdeb.el9. 2.4 MB/s | 299 kB 00:00 2026-03-09T00:26:55.006 INFO:teuthology.orchestra.run.vm09.stdout:(64/136): openblas-0.3.29-1.el9.x86_64.rpm 345 kB/s | 42 kB 00:00 2026-03-09T00:26:55.104 INFO:teuthology.orchestra.run.vm11.stdout:(34/136): cephadm-19.2.3-678.ge911bdeb.el9.noar 5.9 MB/s | 769 kB 00:00 2026-03-09T00:26:55.162 INFO:teuthology.orchestra.run.vm11.stdout:(35/136): ceph-mgr-diskprediction-local-19.2.3- 7.8 MB/s | 7.4 MB 00:00 2026-03-09T00:26:55.233 INFO:teuthology.orchestra.run.vm11.stdout:(36/136): ledmon-libs-1.1.0-3.el9.x86_64.rpm 574 kB/s | 40 kB 00:00 2026-03-09T00:26:55.234 INFO:teuthology.orchestra.run.vm11.stdout:(37/136): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.6 MB/s | 351 kB 00:00 2026-03-09T00:26:55.294 INFO:teuthology.orchestra.run.vm11.stdout:(38/136): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-03-09T00:26:55.334 INFO:teuthology.orchestra.run.vm09.stdout:(65/136): openblas-openmp-0.3.29-1.el9.x86_64.r 13 MB/s | 5.3 MB 00:00 2026-03-09T00:26:55.354 INFO:teuthology.orchestra.run.vm11.stdout:(39/136): libgfortran-11.5.0-14.el9.x86_64.rpm 6.5 MB/s | 794 kB 00:00 2026-03-09T00:26:55.397 INFO:teuthology.orchestra.run.vm11.stdout:(40/136): libquadmath-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 184 kB 00:00 2026-03-09T00:26:55.397 INFO:teuthology.orchestra.run.vm11.stdout:(41/136): mailcap-2.1.49-5.el9.noarch.rpm 761 kB/s | 33 kB 00:00 2026-03-09T00:26:55.438 INFO:teuthology.orchestra.run.vm11.stdout:(42/136): pciutils-3.7.0-7.el9.x86_64.rpm 2.2 MB/s | 93 kB 00:00 2026-03-09T00:26:55.470 INFO:teuthology.orchestra.run.vm11.stdout:(43/136): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.4 MB/s | 253 kB 00:00 2026-03-09T00:26:55.565 INFO:teuthology.orchestra.run.vm09.stdout:(66/136): protobuf-3.14.0-17.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2026-03-09T00:26:55.622 INFO:teuthology.orchestra.run.vm09.stdout:(67/136): python3-devel-3.9.25-3.el9.x86_64.rpm 850 kB/s | 244 kB 00:00 2026-03-09T00:26:55.674 INFO:teuthology.orchestra.run.vm09.stdout:(68/136): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2026-03-09T00:26:55.675 INFO:teuthology.orchestra.run.vm11.stdout:(44/136): ceph-test-19.2.3-678.ge911bdeb.el9.x8 12 MB/s | 50 MB 00:04 2026-03-09T00:26:55.677 INFO:teuthology.orchestra.run.vm11.stdout:(45/136): python3-ply-3.11-14.el9.noarch.rpm 514 kB/s | 106 kB 00:00 2026-03-09T00:26:55.681 INFO:teuthology.orchestra.run.vm11.stdout:(46/136): python3-cryptography-36.0.1-5.el9.x86 5.1 MB/s | 1.2 MB 00:00 2026-03-09T00:26:55.710 INFO:teuthology.orchestra.run.vm09.stdout:(69/136): python3-jmespath-1.0.1-1.el9.noarch.r 544 kB/s | 48 kB 00:00 2026-03-09T00:26:55.713 INFO:teuthology.orchestra.run.vm11.stdout:(47/136): python3-requests-2.25.1-10.el9.noarch 3.5 MB/s | 126 kB 00:00 2026-03-09T00:26:55.759 INFO:teuthology.orchestra.run.vm11.stdout:(48/136): python3-urllib3-1.26.5-7.el9.noarch.r 2.7 MB/s | 218 kB 00:00 2026-03-09T00:26:55.788 INFO:teuthology.orchestra.run.vm09.stdout:(70/136): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 172 kB 00:00 2026-03-09T00:26:55.789 INFO:teuthology.orchestra.run.vm11.stdout:(49/136): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2026-03-09T00:26:55.789 INFO:teuthology.orchestra.run.vm09.stdout:(71/136): python3-libstoragemgmt-1.10.1-1.el9.x 1.5 MB/s | 177 kB 00:00 2026-03-09T00:26:55.794 INFO:teuthology.orchestra.run.vm11.stdout:(50/136): unzip-6.0-59.el9.x86_64.rpm 2.2 MB/s | 182 kB 00:00 2026-03-09T00:26:55.823 INFO:teuthology.orchestra.run.vm11.stdout:(51/136): zip-3.0-35.el9.x86_64.rpm 4.1 MB/s | 266 kB 00:00 2026-03-09T00:26:55.831 INFO:teuthology.orchestra.run.vm09.stdout:(72/136): python3-jinja2-2.11.3-8.el9.noarch.rp 936 kB/s | 249 kB 00:00 2026-03-09T00:26:55.863 INFO:teuthology.orchestra.run.vm09.stdout:(73/136): python3-markupsafe-1.1.1-12.el9.x86_6 468 kB/s | 35 kB 00:00 2026-03-09T00:26:55.905 INFO:teuthology.orchestra.run.vm11.stdout:(52/136): flexiblas-3.0.4-9.el9.x86_64.rpm 267 kB/s | 30 kB 00:00 2026-03-09T00:26:55.920 INFO:teuthology.orchestra.run.vm09.stdout:(74/136): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2026-03-09T00:26:55.938 INFO:teuthology.orchestra.run.vm09.stdout:(75/136): python3-numpy-f2py-1.23.5-2.el9.x86_6 4.0 MB/s | 442 kB 00:00 2026-03-09T00:26:55.982 INFO:teuthology.orchestra.run.vm11.stdout:(53/136): flexiblas-openblas-openmp-3.0.4-9.el9 192 kB/s | 15 kB 00:00 2026-03-09T00:26:55.995 INFO:teuthology.orchestra.run.vm09.stdout:(76/136): python3-protobuf-3.14.0-17.el9.noarch 3.5 MB/s | 267 kB 00:00 2026-03-09T00:26:56.008 INFO:teuthology.orchestra.run.vm09.stdout:(77/136): python3-pyasn1-0.4.8-7.el9.noarch.rpm 2.2 MB/s | 157 kB 00:00 2026-03-09T00:26:56.018 INFO:teuthology.orchestra.run.vm11.stdout:(54/136): boost-program-options-1.75.0-13.el9.x 455 kB/s | 104 kB 00:00 2026-03-09T00:26:56.078 INFO:teuthology.orchestra.run.vm09.stdout:(78/136): python3-requests-oauthlib-1.3.0-12.el 772 kB/s | 54 kB 00:00 2026-03-09T00:26:56.081 INFO:teuthology.orchestra.run.vm09.stdout:(79/136): python3-pyasn1-modules-0.4.8-7.el9.no 3.1 MB/s | 277 kB 00:00 2026-03-09T00:26:56.098 INFO:teuthology.orchestra.run.vm11.stdout:(55/136): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.0 MB/s | 160 kB 00:00 2026-03-09T00:26:56.157 INFO:teuthology.orchestra.run.vm09.stdout:(80/136): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2026-03-09T00:26:56.190 INFO:teuthology.orchestra.run.vm11.stdout:(56/136): libnbd-1.20.3-4.el9.x86_64.rpm 792 kB/s | 164 kB 00:00 2026-03-09T00:26:56.199 INFO:teuthology.orchestra.run.vm11.stdout:(57/136): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2026-03-09T00:26:56.238 INFO:teuthology.orchestra.run.vm09.stdout:(81/136): qatlib-25.08.0-2.el9.x86_64.rpm 2.9 MB/s | 240 kB 00:00 2026-03-09T00:26:56.290 INFO:teuthology.orchestra.run.vm11.stdout:(58/136): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.7 MB/s | 246 kB 00:00 2026-03-09T00:26:56.321 INFO:teuthology.orchestra.run.vm09.stdout:(82/136): qatlib-service-25.08.0-2.el9.x86_64.r 448 kB/s | 37 kB 00:00 2026-03-09T00:26:56.353 INFO:teuthology.orchestra.run.vm11.stdout:(59/136): libxslt-1.1.34-12.el9.x86_64.rpm 3.6 MB/s | 233 kB 00:00 2026-03-09T00:26:56.431 INFO:teuthology.orchestra.run.vm11.stdout:(60/136): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 292 kB 00:00 2026-03-09T00:26:56.434 INFO:teuthology.orchestra.run.vm09.stdout:(83/136): qatzip-libs-1.3.1-1.el9.x86_64.rpm 589 kB/s | 66 kB 00:00 2026-03-09T00:26:56.501 INFO:teuthology.orchestra.run.vm09.stdout:(84/136): python3-numpy-1.23.5-2.el9.x86_64.rpm 8.6 MB/s | 6.1 MB 00:00 2026-03-09T00:26:56.502 INFO:teuthology.orchestra.run.vm11.stdout:(61/136): lua-5.4.4-4.el9.x86_64.rpm 2.6 MB/s | 188 kB 00:00 2026-03-09T00:26:56.504 INFO:teuthology.orchestra.run.vm09.stdout:(85/136): socat-1.7.4.1-8.el9.x86_64.rpm 4.3 MB/s | 303 kB 00:00 2026-03-09T00:26:56.511 INFO:teuthology.orchestra.run.vm11.stdout:(62/136): flexiblas-netlib-3.0.4-9.el9.x86_64.r 4.3 MB/s | 3.0 MB 00:00 2026-03-09T00:26:56.541 INFO:teuthology.orchestra.run.vm11.stdout:(63/136): openblas-0.3.29-1.el9.x86_64.rpm 1.0 MB/s | 42 kB 00:00 2026-03-09T00:26:56.612 INFO:teuthology.orchestra.run.vm09.stdout:(86/136): xmlstarlet-1.6.1-20.el9.x86_64.rpm 579 kB/s | 64 kB 00:00 2026-03-09T00:26:56.613 INFO:teuthology.orchestra.run.vm11.stdout:(64/136): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 662 kB 00:00 2026-03-09T00:26:56.650 INFO:teuthology.orchestra.run.vm09.stdout:(87/136): lua-devel-5.4.4-4.el9.x86_64.rpm 152 kB/s | 22 kB 00:00 2026-03-09T00:26:56.666 INFO:teuthology.orchestra.run.vm09.stdout:(88/136): abseil-cpp-20211102.0-4.el9.x86_64.rp 33 MB/s | 551 kB 00:00 2026-03-09T00:26:56.674 INFO:teuthology.orchestra.run.vm09.stdout:(89/136): gperftools-libs-2.9.1-3.el9.x86_64.rp 42 MB/s | 308 kB 00:00 2026-03-09T00:26:56.676 INFO:teuthology.orchestra.run.vm09.stdout:(90/136): grpc-data-1.46.7-10.el9.noarch.rpm 7.3 MB/s | 19 kB 00:00 2026-03-09T00:26:56.742 INFO:teuthology.orchestra.run.vm09.stdout:(91/136): libarrow-9.0.0-15.el9.x86_64.rpm 67 MB/s | 4.4 MB 00:00 2026-03-09T00:26:56.746 INFO:teuthology.orchestra.run.vm09.stdout:(92/136): libarrow-doc-9.0.0-15.el9.noarch.rpm 7.5 MB/s | 25 kB 00:00 2026-03-09T00:26:56.749 INFO:teuthology.orchestra.run.vm09.stdout:(93/136): liboath-2.6.12-1.el9.x86_64.rpm 15 MB/s | 49 kB 00:00 2026-03-09T00:26:56.751 INFO:teuthology.orchestra.run.vm11.stdout:(65/136): protobuf-3.14.0-17.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2026-03-09T00:26:56.752 INFO:teuthology.orchestra.run.vm09.stdout:(94/136): libunwind-1.6.2-1.el9.x86_64.rpm 23 MB/s | 67 kB 00:00 2026-03-09T00:26:56.756 INFO:teuthology.orchestra.run.vm09.stdout:(95/136): luarocks-3.9.2-5.el9.noarch.rpm 40 MB/s | 151 kB 00:00 2026-03-09T00:26:56.769 INFO:teuthology.orchestra.run.vm09.stdout:(96/136): parquet-libs-9.0.0-15.el9.x86_64.rpm 65 MB/s | 838 kB 00:00 2026-03-09T00:26:56.778 INFO:teuthology.orchestra.run.vm09.stdout:(97/136): python3-asyncssh-2.13.2-5.el9.noarch. 63 MB/s | 548 kB 00:00 2026-03-09T00:26:56.782 INFO:teuthology.orchestra.run.vm09.stdout:(98/136): python3-autocommand-2.2.2-8.el9.noarc 8.8 MB/s | 29 kB 00:00 2026-03-09T00:26:56.785 INFO:teuthology.orchestra.run.vm09.stdout:(99/136): python3-backports-tarfile-1.2.0-1.el9 21 MB/s | 60 kB 00:00 2026-03-09T00:26:56.789 INFO:teuthology.orchestra.run.vm09.stdout:(100/136): python3-bcrypt-3.2.2-1.el9.x86_64.rp 12 MB/s | 43 kB 00:00 2026-03-09T00:26:56.792 INFO:teuthology.orchestra.run.vm09.stdout:(101/136): python3-cachetools-4.2.4-1.el9.noarc 12 MB/s | 32 kB 00:00 2026-03-09T00:26:56.795 INFO:teuthology.orchestra.run.vm09.stdout:(102/136): python3-certifi-2023.05.07-4.el9.noa 4.9 MB/s | 14 kB 00:00 2026-03-09T00:26:56.800 INFO:teuthology.orchestra.run.vm09.stdout:(103/136): python3-cheroot-10.0.1-4.el9.noarch. 37 MB/s | 173 kB 00:00 2026-03-09T00:26:56.810 INFO:teuthology.orchestra.run.vm09.stdout:(104/136): python3-cherrypy-18.6.1-2.el9.noarch 36 MB/s | 358 kB 00:00 2026-03-09T00:26:56.817 INFO:teuthology.orchestra.run.vm09.stdout:(105/136): python3-google-auth-2.45.0-1.el9.noa 39 MB/s | 254 kB 00:00 2026-03-09T00:26:56.845 INFO:teuthology.orchestra.run.vm09.stdout:(106/136): python3-grpcio-1.46.7-10.el9.x86_64. 75 MB/s | 2.0 MB 00:00 2026-03-09T00:26:56.849 INFO:teuthology.orchestra.run.vm09.stdout:(107/136): python3-grpcio-tools-1.46.7-10.el9.x 35 MB/s | 144 kB 00:00 2026-03-09T00:26:56.853 INFO:teuthology.orchestra.run.vm09.stdout:(108/136): python3-jaraco-8.2.1-3.el9.noarch.rp 3.0 MB/s | 11 kB 00:00 2026-03-09T00:26:56.856 INFO:teuthology.orchestra.run.vm09.stdout:(109/136): python3-jaraco-classes-3.2.1-5.el9.n 6.6 MB/s | 18 kB 00:00 2026-03-09T00:26:56.859 INFO:teuthology.orchestra.run.vm09.stdout:(110/136): python3-jaraco-collections-3.0.0-8.e 8.7 MB/s | 23 kB 00:00 2026-03-09T00:26:56.861 INFO:teuthology.orchestra.run.vm09.stdout:(111/136): python3-jaraco-context-6.0.1-3.el9.n 7.6 MB/s | 20 kB 00:00 2026-03-09T00:26:56.864 INFO:teuthology.orchestra.run.vm09.stdout:(112/136): python3-jaraco-functools-3.5.0-2.el9 7.8 MB/s | 19 kB 00:00 2026-03-09T00:26:56.866 INFO:teuthology.orchestra.run.vm11.stdout:(66/136): python3-devel-3.9.25-3.el9.x86_64.rpm 2.1 MB/s | 244 kB 00:00 2026-03-09T00:26:56.867 INFO:teuthology.orchestra.run.vm09.stdout:(113/136): python3-jaraco-text-4.0.0-2.el9.noar 9.6 MB/s | 26 kB 00:00 2026-03-09T00:26:56.881 INFO:teuthology.orchestra.run.vm09.stdout:(114/136): python3-kubernetes-26.1.0-3.el9.noar 71 MB/s | 1.0 MB 00:00 2026-03-09T00:26:56.884 INFO:teuthology.orchestra.run.vm09.stdout:(115/136): python3-logutils-0.3.5-21.el9.noarch 17 MB/s | 46 kB 00:00 2026-03-09T00:26:56.888 INFO:teuthology.orchestra.run.vm09.stdout:(116/136): python3-more-itertools-8.12.0-2.el9. 22 MB/s | 79 kB 00:00 2026-03-09T00:26:56.891 INFO:teuthology.orchestra.run.vm09.stdout:(117/136): python3-natsort-7.1.1-5.el9.noarch.r 21 MB/s | 58 kB 00:00 2026-03-09T00:26:56.897 INFO:teuthology.orchestra.run.vm09.stdout:(118/136): python3-pecan-1.4.2-3.el9.noarch.rpm 49 MB/s | 272 kB 00:00 2026-03-09T00:26:56.901 INFO:teuthology.orchestra.run.vm09.stdout:(119/136): python3-portend-3.1.0-2.el9.noarch.r 4.0 MB/s | 16 kB 00:00 2026-03-09T00:26:56.906 INFO:teuthology.orchestra.run.vm09.stdout:(120/136): python3-pyOpenSSL-21.0.0-1.el9.noarc 21 MB/s | 90 kB 00:00 2026-03-09T00:26:56.908 INFO:teuthology.orchestra.run.vm09.stdout:(121/136): python3-repoze-lru-0.7-16.el9.noarch 13 MB/s | 31 kB 00:00 2026-03-09T00:26:56.914 INFO:teuthology.orchestra.run.vm09.stdout:(122/136): python3-routes-2.5.1-5.el9.noarch.rp 34 MB/s | 188 kB 00:00 2026-03-09T00:26:56.918 INFO:teuthology.orchestra.run.vm09.stdout:(123/136): python3-rsa-4.9-2.el9.noarch.rpm 14 MB/s | 59 kB 00:00 2026-03-09T00:26:56.921 INFO:teuthology.orchestra.run.vm09.stdout:(124/136): python3-tempora-5.0.0-2.el9.noarch.r 15 MB/s | 36 kB 00:00 2026-03-09T00:26:56.924 INFO:teuthology.orchestra.run.vm09.stdout:(125/136): python3-typing-extensions-4.15.0-1.e 26 MB/s | 86 kB 00:00 2026-03-09T00:26:56.929 INFO:teuthology.orchestra.run.vm09.stdout:(126/136): python3-webob-1.8.8-2.el9.noarch.rpm 49 MB/s | 230 kB 00:00 2026-03-09T00:26:56.933 INFO:teuthology.orchestra.run.vm09.stdout:(127/136): python3-websocket-client-1.2.3-2.el9 27 MB/s | 90 kB 00:00 2026-03-09T00:26:56.941 INFO:teuthology.orchestra.run.vm09.stdout:(128/136): python3-werkzeug-2.0.3-3.el9.1.noarc 51 MB/s | 427 kB 00:00 2026-03-09T00:26:56.943 INFO:teuthology.orchestra.run.vm11.stdout:(67/136): python3-jinja2-2.11.3-8.el9.noarch.rp 3.2 MB/s | 249 kB 00:00 2026-03-09T00:26:56.944 INFO:teuthology.orchestra.run.vm09.stdout:(129/136): python3-xmltodict-0.12.0-15.el9.noar 7.7 MB/s | 22 kB 00:00 2026-03-09T00:26:56.948 INFO:teuthology.orchestra.run.vm09.stdout:(130/136): python3-zc-lockfile-2.0-10.el9.noarc 6.1 MB/s | 20 kB 00:00 2026-03-09T00:26:56.953 INFO:teuthology.orchestra.run.vm09.stdout:(131/136): re2-20211101-20.el9.x86_64.rpm 36 MB/s | 191 kB 00:00 2026-03-09T00:26:56.976 INFO:teuthology.orchestra.run.vm09.stdout:(132/136): thrift-0.15.0-4.el9.x86_64.rpm 71 MB/s | 1.6 MB 00:00 2026-03-09T00:26:56.987 INFO:teuthology.orchestra.run.vm11.stdout:(68/136): python3-jmespath-1.0.1-1.el9.noarch.r 1.1 MB/s | 48 kB 00:00 2026-03-09T00:26:57.055 INFO:teuthology.orchestra.run.vm09.stdout:(133/136): protobuf-compiler-3.14.0-17.el9.x86_ 1.9 MB/s | 862 kB 00:00 2026-03-09T00:26:57.107 INFO:teuthology.orchestra.run.vm11.stdout:(69/136): python3-libstoragemgmt-1.10.1-1.el9.x 1.4 MB/s | 177 kB 00:00 2026-03-09T00:26:57.168 INFO:teuthology.orchestra.run.vm11.stdout:(70/136): python3-mako-1.1.4-6.el9.noarch.rpm 2.7 MB/s | 172 kB 00:00 2026-03-09T00:26:57.223 INFO:teuthology.orchestra.run.vm11.stdout:(71/136): openblas-openmp-0.3.29-1.el9.x86_64.r 7.4 MB/s | 5.3 MB 00:00 2026-03-09T00:26:57.223 INFO:teuthology.orchestra.run.vm11.stdout:(72/136): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 35 kB 00:00 2026-03-09T00:26:57.372 INFO:teuthology.orchestra.run.vm11.stdout:(73/136): python3-numpy-f2py-1.23.5-2.el9.x86_6 2.9 MB/s | 442 kB 00:00 2026-03-09T00:26:57.443 INFO:teuthology.orchestra.run.vm09.stdout:(134/136): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-03-09T00:26:57.443 INFO:teuthology.orchestra.run.vm11.stdout:(74/136): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2026-03-09T00:26:57.535 INFO:teuthology.orchestra.run.vm11.stdout:(75/136): python3-protobuf-3.14.0-17.el9.noarch 2.8 MB/s | 267 kB 00:00 2026-03-09T00:26:57.633 INFO:teuthology.orchestra.run.vm11.stdout:(76/136): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.6 MB/s | 157 kB 00:00 2026-03-09T00:26:57.701 INFO:teuthology.orchestra.run.vm11.stdout:(77/136): python3-pyasn1-modules-0.4.8-7.el9.no 4.0 MB/s | 277 kB 00:00 2026-03-09T00:26:57.752 INFO:teuthology.orchestra.run.vm11.stdout:(78/136): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2026-03-09T00:26:58.066 INFO:teuthology.orchestra.run.vm09.stdout:(135/136): librados2-19.2.3-678.ge911bdeb.el9.x 3.1 MB/s | 3.4 MB 00:01 2026-03-09T00:26:58.074 INFO:teuthology.orchestra.run.vm09.stdout:(136/136): librbd1-19.2.3-678.ge911bdeb.el9.x86 3.1 MB/s | 3.2 MB 00:01 2026-03-09T00:26:58.078 INFO:teuthology.orchestra.run.vm09.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:26:58.079 INFO:teuthology.orchestra.run.vm09.stdout:Total 13 MB/s | 210 MB 00:15 2026-03-09T00:26:58.419 INFO:teuthology.orchestra.run.vm11.stdout:(79/136): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.1 MB/s | 6.1 MB 00:01 2026-03-09T00:26:58.479 INFO:teuthology.orchestra.run.vm11.stdout:(80/136): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2026-03-09T00:26:58.479 INFO:teuthology.orchestra.run.vm11.stdout:(81/136): python3-toml-0.10.2-6.el9.noarch.rpm 696 kB/s | 42 kB 00:00 2026-03-09T00:26:58.556 INFO:teuthology.orchestra.run.vm11.stdout:(82/136): qatlib-service-25.08.0-2.el9.x86_64.r 488 kB/s | 37 kB 00:00 2026-03-09T00:26:58.591 INFO:teuthology.orchestra.run.vm11.stdout:(83/136): qatlib-25.08.0-2.el9.x86_64.rpm 2.1 MB/s | 240 kB 00:00 2026-03-09T00:26:58.664 INFO:teuthology.orchestra.run.vm11.stdout:(84/136): qatzip-libs-1.3.1-1.el9.x86_64.rpm 614 kB/s | 66 kB 00:00 2026-03-09T00:26:58.675 INFO:teuthology.orchestra.run.vm09.stdout:Running transaction check 2026-03-09T00:26:58.700 INFO:teuthology.orchestra.run.vm11.stdout:(85/136): socat-1.7.4.1-8.el9.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2026-03-09T00:26:58.724 INFO:teuthology.orchestra.run.vm11.stdout:(86/136): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 64 kB 00:00 2026-03-09T00:26:58.726 INFO:teuthology.orchestra.run.vm09.stdout:Transaction check succeeded. 2026-03-09T00:26:58.726 INFO:teuthology.orchestra.run.vm09.stdout:Running transaction test 2026-03-09T00:26:59.310 INFO:teuthology.orchestra.run.vm11.stdout:(87/136): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2026-03-09T00:26:59.322 INFO:teuthology.orchestra.run.vm11.stdout:(88/136): abseil-cpp-20211102.0-4.el9.x86_64.rp 47 MB/s | 551 kB 00:00 2026-03-09T00:26:59.328 INFO:teuthology.orchestra.run.vm11.stdout:(89/136): gperftools-libs-2.9.1-3.el9.x86_64.rp 56 MB/s | 308 kB 00:00 2026-03-09T00:26:59.330 INFO:teuthology.orchestra.run.vm11.stdout:(90/136): grpc-data-1.46.7-10.el9.noarch.rpm 9.4 MB/s | 19 kB 00:00 2026-03-09T00:26:59.386 INFO:teuthology.orchestra.run.vm11.stdout:(91/136): libarrow-9.0.0-15.el9.x86_64.rpm 80 MB/s | 4.4 MB 00:00 2026-03-09T00:26:59.388 INFO:teuthology.orchestra.run.vm11.stdout:(92/136): libarrow-doc-9.0.0-15.el9.noarch.rpm 11 MB/s | 25 kB 00:00 2026-03-09T00:26:59.391 INFO:teuthology.orchestra.run.vm11.stdout:(93/136): liboath-2.6.12-1.el9.x86_64.rpm 20 MB/s | 49 kB 00:00 2026-03-09T00:26:59.393 INFO:teuthology.orchestra.run.vm11.stdout:(94/136): libunwind-1.6.2-1.el9.x86_64.rpm 25 MB/s | 67 kB 00:00 2026-03-09T00:26:59.397 INFO:teuthology.orchestra.run.vm11.stdout:(95/136): luarocks-3.9.2-5.el9.noarch.rpm 43 MB/s | 151 kB 00:00 2026-03-09T00:26:59.409 INFO:teuthology.orchestra.run.vm11.stdout:(96/136): parquet-libs-9.0.0-15.el9.x86_64.rpm 71 MB/s | 838 kB 00:00 2026-03-09T00:26:59.417 INFO:teuthology.orchestra.run.vm11.stdout:(97/136): python3-asyncssh-2.13.2-5.el9.noarch. 70 MB/s | 548 kB 00:00 2026-03-09T00:26:59.419 INFO:teuthology.orchestra.run.vm11.stdout:(98/136): python3-autocommand-2.2.2-8.el9.noarc 11 MB/s | 29 kB 00:00 2026-03-09T00:26:59.422 INFO:teuthology.orchestra.run.vm11.stdout:(99/136): python3-backports-tarfile-1.2.0-1.el9 23 MB/s | 60 kB 00:00 2026-03-09T00:26:59.424 INFO:teuthology.orchestra.run.vm11.stdout:(100/136): python3-bcrypt-3.2.2-1.el9.x86_64.rp 19 MB/s | 43 kB 00:00 2026-03-09T00:26:59.427 INFO:teuthology.orchestra.run.vm11.stdout:(101/136): python3-cachetools-4.2.4-1.el9.noarc 14 MB/s | 32 kB 00:00 2026-03-09T00:26:59.429 INFO:teuthology.orchestra.run.vm11.stdout:(102/136): python3-certifi-2023.05.07-4.el9.noa 6.6 MB/s | 14 kB 00:00 2026-03-09T00:26:59.433 INFO:teuthology.orchestra.run.vm11.stdout:(103/136): python3-cheroot-10.0.1-4.el9.noarch. 47 MB/s | 173 kB 00:00 2026-03-09T00:26:59.440 INFO:teuthology.orchestra.run.vm11.stdout:(104/136): python3-cherrypy-18.6.1-2.el9.noarch 56 MB/s | 358 kB 00:00 2026-03-09T00:26:59.444 INFO:teuthology.orchestra.run.vm11.stdout:(105/136): python3-google-auth-2.45.0-1.el9.noa 54 MB/s | 254 kB 00:00 2026-03-09T00:26:59.464 INFO:teuthology.orchestra.run.vm11.stdout:(106/136): protobuf-compiler-3.14.0-17.el9.x86_ 1.1 MB/s | 862 kB 00:00 2026-03-09T00:26:59.480 INFO:teuthology.orchestra.run.vm11.stdout:(107/136): python3-grpcio-1.46.7-10.el9.x86_64. 57 MB/s | 2.0 MB 00:00 2026-03-09T00:26:59.483 INFO:teuthology.orchestra.run.vm11.stdout:(108/136): python3-jaraco-8.2.1-3.el9.noarch.rp 5.2 MB/s | 11 kB 00:00 2026-03-09T00:26:59.484 INFO:teuthology.orchestra.run.vm11.stdout:(109/136): python3-grpcio-tools-1.46.7-10.el9.x 7.2 MB/s | 144 kB 00:00 2026-03-09T00:26:59.485 INFO:teuthology.orchestra.run.vm11.stdout:(110/136): python3-jaraco-classes-3.2.1-5.el9.n 8.6 MB/s | 18 kB 00:00 2026-03-09T00:26:59.487 INFO:teuthology.orchestra.run.vm11.stdout:(111/136): python3-jaraco-collections-3.0.0-8.e 6.9 MB/s | 23 kB 00:00 2026-03-09T00:26:59.488 INFO:teuthology.orchestra.run.vm11.stdout:(112/136): python3-jaraco-context-6.0.1-3.el9.n 7.5 MB/s | 20 kB 00:00 2026-03-09T00:26:59.489 INFO:teuthology.orchestra.run.vm11.stdout:(113/136): python3-jaraco-functools-3.5.0-2.el9 9.1 MB/s | 19 kB 00:00 2026-03-09T00:26:59.490 INFO:teuthology.orchestra.run.vm11.stdout:(114/136): python3-jaraco-text-4.0.0-2.el9.noar 12 MB/s | 26 kB 00:00 2026-03-09T00:26:59.493 INFO:teuthology.orchestra.run.vm11.stdout:(115/136): python3-logutils-0.3.5-21.el9.noarch 15 MB/s | 46 kB 00:00 2026-03-09T00:26:59.498 INFO:teuthology.orchestra.run.vm11.stdout:(116/136): python3-more-itertools-8.12.0-2.el9. 19 MB/s | 79 kB 00:00 2026-03-09T00:26:59.502 INFO:teuthology.orchestra.run.vm11.stdout:(117/136): python3-natsort-7.1.1-5.el9.noarch.r 15 MB/s | 58 kB 00:00 2026-03-09T00:26:59.505 INFO:teuthology.orchestra.run.vm11.stdout:(118/136): python3-kubernetes-26.1.0-3.el9.noar 65 MB/s | 1.0 MB 00:00 2026-03-09T00:26:59.507 INFO:teuthology.orchestra.run.vm11.stdout:(119/136): python3-pecan-1.4.2-3.el9.noarch.rpm 52 MB/s | 272 kB 00:00 2026-03-09T00:26:59.507 INFO:teuthology.orchestra.run.vm11.stdout:(120/136): python3-portend-3.1.0-2.el9.noarch.r 7.9 MB/s | 16 kB 00:00 2026-03-09T00:26:59.510 INFO:teuthology.orchestra.run.vm11.stdout:(121/136): python3-pyOpenSSL-21.0.0-1.el9.noarc 31 MB/s | 90 kB 00:00 2026-03-09T00:26:59.510 INFO:teuthology.orchestra.run.vm11.stdout:(122/136): python3-repoze-lru-0.7-16.el9.noarch 11 MB/s | 31 kB 00:00 2026-03-09T00:26:59.516 INFO:teuthology.orchestra.run.vm11.stdout:(123/136): python3-routes-2.5.1-5.el9.noarch.rp 31 MB/s | 188 kB 00:00 2026-03-09T00:26:59.517 INFO:teuthology.orchestra.run.vm11.stdout:(124/136): python3-rsa-4.9-2.el9.noarch.rpm 9.3 MB/s | 59 kB 00:00 2026-03-09T00:26:59.519 INFO:teuthology.orchestra.run.vm11.stdout:(125/136): python3-tempora-5.0.0-2.el9.noarch.r 13 MB/s | 36 kB 00:00 2026-03-09T00:26:59.520 INFO:teuthology.orchestra.run.vm11.stdout:(126/136): python3-typing-extensions-4.15.0-1.e 32 MB/s | 86 kB 00:00 2026-03-09T00:26:59.523 INFO:teuthology.orchestra.run.vm11.stdout:(127/136): python3-webob-1.8.8-2.el9.noarch.rpm 50 MB/s | 230 kB 00:00 2026-03-09T00:26:59.524 INFO:teuthology.orchestra.run.vm11.stdout:(128/136): python3-websocket-client-1.2.3-2.el9 20 MB/s | 90 kB 00:00 2026-03-09T00:26:59.526 INFO:teuthology.orchestra.run.vm11.stdout:(129/136): python3-xmltodict-0.12.0-15.el9.noar 11 MB/s | 22 kB 00:00 2026-03-09T00:26:59.529 INFO:teuthology.orchestra.run.vm11.stdout:(130/136): python3-zc-lockfile-2.0-10.el9.noarc 9.7 MB/s | 20 kB 00:00 2026-03-09T00:26:59.533 INFO:teuthology.orchestra.run.vm11.stdout:(131/136): re2-20211101-20.el9.x86_64.rpm 48 MB/s | 191 kB 00:00 2026-03-09T00:26:59.543 INFO:teuthology.orchestra.run.vm11.stdout:(132/136): python3-werkzeug-2.0.3-3.el9.1.noarc 22 MB/s | 427 kB 00:00 2026-03-09T00:26:59.554 INFO:teuthology.orchestra.run.vm11.stdout:(133/136): thrift-0.15.0-4.el9.x86_64.rpm 75 MB/s | 1.6 MB 00:00 2026-03-09T00:26:59.577 INFO:teuthology.orchestra.run.vm09.stdout:Transaction test succeeded. 2026-03-09T00:26:59.577 INFO:teuthology.orchestra.run.vm09.stdout:Running transaction 2026-03-09T00:27:00.468 INFO:teuthology.orchestra.run.vm11.stdout:(134/136): librbd1-19.2.3-678.ge911bdeb.el9.x86 3.5 MB/s | 3.2 MB 00:00 2026-03-09T00:27:00.515 INFO:teuthology.orchestra.run.vm09.stdout: Preparing : 1/1 2026-03-09T00:27:00.531 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/138 2026-03-09T00:27:00.544 INFO:teuthology.orchestra.run.vm09.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/138 2026-03-09T00:27:00.601 INFO:teuthology.orchestra.run.vm11.stdout:(135/136): librados2-19.2.3-678.ge911bdeb.el9.x 3.2 MB/s | 3.4 MB 00:01 2026-03-09T00:27:00.685 INFO:teuthology.orchestra.run.vm11.stdout:(136/136): python3-scipy-1.9.3-2.el9.x86_64.rpm 6.6 MB/s | 19 MB 00:02 2026-03-09T00:27:00.688 INFO:teuthology.orchestra.run.vm11.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:27:00.688 INFO:teuthology.orchestra.run.vm11.stdout:Total 14 MB/s | 210 MB 00:15 2026-03-09T00:27:00.715 INFO:teuthology.orchestra.run.vm09.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/138 2026-03-09T00:27:00.718 INFO:teuthology.orchestra.run.vm09.stdout: Upgrading : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:27:00.779 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:27:00.781 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T00:27:00.811 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T00:27:00.820 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T00:27:00.825 INFO:teuthology.orchestra.run.vm09.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/138 2026-03-09T00:27:00.827 INFO:teuthology.orchestra.run.vm09.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/138 2026-03-09T00:27:00.833 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/138 2026-03-09T00:27:00.843 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 10/138 2026-03-09T00:27:00.845 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:27:00.881 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:27:00.883 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T00:27:00.900 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T00:27:00.939 INFO:teuthology.orchestra.run.vm09.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/138 2026-03-09T00:27:00.981 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/138 2026-03-09T00:27:00.987 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 15/138 2026-03-09T00:27:01.014 INFO:teuthology.orchestra.run.vm09.stdout: Installing : liboath-2.6.12-1.el9.x86_64 16/138 2026-03-09T00:27:01.029 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 17/138 2026-03-09T00:27:01.037 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/138 2026-03-09T00:27:01.048 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/138 2026-03-09T00:27:01.056 INFO:teuthology.orchestra.run.vm09.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 20/138 2026-03-09T00:27:01.060 INFO:teuthology.orchestra.run.vm09.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/138 2026-03-09T00:27:01.066 INFO:teuthology.orchestra.run.vm09.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 22/138 2026-03-09T00:27:01.095 INFO:teuthology.orchestra.run.vm09.stdout: Installing : unzip-6.0-59.el9.x86_64 23/138 2026-03-09T00:27:01.115 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 24/138 2026-03-09T00:27:01.119 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 25/138 2026-03-09T00:27:01.126 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 26/138 2026-03-09T00:27:01.128 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 27/138 2026-03-09T00:27:01.160 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 28/138 2026-03-09T00:27:01.166 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 29/138 2026-03-09T00:27:01.177 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 30/138 2026-03-09T00:27:01.191 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 31/138 2026-03-09T00:27:01.200 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 32/138 2026-03-09T00:27:01.233 INFO:teuthology.orchestra.run.vm09.stdout: Installing : zip-3.0-35.el9.x86_64 33/138 2026-03-09T00:27:01.240 INFO:teuthology.orchestra.run.vm09.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/138 2026-03-09T00:27:01.250 INFO:teuthology.orchestra.run.vm09.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/138 2026-03-09T00:27:01.284 INFO:teuthology.orchestra.run.vm09.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 36/138 2026-03-09T00:27:01.310 INFO:teuthology.orchestra.run.vm11.stdout:Running transaction check 2026-03-09T00:27:01.350 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/138 2026-03-09T00:27:01.368 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 38/138 2026-03-09T00:27:01.370 INFO:teuthology.orchestra.run.vm11.stdout:Transaction check succeeded. 2026-03-09T00:27:01.370 INFO:teuthology.orchestra.run.vm11.stdout:Running transaction test 2026-03-09T00:27:01.376 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/138 2026-03-09T00:27:01.385 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/138 2026-03-09T00:27:01.392 INFO:teuthology.orchestra.run.vm09.stdout: Installing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 41/138 2026-03-09T00:27:01.397 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/138 2026-03-09T00:27:01.416 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 43/138 2026-03-09T00:27:01.443 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/138 2026-03-09T00:27:01.490 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 45/138 2026-03-09T00:27:01.497 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 46/138 2026-03-09T00:27:01.511 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/138 2026-03-09T00:27:01.523 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/138 2026-03-09T00:27:01.537 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/138 2026-03-09T00:27:01.603 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/138 2026-03-09T00:27:01.612 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/138 2026-03-09T00:27:01.622 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/138 2026-03-09T00:27:01.673 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/138 2026-03-09T00:27:02.082 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 54/138 2026-03-09T00:27:02.098 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 55/138 2026-03-09T00:27:02.104 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 56/138 2026-03-09T00:27:02.112 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 57/138 2026-03-09T00:27:02.117 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 58/138 2026-03-09T00:27:02.125 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/138 2026-03-09T00:27:02.129 INFO:teuthology.orchestra.run.vm09.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 60/138 2026-03-09T00:27:02.132 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 61/138 2026-03-09T00:27:02.164 INFO:teuthology.orchestra.run.vm09.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/138 2026-03-09T00:27:02.220 INFO:teuthology.orchestra.run.vm09.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 63/138 2026-03-09T00:27:02.235 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/138 2026-03-09T00:27:02.244 INFO:teuthology.orchestra.run.vm09.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 65/138 2026-03-09T00:27:02.249 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/138 2026-03-09T00:27:02.259 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/138 2026-03-09T00:27:02.265 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 68/138 2026-03-09T00:27:02.275 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/138 2026-03-09T00:27:02.282 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/138 2026-03-09T00:27:02.284 INFO:teuthology.orchestra.run.vm11.stdout:Transaction test succeeded. 2026-03-09T00:27:02.285 INFO:teuthology.orchestra.run.vm11.stdout:Running transaction 2026-03-09T00:27:02.317 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/138 2026-03-09T00:27:02.332 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 72/138 2026-03-09T00:27:02.380 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/138 2026-03-09T00:27:02.668 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 74/138 2026-03-09T00:27:02.702 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 75/138 2026-03-09T00:27:02.710 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 76/138 2026-03-09T00:27:02.779 INFO:teuthology.orchestra.run.vm09.stdout: Installing : openblas-0.3.29-1.el9.x86_64 77/138 2026-03-09T00:27:02.782 INFO:teuthology.orchestra.run.vm09.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 78/138 2026-03-09T00:27:02.810 INFO:teuthology.orchestra.run.vm09.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 79/138 2026-03-09T00:27:03.244 INFO:teuthology.orchestra.run.vm09.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 80/138 2026-03-09T00:27:03.313 INFO:teuthology.orchestra.run.vm11.stdout: Preparing : 1/1 2026-03-09T00:27:03.331 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/138 2026-03-09T00:27:03.349 INFO:teuthology.orchestra.run.vm11.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/138 2026-03-09T00:27:03.357 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 81/138 2026-03-09T00:27:03.532 INFO:teuthology.orchestra.run.vm11.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/138 2026-03-09T00:27:03.533 INFO:teuthology.orchestra.run.vm11.stdout: Upgrading : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:27:03.595 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:27:03.597 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T00:27:03.629 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T00:27:03.641 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T00:27:03.645 INFO:teuthology.orchestra.run.vm11.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/138 2026-03-09T00:27:03.649 INFO:teuthology.orchestra.run.vm11.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/138 2026-03-09T00:27:03.657 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/138 2026-03-09T00:27:03.686 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 10/138 2026-03-09T00:27:03.687 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:27:03.725 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:27:03.727 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T00:27:03.744 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T00:27:03.783 INFO:teuthology.orchestra.run.vm11.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/138 2026-03-09T00:27:03.823 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/138 2026-03-09T00:27:03.830 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 15/138 2026-03-09T00:27:03.858 INFO:teuthology.orchestra.run.vm11.stdout: Installing : liboath-2.6.12-1.el9.x86_64 16/138 2026-03-09T00:27:03.875 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 17/138 2026-03-09T00:27:03.884 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/138 2026-03-09T00:27:03.895 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/138 2026-03-09T00:27:03.902 INFO:teuthology.orchestra.run.vm11.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 20/138 2026-03-09T00:27:03.908 INFO:teuthology.orchestra.run.vm11.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/138 2026-03-09T00:27:03.916 INFO:teuthology.orchestra.run.vm11.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 22/138 2026-03-09T00:27:03.948 INFO:teuthology.orchestra.run.vm11.stdout: Installing : unzip-6.0-59.el9.x86_64 23/138 2026-03-09T00:27:03.966 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 24/138 2026-03-09T00:27:03.973 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 25/138 2026-03-09T00:27:03.981 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 26/138 2026-03-09T00:27:03.984 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 27/138 2026-03-09T00:27:04.020 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 28/138 2026-03-09T00:27:04.028 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 29/138 2026-03-09T00:27:04.040 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 30/138 2026-03-09T00:27:04.056 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 31/138 2026-03-09T00:27:04.065 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 32/138 2026-03-09T00:27:04.097 INFO:teuthology.orchestra.run.vm11.stdout: Installing : zip-3.0-35.el9.x86_64 33/138 2026-03-09T00:27:04.103 INFO:teuthology.orchestra.run.vm11.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/138 2026-03-09T00:27:04.114 INFO:teuthology.orchestra.run.vm11.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/138 2026-03-09T00:27:04.150 INFO:teuthology.orchestra.run.vm11.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 36/138 2026-03-09T00:27:04.216 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/138 2026-03-09T00:27:04.225 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 82/138 2026-03-09T00:27:04.234 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 38/138 2026-03-09T00:27:04.242 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/138 2026-03-09T00:27:04.252 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/138 2026-03-09T00:27:04.257 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 83/138 2026-03-09T00:27:04.259 INFO:teuthology.orchestra.run.vm11.stdout: Installing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 41/138 2026-03-09T00:27:04.263 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/138 2026-03-09T00:27:04.265 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 84/138 2026-03-09T00:27:04.270 INFO:teuthology.orchestra.run.vm09.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 85/138 2026-03-09T00:27:04.284 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 43/138 2026-03-09T00:27:04.312 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/138 2026-03-09T00:27:04.320 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 45/138 2026-03-09T00:27:04.327 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 46/138 2026-03-09T00:27:04.343 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/138 2026-03-09T00:27:04.356 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/138 2026-03-09T00:27:04.372 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/138 2026-03-09T00:27:04.435 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/138 2026-03-09T00:27:04.439 INFO:teuthology.orchestra.run.vm09.stdout: Upgrading : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T00:27:04.441 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/138 2026-03-09T00:27:04.451 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/138 2026-03-09T00:27:04.463 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/138 2026-03-09T00:27:04.475 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T00:27:04.479 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 88/138 2026-03-09T00:27:04.488 INFO:teuthology.orchestra.run.vm09.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 89/138 2026-03-09T00:27:04.517 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/138 2026-03-09T00:27:04.761 INFO:teuthology.orchestra.run.vm09.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 90/138 2026-03-09T00:27:04.764 INFO:teuthology.orchestra.run.vm09.stdout: Installing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T00:27:04.788 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T00:27:04.791 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 92/138 2026-03-09T00:27:04.944 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 54/138 2026-03-09T00:27:04.966 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 55/138 2026-03-09T00:27:05.038 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 56/138 2026-03-09T00:27:05.127 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 57/138 2026-03-09T00:27:05.244 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 58/138 2026-03-09T00:27:05.694 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/138 2026-03-09T00:27:05.701 INFO:teuthology.orchestra.run.vm11.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 60/138 2026-03-09T00:27:05.704 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 61/138 2026-03-09T00:27:05.741 INFO:teuthology.orchestra.run.vm11.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/138 2026-03-09T00:27:05.801 INFO:teuthology.orchestra.run.vm11.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 63/138 2026-03-09T00:27:05.816 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/138 2026-03-09T00:27:05.825 INFO:teuthology.orchestra.run.vm11.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 65/138 2026-03-09T00:27:05.831 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/138 2026-03-09T00:27:05.839 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/138 2026-03-09T00:27:05.845 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 68/138 2026-03-09T00:27:05.856 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/138 2026-03-09T00:27:05.861 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/138 2026-03-09T00:27:05.900 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/138 2026-03-09T00:27:05.916 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 72/138 2026-03-09T00:27:05.967 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/138 2026-03-09T00:27:06.025 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:27:06.030 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:27:06.056 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:27:06.074 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-ply-3.11-14.el9.noarch 94/138 2026-03-09T00:27:06.095 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 95/138 2026-03-09T00:27:06.199 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 96/138 2026-03-09T00:27:06.285 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 97/138 2026-03-09T00:27:06.288 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 74/138 2026-03-09T00:27:06.317 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 98/138 2026-03-09T00:27:06.318 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 75/138 2026-03-09T00:27:06.325 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 76/138 2026-03-09T00:27:06.357 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 99/138 2026-03-09T00:27:06.392 INFO:teuthology.orchestra.run.vm11.stdout: Installing : openblas-0.3.29-1.el9.x86_64 77/138 2026-03-09T00:27:06.395 INFO:teuthology.orchestra.run.vm11.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 78/138 2026-03-09T00:27:06.421 INFO:teuthology.orchestra.run.vm11.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 79/138 2026-03-09T00:27:06.422 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 100/138 2026-03-09T00:27:06.432 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 101/138 2026-03-09T00:27:06.437 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T00:27:06.443 INFO:teuthology.orchestra.run.vm09.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 103/138 2026-03-09T00:27:06.448 INFO:teuthology.orchestra.run.vm09.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 104/138 2026-03-09T00:27:06.450 INFO:teuthology.orchestra.run.vm09.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T00:27:06.471 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T00:27:06.802 INFO:teuthology.orchestra.run.vm09.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 106/138 2026-03-09T00:27:06.808 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T00:27:06.844 INFO:teuthology.orchestra.run.vm11.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 80/138 2026-03-09T00:27:06.858 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T00:27:06.858 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-03-09T00:27:06.858 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-03-09T00:27:06.858 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:06.863 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T00:27:06.944 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 81/138 2026-03-09T00:27:07.828 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 82/138 2026-03-09T00:27:07.866 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 83/138 2026-03-09T00:27:07.876 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 84/138 2026-03-09T00:27:07.882 INFO:teuthology.orchestra.run.vm11.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 85/138 2026-03-09T00:27:08.056 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/138 2026-03-09T00:27:08.059 INFO:teuthology.orchestra.run.vm11.stdout: Upgrading : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T00:27:08.096 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T00:27:08.101 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 88/138 2026-03-09T00:27:08.110 INFO:teuthology.orchestra.run.vm11.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 89/138 2026-03-09T00:27:08.407 INFO:teuthology.orchestra.run.vm11.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 90/138 2026-03-09T00:27:08.410 INFO:teuthology.orchestra.run.vm11.stdout: Installing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T00:27:08.432 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T00:27:08.436 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 92/138 2026-03-09T00:27:09.739 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:27:09.796 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:27:09.834 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:27:09.858 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-ply-3.11-14.el9.noarch 94/138 2026-03-09T00:27:09.882 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 95/138 2026-03-09T00:27:09.985 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 96/138 2026-03-09T00:27:10.001 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 97/138 2026-03-09T00:27:10.035 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 98/138 2026-03-09T00:27:10.078 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 99/138 2026-03-09T00:27:10.151 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 100/138 2026-03-09T00:27:10.163 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 101/138 2026-03-09T00:27:10.170 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T00:27:10.177 INFO:teuthology.orchestra.run.vm11.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 103/138 2026-03-09T00:27:10.182 INFO:teuthology.orchestra.run.vm11.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 104/138 2026-03-09T00:27:10.185 INFO:teuthology.orchestra.run.vm11.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T00:27:10.211 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T00:27:10.676 INFO:teuthology.orchestra.run.vm11.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 106/138 2026-03-09T00:27:10.682 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T00:27:10.729 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T00:27:10.729 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-03-09T00:27:10.729 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-03-09T00:27:10.729 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:10.735 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /sys 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /proc 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /mnt 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /var/tmp 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /home 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /root 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout:skipping the directory /tmp 2026-03-09T00:27:13.972 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:14.106 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T00:27:14.137 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T00:27:14.137 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:14.137 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T00:27:14.137 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T00:27:14.137 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T00:27:14.137 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:14.382 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T00:27:14.411 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T00:27:14.411 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:14.411 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T00:27:14.411 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T00:27:14.411 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T00:27:14.411 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:14.420 INFO:teuthology.orchestra.run.vm09.stdout: Installing : mailcap-2.1.49-5.el9.noarch 111/138 2026-03-09T00:27:14.423 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 112/138 2026-03-09T00:27:14.445 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:27:14.445 INFO:teuthology.orchestra.run.vm09.stdout:Creating group 'qat' with GID 994. 2026-03-09T00:27:14.445 INFO:teuthology.orchestra.run.vm09.stdout:Creating group 'libstoragemgmt' with GID 993. 2026-03-09T00:27:14.445 INFO:teuthology.orchestra.run.vm09.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 993 and GID 993. 2026-03-09T00:27:14.445 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:14.456 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:27:14.482 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:27:14.482 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-03-09T00:27:14.482 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:14.524 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 114/138 2026-03-09T00:27:14.602 INFO:teuthology.orchestra.run.vm09.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 115/138 2026-03-09T00:27:14.608 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T00:27:14.624 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T00:27:14.624 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:14.624 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T00:27:14.624 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:15.468 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T00:27:15.496 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T00:27:15.496 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:15.496 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T00:27:15.496 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T00:27:15.496 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T00:27:15.496 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:15.565 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T00:27:15.569 INFO:teuthology.orchestra.run.vm09.stdout: Installing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T00:27:15.575 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 119/138 2026-03-09T00:27:15.599 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 120/138 2026-03-09T00:27:15.603 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T00:27:16.184 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T00:27:16.190 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T00:27:16.789 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T00:27:16.905 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T00:27:16.975 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T00:27:17.113 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 124/138 2026-03-09T00:27:17.197 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T00:27:17.218 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T00:27:17.219 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:17.219 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T00:27:17.219 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T00:27:17.219 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T00:27:17.219 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:17.307 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T00:27:17.320 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T00:27:17.977 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 127/138 2026-03-09T00:27:18.045 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T00:27:18.069 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T00:27:18.072 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:18.072 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T00:27:18.072 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T00:27:18.072 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T00:27:18.072 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:18.186 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T00:27:18.211 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T00:27:18.211 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:18.211 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T00:27:18.211 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:18.476 INFO:teuthology.orchestra.run.vm09.stdout: Installing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T00:27:18.499 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T00:27:18.499 INFO:teuthology.orchestra.run.vm09.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:18.499 INFO:teuthology.orchestra.run.vm09.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T00:27:18.499 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T00:27:18.499 INFO:teuthology.orchestra.run.vm09.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T00:27:18.499 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /sys 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /proc 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /mnt 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /var/tmp 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /home 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /root 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout:skipping the directory /tmp 2026-03-09T00:27:18.733 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:18.868 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T00:27:18.896 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T00:27:18.896 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:18.896 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T00:27:18.896 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T00:27:18.896 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T00:27:18.896 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:19.143 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T00:27:19.169 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T00:27:19.169 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:19.169 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T00:27:19.169 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T00:27:19.169 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T00:27:19.169 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:19.179 INFO:teuthology.orchestra.run.vm11.stdout: Installing : mailcap-2.1.49-5.el9.noarch 111/138 2026-03-09T00:27:19.183 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 112/138 2026-03-09T00:27:19.208 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:27:19.208 INFO:teuthology.orchestra.run.vm11.stdout:Creating group 'qat' with GID 994. 2026-03-09T00:27:19.208 INFO:teuthology.orchestra.run.vm11.stdout:Creating group 'libstoragemgmt' with GID 993. 2026-03-09T00:27:19.208 INFO:teuthology.orchestra.run.vm11.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 993 and GID 993. 2026-03-09T00:27:19.208 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:19.222 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:27:19.255 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:27:19.255 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-03-09T00:27:19.255 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:19.298 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 114/138 2026-03-09T00:27:19.374 INFO:teuthology.orchestra.run.vm11.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 115/138 2026-03-09T00:27:19.378 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T00:27:19.394 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T00:27:19.394 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:19.394 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T00:27:19.394 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:20.250 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T00:27:20.274 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T00:27:20.274 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:20.274 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T00:27:20.274 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T00:27:20.274 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T00:27:20.274 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:20.332 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T00:27:20.335 INFO:teuthology.orchestra.run.vm11.stdout: Installing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T00:27:20.342 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 119/138 2026-03-09T00:27:20.368 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 120/138 2026-03-09T00:27:20.371 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T00:27:20.947 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T00:27:20.953 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T00:27:21.282 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 131/138 2026-03-09T00:27:21.295 INFO:teuthology.orchestra.run.vm09.stdout: Installing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 132/138 2026-03-09T00:27:21.302 INFO:teuthology.orchestra.run.vm09.stdout: Installing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 133/138 2026-03-09T00:27:21.365 INFO:teuthology.orchestra.run.vm09.stdout: Installing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 134/138 2026-03-09T00:27:21.376 INFO:teuthology.orchestra.run.vm09.stdout: Installing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T00:27:21.380 INFO:teuthology.orchestra.run.vm09.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 136/138 2026-03-09T00:27:21.380 INFO:teuthology.orchestra.run.vm09.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T00:27:21.399 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T00:27:21.399 INFO:teuthology.orchestra.run.vm09.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:27:21.549 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T00:27:21.551 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T00:27:21.618 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T00:27:21.679 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 124/138 2026-03-09T00:27:21.682 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T00:27:21.707 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T00:27:21.707 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:21.707 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T00:27:21.707 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T00:27:21.707 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T00:27:21.707 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:21.721 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T00:27:21.736 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T00:27:22.282 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 127/138 2026-03-09T00:27:22.410 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T00:27:22.438 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T00:27:22.438 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:22.438 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T00:27:22.438 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T00:27:22.438 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T00:27:22.438 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:22.449 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T00:27:22.478 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T00:27:22.478 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:22.479 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T00:27:22.479 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:22.697 INFO:teuthology.orchestra.run.vm11.stdout: Installing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T00:27:22.736 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T00:27:22.736 INFO:teuthology.orchestra.run.vm11.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:27:22.736 INFO:teuthology.orchestra.run.vm11.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T00:27:22.736 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T00:27:22.736 INFO:teuthology.orchestra.run.vm11.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T00:27:22.736 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 7/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 9/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 10/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 12/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 13/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 14/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 15/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 16/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 17/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 18/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 19/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 20/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 21/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 22/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 23/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 24/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 25/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 26/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 27/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 28/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 29/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 30/138 2026-03-09T00:27:22.974 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 31/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 32/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 33/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 34/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 35/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 36/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 37/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 38/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 39/138 2026-03-09T00:27:22.975 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 40/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 41/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 42/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 43/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 45/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-ply-3.11-14.el9.noarch 46/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 47/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 48/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 49/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : unzip-6.0-59.el9.x86_64 50/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : zip-3.0-35.el9.x86_64 51/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 52/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 53/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 54/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 55/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 56/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 60/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 61/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : lua-5.4.4-4.el9.x86_64 63/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 64/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 65/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 66/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 68/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 69/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 70/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 71/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 74/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 75/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 77/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 78/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 79/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/138 2026-03-09T00:27:22.977 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 81/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 83/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 84/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 85/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 86/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 88/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 89/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 90/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 91/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 92/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 93/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 94/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 95/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 96/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 97/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 98/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 99/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 100/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 101/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 105/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 107/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 108/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 109/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 113/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 115/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 116/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 127/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 128/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 131/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : re2-1:20211101-20.el9.x86_64 133/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 134/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/138 2026-03-09T00:27:22.978 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 137/138 2026-03-09T00:27:23.100 INFO:teuthology.orchestra.run.vm09.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:27:23.100 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout:Upgraded: 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout:Installed: 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: libxslt-1.1.34-12.el9.x86_64 2026-03-09T00:27:23.101 INFO:teuthology.orchestra.run.vm09.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: mailcap-2.1.49-5.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T00:27:23.102 INFO:teuthology.orchestra.run.vm09.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: zip-3.0-35.el9.x86_64 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:27:23.103 INFO:teuthology.orchestra.run.vm09.stdout:Complete! 2026-03-09T00:27:23.204 DEBUG:teuthology.parallel:result is None 2026-03-09T00:27:25.395 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 131/138 2026-03-09T00:27:25.408 INFO:teuthology.orchestra.run.vm11.stdout: Installing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 132/138 2026-03-09T00:27:25.414 INFO:teuthology.orchestra.run.vm11.stdout: Installing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 133/138 2026-03-09T00:27:25.474 INFO:teuthology.orchestra.run.vm11.stdout: Installing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 134/138 2026-03-09T00:27:25.484 INFO:teuthology.orchestra.run.vm11.stdout: Installing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T00:27:25.488 INFO:teuthology.orchestra.run.vm11.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 136/138 2026-03-09T00:27:25.488 INFO:teuthology.orchestra.run.vm11.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T00:27:25.506 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T00:27:25.506 INFO:teuthology.orchestra.run.vm11.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:27:27.030 INFO:teuthology.orchestra.run.vm11.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:27:27.030 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/138 2026-03-09T00:27:27.030 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 7/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 9/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 10/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 12/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 13/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 14/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 15/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 16/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 17/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 18/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 19/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 20/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 21/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 22/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 23/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 24/138 2026-03-09T00:27:27.031 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 25/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 26/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 27/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 28/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 29/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 30/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 31/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 32/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 33/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 34/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 35/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 36/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 37/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 38/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 39/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 40/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 41/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 42/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 43/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 45/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-ply-3.11-14.el9.noarch 46/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 47/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 48/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 49/138 2026-03-09T00:27:27.032 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : unzip-6.0-59.el9.x86_64 50/138 2026-03-09T00:27:27.033 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : zip-3.0-35.el9.x86_64 51/138 2026-03-09T00:27:27.033 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 52/138 2026-03-09T00:27:27.033 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 53/138 2026-03-09T00:27:27.033 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 54/138 2026-03-09T00:27:27.033 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 55/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 56/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 60/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 61/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : lua-5.4.4-4.el9.x86_64 63/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 64/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 65/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 66/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 68/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 69/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 70/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 71/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 74/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 75/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 77/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 78/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 79/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 81/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 83/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 84/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 85/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 86/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 88/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 89/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 90/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 91/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 92/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 93/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 94/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 95/138 2026-03-09T00:27:27.034 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 96/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 97/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 98/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 99/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 100/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 101/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 105/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 107/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 108/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 109/138 2026-03-09T00:27:27.035 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 113/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 115/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 116/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 127/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 128/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 131/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : re2-1:20211101-20.el9.x86_64 133/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 134/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/138 2026-03-09T00:27:27.036 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 137/138 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout:Upgraded: 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout:Installed: 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.145 INFO:teuthology.orchestra.run.vm11.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: libxslt-1.1.34-12.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: mailcap-2.1.49-5.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T00:27:27.146 INFO:teuthology.orchestra.run.vm11.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T00:27:27.147 INFO:teuthology.orchestra.run.vm11.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T00:27:27.148 INFO:teuthology.orchestra.run.vm11.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T00:27:27.148 INFO:teuthology.orchestra.run.vm11.stdout: zip-3.0-35.el9.x86_64 2026-03-09T00:27:27.148 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:27:27.148 INFO:teuthology.orchestra.run.vm11.stdout:Complete! 2026-03-09T00:27:27.249 DEBUG:teuthology.parallel:result is None 2026-03-09T00:27:27.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:27:27.876 DEBUG:teuthology.orchestra.run.vm09:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-03-09T00:27:27.896 INFO:teuthology.orchestra.run.vm09.stdout:19.2.3-678.ge911bdeb.el9 2026-03-09T00:27:27.896 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-678.ge911bdeb.el9 2026-03-09T00:27:27.896 INFO:teuthology.task.install:The correct ceph version 19.2.3-678.ge911bdeb is installed. 2026-03-09T00:27:27.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:27:28.510 DEBUG:teuthology.orchestra.run.vm11:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-03-09T00:27:28.532 INFO:teuthology.orchestra.run.vm11.stdout:19.2.3-678.ge911bdeb.el9 2026-03-09T00:27:28.533 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-678.ge911bdeb.el9 2026-03-09T00:27:28.533 INFO:teuthology.task.install:The correct ceph version 19.2.3-678.ge911bdeb is installed. 2026-03-09T00:27:28.533 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-03-09T00:27:28.534 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:27:28.534 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-03-09T00:27:28.561 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:27:28.561 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-03-09T00:27:28.608 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-03-09T00:27:28.609 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:27:28.609 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/usr/bin/daemon-helper 2026-03-09T00:27:28.637 DEBUG:teuthology.orchestra.run.vm09:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-03-09T00:27:28.705 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:27:28.705 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/usr/bin/daemon-helper 2026-03-09T00:27:28.734 DEBUG:teuthology.orchestra.run.vm11:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-03-09T00:27:28.800 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-03-09T00:27:28.800 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:27:28.800 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/usr/bin/adjust-ulimits 2026-03-09T00:27:28.828 DEBUG:teuthology.orchestra.run.vm09:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-03-09T00:27:28.893 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:27:28.893 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/usr/bin/adjust-ulimits 2026-03-09T00:27:28.919 DEBUG:teuthology.orchestra.run.vm11:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-03-09T00:27:28.983 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-03-09T00:27:28.983 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:27:28.983 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/usr/bin/stdin-killer 2026-03-09T00:27:29.008 DEBUG:teuthology.orchestra.run.vm09:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-03-09T00:27:29.070 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:27:29.070 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/usr/bin/stdin-killer 2026-03-09T00:27:29.096 DEBUG:teuthology.orchestra.run.vm11:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-03-09T00:27:29.162 INFO:teuthology.run_tasks:Running task cephadm... 2026-03-09T00:27:29.212 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd mclock iops capacity threshold hdd': 49000, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', 'CEPHADM_STRAY_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'cephadm_mode': 'cephadm-package'} 2026-03-09T00:27:29.212 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:27:29.212 INFO:tasks.cephadm:Cluster fsid is c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:27:29.212 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-03-09T00:27:29.212 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '192.168.123.109', 'mon.c': '[v2:192.168.123.109:3301,v1:192.168.123.109:6790]', 'mon.b': '192.168.123.111'} 2026-03-09T00:27:29.212 INFO:tasks.cephadm:First mon is mon.a on vm09 2026-03-09T00:27:29.212 INFO:tasks.cephadm:First mgr is y 2026-03-09T00:27:29.212 INFO:tasks.cephadm:Normalizing hostnames... 2026-03-09T00:27:29.212 DEBUG:teuthology.orchestra.run.vm09:> sudo hostname $(hostname -s) 2026-03-09T00:27:29.235 DEBUG:teuthology.orchestra.run.vm11:> sudo hostname $(hostname -s) 2026-03-09T00:27:29.264 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df on all hosts... 2026-03-09T00:27:29.264 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T00:27:29.277 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T00:27:29.450 INFO:teuthology.orchestra.run.vm09.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:27:29.471 INFO:teuthology.orchestra.run.vm11.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout:{ 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout: "repo_digests": [ 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout: ] 2026-03-09T00:28:55.546 INFO:teuthology.orchestra.run.vm09.stdout:} 2026-03-09T00:29:04.046 INFO:teuthology.orchestra.run.vm11.stdout:{ 2026-03-09T00:29:04.046 INFO:teuthology.orchestra.run.vm11.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T00:29:04.047 INFO:teuthology.orchestra.run.vm11.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T00:29:04.047 INFO:teuthology.orchestra.run.vm11.stdout: "repo_digests": [ 2026-03-09T00:29:04.047 INFO:teuthology.orchestra.run.vm11.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T00:29:04.047 INFO:teuthology.orchestra.run.vm11.stdout: ] 2026-03-09T00:29:04.047 INFO:teuthology.orchestra.run.vm11.stdout:} 2026-03-09T00:29:04.073 DEBUG:teuthology.orchestra.run.vm09:> sudo mkdir -p /etc/ceph 2026-03-09T00:29:04.104 DEBUG:teuthology.orchestra.run.vm11:> sudo mkdir -p /etc/ceph 2026-03-09T00:29:04.136 DEBUG:teuthology.orchestra.run.vm09:> sudo chmod 777 /etc/ceph 2026-03-09T00:29:04.171 DEBUG:teuthology.orchestra.run.vm11:> sudo chmod 777 /etc/ceph 2026-03-09T00:29:04.203 INFO:tasks.cephadm:Writing seed config... 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [global] ms type = async 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [osd] osd class default list = * 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [osd] osd class load list = * 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [osd] osd mclock iops capacity threshold hdd = 49000 2026-03-09T00:29:04.203 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-03-09T00:29:04.203 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:04.204 DEBUG:teuthology.orchestra.run.vm09:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-03-09T00:29:04.230 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c172d940-1b4e-11f1-be3e-fb1b568ebce1 mon election default strategy = 1 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * osd mclock iops capacity threshold hdd = 49000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2026-03-09T00:29:04.230 DEBUG:teuthology.orchestra.run.vm09:mon.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.a.service 2026-03-09T00:29:04.273 DEBUG:teuthology.orchestra.run.vm09:mgr.y> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mgr.y.service 2026-03-09T00:29:04.315 INFO:tasks.cephadm:Bootstrapping... 2026-03-09T00:29:04.315 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df -v bootstrap --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 192.168.123.109 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:04.472 INFO:teuthology.orchestra.run.vm09.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:29:04.472 INFO:teuthology.orchestra.run.vm09.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df', '-v', 'bootstrap', '--fsid', 'c172d940-1b4e-11f1-be3e-fb1b568ebce1', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '192.168.123.109', '--skip-admin-label'] 2026-03-09T00:29:04.472 INFO:teuthology.orchestra.run.vm09.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-03-09T00:29:04.472 INFO:teuthology.orchestra.run.vm09.stdout:Verifying podman|docker is present... 2026-03-09T00:29:04.494 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stdout 5.8.0 2026-03-09T00:29:04.495 INFO:teuthology.orchestra.run.vm09.stdout:Verifying lvm2 is present... 2026-03-09T00:29:04.495 INFO:teuthology.orchestra.run.vm09.stdout:Verifying time synchronization is in place... 2026-03-09T00:29:04.503 INFO:teuthology.orchestra.run.vm09.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T00:29:04.503 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T00:29:04.510 INFO:teuthology.orchestra.run.vm09.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T00:29:04.510 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stdout inactive 2026-03-09T00:29:04.517 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stdout enabled 2026-03-09T00:29:04.524 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stdout active 2026-03-09T00:29:04.524 INFO:teuthology.orchestra.run.vm09.stdout:Unit chronyd.service is enabled and running 2026-03-09T00:29:04.524 INFO:teuthology.orchestra.run.vm09.stdout:Repeating the final host check... 2026-03-09T00:29:04.546 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stdout 5.8.0 2026-03-09T00:29:04.546 INFO:teuthology.orchestra.run.vm09.stdout:podman (/bin/podman) version 5.8.0 is present 2026-03-09T00:29:04.546 INFO:teuthology.orchestra.run.vm09.stdout:systemctl is present 2026-03-09T00:29:04.546 INFO:teuthology.orchestra.run.vm09.stdout:lvcreate is present 2026-03-09T00:29:04.553 INFO:teuthology.orchestra.run.vm09.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T00:29:04.553 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T00:29:04.560 INFO:teuthology.orchestra.run.vm09.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T00:29:04.560 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stdout inactive 2026-03-09T00:29:04.567 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stdout enabled 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stdout active 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:Unit chronyd.service is enabled and running 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:Host looks OK 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:Cluster fsid: c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:Acquiring lock 139917469325200 on /run/cephadm/c172d940-1b4e-11f1-be3e-fb1b568ebce1.lock 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:Lock 139917469325200 acquired on /run/cephadm/c172d940-1b4e-11f1-be3e-fb1b568ebce1.lock 2026-03-09T00:29:04.573 INFO:teuthology.orchestra.run.vm09.stdout:Verifying IP 192.168.123.109 port 3300 ... 2026-03-09T00:29:04.574 INFO:teuthology.orchestra.run.vm09.stdout:Verifying IP 192.168.123.109 port 6789 ... 2026-03-09T00:29:04.574 INFO:teuthology.orchestra.run.vm09.stdout:Base mon IP(s) is [192.168.123.109:3300, 192.168.123.109:6789], mon addrv is [v2:192.168.123.109:3300,v1:192.168.123.109:6789] 2026-03-09T00:29:04.577 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout default via 192.168.123.1 dev eth0 proto dhcp src 192.168.123.109 metric 100 2026-03-09T00:29:04.577 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout 192.168.123.0/24 dev eth0 proto kernel scope link src 192.168.123.109 metric 100 2026-03-09T00:29:04.580 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-03-09T00:29:04.580 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout fe80::/64 dev eth0 proto kernel metric 1024 pref medium 2026-03-09T00:29:04.582 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-03-09T00:29:04.582 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout 2: eth0: mtu 1500 state UP qlen 1000 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout inet6 fe80::5055:ff:fe00:9/64 scope link noprefixroute 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:Mon IP `192.168.123.109` is in CIDR network `192.168.123.0/24` 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:Mon IP `192.168.123.109` is in CIDR network `192.168.123.0/24` 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:Inferred mon public CIDR from local network configuration ['192.168.123.0/24', '192.168.123.0/24'] 2026-03-09T00:29:04.583 INFO:teuthology.orchestra.run.vm09.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-03-09T00:29:04.584 INFO:teuthology.orchestra.run.vm09.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stdout 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stderr Getting image source signatures 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stderr Copying blob sha256:1752b8d01aa0dd33bbe0ab24e8316174c94fbdcd5d26252e2680bba0624747a7 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stderr Copying config sha256:654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T00:29:05.813 INFO:teuthology.orchestra.run.vm09.stdout:/bin/podman: stderr Writing manifest to image destination 2026-03-09T00:29:05.974 INFO:teuthology.orchestra.run.vm09.stdout:ceph: stdout ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T00:29:05.975 INFO:teuthology.orchestra.run.vm09.stdout:Ceph version: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T00:29:05.975 INFO:teuthology.orchestra.run.vm09.stdout:Extracting ceph user uid/gid from container image... 2026-03-09T00:29:06.083 INFO:teuthology.orchestra.run.vm09.stdout:stat: stdout 167 167 2026-03-09T00:29:06.083 INFO:teuthology.orchestra.run.vm09.stdout:Creating initial keys... 2026-03-09T00:29:06.212 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph-authtool: stdout AQBSFK5pnYj8CRAAxJYeD/SYxOPEEne1X3I4rA== 2026-03-09T00:29:06.312 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph-authtool: stdout AQBSFK5p30KFERAADXGWty5DaCFVDARQkFj0FA== 2026-03-09T00:29:06.412 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph-authtool: stdout AQBSFK5prrVnFxAA0HGcrJQ1aKH8B8WAMdvQlw== 2026-03-09T00:29:06.413 INFO:teuthology.orchestra.run.vm09.stdout:Creating initial monmap... 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:monmaptool for a [v2:192.168.123.109:3300,v1:192.168.123.109:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:setting min_mon_release = quincy 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/monmaptool: set fsid to c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:06.520 INFO:teuthology.orchestra.run.vm09.stdout:Creating mon... 2026-03-09T00:29:06.737 INFO:teuthology.orchestra.run.vm09.stdout:create mon.a on 2026-03-09T00:29:06.945 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-03-09T00:29:07.075 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-03-09T00:29:07.225 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1.target → /etc/systemd/system/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1.target. 2026-03-09T00:29:07.225 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1.target → /etc/systemd/system/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1.target. 2026-03-09T00:29:07.402 INFO:teuthology.orchestra.run.vm09.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.a 2026-03-09T00:29:07.402 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.a.service: Unit ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.a.service not loaded. 2026-03-09T00:29:07.549 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1.target.wants/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.a.service → /etc/systemd/system/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@.service. 2026-03-09T00:29:07.751 INFO:teuthology.orchestra.run.vm09.stdout:firewalld does not appear to be present 2026-03-09T00:29:07.751 INFO:teuthology.orchestra.run.vm09.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T00:29:07.751 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for mon to start... 2026-03-09T00:29:07.751 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for mon... 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout cluster: 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout id: c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout services: 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.148547s) 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout data: 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout pgs: 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.886+0000 7faf898b4640 1 Processor -- start 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.888+0000 7faf898b4640 1 -- start start 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.888+0000 7faf898b4640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf84108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.888+0000 7faf898b4640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7faf84109540 con 0x7faf84108b70 2026-03-09T00:29:07.963 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.888+0000 7faf82ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf84108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.888+0000 7faf82ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf84108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:35626/0 (socket says 192.168.123.109:35626) 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.888+0000 7faf82ffd640 1 -- 192.168.123.109:0/261487928 learned_addr learned my addr 192.168.123.109:0/261487928 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.890+0000 7faf82ffd640 1 -- 192.168.123.109:0/261487928 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf84109d70 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.890+0000 7faf82ffd640 1 --2- 192.168.123.109:0/261487928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf84108f70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009b80 tx=0x7faf6c02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b122a075ec2bc8f server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.891+0000 7faf81ffb640 1 -- 192.168.123.109:0/261487928 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf6c03c070 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.891+0000 7faf81ffb640 1 -- 192.168.123.109:0/261487928 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c02fb40 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.891+0000 7faf81ffb640 1 -- 192.168.123.109:0/261487928 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf6c02fe40 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.891+0000 7faf898b4640 1 -- 192.168.123.109:0/261487928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 msgr2=0x7faf84108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.891+0000 7faf898b4640 1 --2- 192.168.123.109:0/261487928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf84108f70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009b80 tx=0x7faf6c02f190 comp rx=0 tx=0).stop 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.892+0000 7faf898b4640 1 -- 192.168.123.109:0/261487928 shutdown_connections 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.892+0000 7faf898b4640 1 --2- 192.168.123.109:0/261487928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf84108f70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.892+0000 7faf898b4640 1 -- 192.168.123.109:0/261487928 >> 192.168.123.109:0/261487928 conn(0x7faf8407c040 msgr2=0x7faf8407c450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.892+0000 7faf898b4640 1 -- 192.168.123.109:0/261487928 shutdown_connections 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.892+0000 7faf898b4640 1 -- 192.168.123.109:0/261487928 wait complete. 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf898b4640 1 Processor -- start 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf898b4640 1 -- start start 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf898b4640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf8419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf898b4640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7faf8410a2a0 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf82ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf8419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf82ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf8419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:35632/0 (socket says 192.168.123.109:35632) 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.893+0000 7faf82ffd640 1 -- 192.168.123.109:0/2858185486 learned_addr learned my addr 192.168.123.109:0/2858185486 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.894+0000 7faf82ffd640 1 -- 192.168.123.109:0/2858185486 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8419e750 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.894+0000 7faf82ffd640 1 --2- 192.168.123.109:0/2858185486 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf8419e210 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faf6c002410 tx=0x7faf6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.894+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf6c03c070 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.894+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c046070 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.894+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf6c003b70 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.895+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8419e9e0 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.895+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841a16d0 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.896+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7faf6c0375a0 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.896+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faf6c041570 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.896+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8410a8f0 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.897+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7faf6c037960 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.932+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7faf841970f0 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.932+0000 7faf888b2640 1 -- 192.168.123.109:0/2858185486 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7faf6c037b40 con 0x7faf84108b70 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 msgr2=0x7faf8419e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 --2- 192.168.123.109:0/2858185486 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf8419e210 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faf6c002410 tx=0x7faf6c0047c0 comp rx=0 tx=0).stop 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 shutdown_connections 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 --2- 192.168.123.109:0/2858185486 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7faf84108b70 0x7faf8419e210 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 >> 192.168.123.109:0/2858185486 conn(0x7faf8407c040 msgr2=0x7faf84192500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 shutdown_connections 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:07.934+0000 7faf898b4640 1 -- 192.168.123.109:0/2858185486 wait complete. 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:mon is available 2026-03-09T00:29:07.964 INFO:teuthology.orchestra.run.vm09.stdout:Assimilating anything we can from ceph.conf... 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout fsid = c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.109:3300,v1:192.168.123.109:6789] 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.092+0000 7fc1e9e09640 1 Processor -- start 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e9e09640 1 -- start start 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e9e09640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e9e09640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4109540 con 0x7fc1e4108b70 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e37fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e37fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:35646/0 (socket says 192.168.123.109:35646) 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e37fe640 1 -- 192.168.123.109:0/1418106310 learned_addr learned my addr 192.168.123.109:0/1418106310 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.093+0000 7fc1e37fe640 1 -- 192.168.123.109:0/1418106310 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4109d70 con 0x7fc1e4108b70 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.094+0000 7fc1e37fe640 1 --2- 192.168.123.109:0/1418106310 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4108f70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1d401c080 tx=0x7fc1d4040520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dff1474b3352fd6 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.094+0000 7fc1e27fc640 1 -- 192.168.123.109:0/1418106310 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d404c070 con 0x7fc1e4108b70 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.094+0000 7fc1e27fc640 1 -- 192.168.123.109:0/1418106310 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d401a200 con 0x7fc1e4108b70 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 -- 192.168.123.109:0/1418106310 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 msgr2=0x7fc1e4108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 --2- 192.168.123.109:0/1418106310 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4108f70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1d401c080 tx=0x7fc1d4040520 comp rx=0 tx=0).stop 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 -- 192.168.123.109:0/1418106310 shutdown_connections 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 --2- 192.168.123.109:0/1418106310 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4108f70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 -- 192.168.123.109:0/1418106310 >> 192.168.123.109:0/1418106310 conn(0x7fc1e407c040 msgr2=0x7fc1e407c450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 -- 192.168.123.109:0/1418106310 shutdown_connections 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 -- 192.168.123.109:0/1418106310 wait complete. 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.095+0000 7fc1e9e09640 1 Processor -- start 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e9e09640 1 -- start start 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e9e09640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e9e09640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410a1e0 con 0x7fc1e4108b70 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e37fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e37fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:35658/0 (socket says 192.168.123.109:35658) 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e37fe640 1 -- 192.168.123.109:0/2456628273 learned_addr learned my addr 192.168.123.109:0/2456628273 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:08.178 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.096+0000 7fc1e37fe640 1 -- 192.168.123.109:0/2456628273 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4195bc0 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.097+0000 7fc1e37fe640 1 --2- 192.168.123.109:0/2456628273 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4195680 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4040a50 tx=0x7fc1d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.097+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d4056020 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.097+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d404d040 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.097+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d404c070 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.097+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e4195e50 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.097+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e4198b40 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.098+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc1d4063050 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.098+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc1d4052420 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.098+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b0005180 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.099+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc1d401a2e0 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.131+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc1b0003c00 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.135+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+380 (secure 0 0 0) 0x7fc1d4003710 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.135+0000 7fc1e0ff9640 1 -- 192.168.123.109:0/2456628273 <== mon.0 v2:192.168.123.109:3300/0 8 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fc1d406c830 con 0x7fc1e4108b70 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 msgr2=0x7fc1e4195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 --2- 192.168.123.109:0/2456628273 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4195680 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4040a50 tx=0x7fc1d40047c0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 shutdown_connections 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 --2- 192.168.123.109:0/2456628273 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc1e4108b70 0x7fc1e4195680 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 >> 192.168.123.109:0/2456628273 conn(0x7fc1e407c040 msgr2=0x7fc1e406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 shutdown_connections 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.137+0000 7fc1e9e09640 1 -- 192.168.123.109:0/2456628273 wait complete. 2026-03-09T00:29:08.179 INFO:teuthology.orchestra.run.vm09.stdout:Generating new minimal ceph.conf... 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.306+0000 7ff295adc640 1 Processor -- start 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.307+0000 7ff295adc640 1 -- start start 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.307+0000 7ff295adc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff290108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.307+0000 7ff295adc640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff290109540 con 0x7ff290108b70 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.307+0000 7ff28f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff290108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.307+0000 7ff28f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff290108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:35672/0 (socket says 192.168.123.109:35672) 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.307+0000 7ff28f7fe640 1 -- 192.168.123.109:0/3192645993 learned_addr learned my addr 192.168.123.109:0/3192645993 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.308+0000 7ff28f7fe640 1 -- 192.168.123.109:0/3192645993 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff290109d70 con 0x7ff290108b70 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.308+0000 7ff28f7fe640 1 --2- 192.168.123.109:0/3192645993 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff290108f70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff280009920 tx=0x7ff28002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da318b98ecc51587 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.308+0000 7ff28e7fc640 1 -- 192.168.123.109:0/3192645993 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28003c070 con 0x7ff290108b70 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.308+0000 7ff28e7fc640 1 -- 192.168.123.109:0/3192645993 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7ff280037440 con 0x7ff290108b70 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff28e7fc640 1 -- 192.168.123.109:0/3192645993 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2800354d0 con 0x7ff290108b70 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 -- 192.168.123.109:0/3192645993 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 msgr2=0x7ff290108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 --2- 192.168.123.109:0/3192645993 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff290108f70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff280009920 tx=0x7ff28002ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 -- 192.168.123.109:0/3192645993 shutdown_connections 2026-03-09T00:29:08.399 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 --2- 192.168.123.109:0/3192645993 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff290108f70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 -- 192.168.123.109:0/3192645993 >> 192.168.123.109:0/3192645993 conn(0x7ff29007c040 msgr2=0x7ff29007c450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 -- 192.168.123.109:0/3192645993 shutdown_connections 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.309+0000 7ff295adc640 1 -- 192.168.123.109:0/3192645993 wait complete. 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff295adc640 1 Processor -- start 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff295adc640 1 -- start start 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff295adc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff29019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff295adc640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff29010cfa0 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff28f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff29019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff28f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff29019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:35688/0 (socket says 192.168.123.109:35688) 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff28f7fe640 1 -- 192.168.123.109:0/1994219525 learned_addr learned my addr 192.168.123.109:0/1994219525 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.310+0000 7ff28f7fe640 1 -- 192.168.123.109:0/1994219525 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29019eea0 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.311+0000 7ff28f7fe640 1 --2- 192.168.123.109:0/1994219525 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff29019e960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff280006fd0 tx=0x7ff280035dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.311+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff280045070 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.311+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7ff28002fbc0 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.311+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28003c070 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.311+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29019f130 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.311+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29019f550 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.312+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff28004a430 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.312+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff280049ae0 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.312+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff290108ff0 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.314+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7ff280049d30 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.347+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff29007d080 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.349+0000 7ff28cff9640 1 -- 192.168.123.109:0/1994219525 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+181 (secure 0 0 0) 0x7ff280040450 con 0x7ff290108b70 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 msgr2=0x7ff29019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 --2- 192.168.123.109:0/1994219525 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff29019e960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff280006fd0 tx=0x7ff280035dc0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 shutdown_connections 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 --2- 192.168.123.109:0/1994219525 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff290108b70 0x7ff29019e960 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 >> 192.168.123.109:0/1994219525 conn(0x7ff29007c040 msgr2=0x7ff290105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 shutdown_connections 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.351+0000 7ff295adc640 1 -- 192.168.123.109:0/1994219525 wait complete. 2026-03-09T00:29:08.400 INFO:teuthology.orchestra.run.vm09.stdout:Restarting the monitor... 2026-03-09T00:29:08.662 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 systemd[1]: Starting Ceph mon.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:29:08.662 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 podman[49444]: 2026-03-09 00:29:08.663689503 +0000 UTC m=+0.016669518 container create 9e6d972820d08d82afe9402eebb7ddea37d4dfb4a948daf0bdf701181aeeb29d (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mon-a, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2026-03-09T00:29:08.706 INFO:teuthology.orchestra.run.vm09.stdout:Setting public_network to 192.168.123.0/24 in mon config section 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 podman[49444]: 2026-03-09 00:29:08.693211784 +0000 UTC m=+0.046191808 container init 9e6d972820d08d82afe9402eebb7ddea37d4dfb4a948daf0bdf701181aeeb29d (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mon-a, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 podman[49444]: 2026-03-09 00:29:08.696964808 +0000 UTC m=+0.049944823 container start 9e6d972820d08d82afe9402eebb7ddea37d4dfb4a948daf0bdf701181aeeb29d (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default) 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 bash[49444]: 9e6d972820d08d82afe9402eebb7ddea37d4dfb4a948daf0bdf701181aeeb29d 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 podman[49444]: 2026-03-09 00:29:08.657172466 +0000 UTC m=+0.010152492 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 systemd[1]: Started Ceph mon.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: set uid:gid to 167:167 (ceph:ceph) 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable), process ceph-mon, pid 2 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: pidfile_write: ignore empty --pid-file 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: load: jerasure load: lrc 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: RocksDB version: 7.9.2 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Git sha 0 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Compile date 2026-02-25 18:11:04 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: DB SUMMARY 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: DB Session ID: UD5QM0DPK7PJEHLO57BE 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: CURRENT file: CURRENT 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: IDENTITY file: IDENTITY 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 78609 ; 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.error_if_exists: 0 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.create_if_missing: 0 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.paranoid_checks: 1 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.flush_verify_memtable_count: 1 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-03-09T00:29:08.929 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.env: 0x55eddb7ffdc0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.fs: PosixFileSystem 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.info_log: 0x55edddbb4700 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_file_opening_threads: 16 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.statistics: (nil) 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.use_fsync: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_log_file_size: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.log_file_time_to_roll: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.keep_log_file_num: 1000 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.recycle_log_file_num: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.allow_fallocate: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.allow_mmap_reads: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.allow_mmap_writes: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.use_direct_reads: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.create_missing_column_families: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.db_log_dir: 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.wal_dir: 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.table_cache_numshardbits: 6 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.WAL_ttl_seconds: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.WAL_size_limit_MB: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.is_fd_close_on_exec: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.advise_random_on_open: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.db_write_buffer_size: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.write_buffer_manager: 0x55edddbb9900 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.use_adaptive_mutex: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.rate_limiter: (nil) 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.wal_recovery_mode: 2 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.enable_thread_tracking: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.enable_pipelined_write: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.unordered_write: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.row_cache: None 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.wal_filter: None 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.allow_ingest_behind: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.two_write_queues: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.manual_wal_flush: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.wal_compression: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.atomic_flush: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.persist_stats_to_disk: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.write_dbid_to_manifest: 0 2026-03-09T00:29:08.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.log_readahead_size: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.best_efforts_recovery: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.allow_data_in_errors: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.db_host_id: __hostname__ 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.enforce_single_del_contracts: true 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_background_jobs: 2 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_background_compactions: -1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_subcompactions: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.delayed_write_rate : 16777216 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_total_wal_size: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.stats_dump_period_sec: 600 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.stats_persist_period_sec: 600 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_open_files: -1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bytes_per_sync: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.wal_bytes_per_sync: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.strict_bytes_per_sync: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_readahead_size: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_background_flushes: -1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Compression algorithms supported: 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kZSTD supported: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kXpressCompression supported: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kBZip2Compression supported: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kLZ4Compression supported: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kZlibCompression supported: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kLZ4HCCompression supported: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: kSnappyCompression supported: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Fast CRC32 supported: Supported on x86 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: DMutex implementation: pthread_mutex_t 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.merge_operator: 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_filter: None 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_filter_factory: None 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.sst_partitioner_factory: None 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.memtable_factory: SkipListFactory 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.table_factory: BlockBasedTable 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55edddbb4640) 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: cache_index_and_filter_blocks: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: pin_top_level_index_and_filter: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: index_type: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: data_block_index_type: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: index_shortening: 1 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: data_block_hash_table_util_ratio: 0.750000 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: checksum: 4 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: no_block_cache: 0 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: block_cache: 0x55edddbd9350 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: block_cache_name: BinnedLRUCache 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: block_cache_options: 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: capacity : 536870912 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: num_shard_bits : 4 2026-03-09T00:29:08.931 INFO:journalctl@ceph.mon.a.vm09.stdout: strict_capacity_limit : 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: high_pri_pool_ratio: 0.000 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: block_cache_compressed: (nil) 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: persistent_cache: (nil) 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: block_size: 4096 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: block_size_deviation: 10 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: block_restart_interval: 16 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: index_block_restart_interval: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: metadata_block_size: 4096 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: partition_filters: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: use_delta_encoding: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: filter_policy: bloomfilter 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: whole_key_filtering: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: verify_compression: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: read_amp_bytes_per_bit: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: format_version: 5 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: enable_index_compression: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: block_align: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: max_auto_readahead_size: 262144 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: prepopulate_block_cache: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: initial_auto_readahead_size: 8192 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout: num_file_reads_for_auto_readahead: 2 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.write_buffer_size: 33554432 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_write_buffer_number: 2 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression: NoCompression 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression: Disabled 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.prefix_extractor: nullptr 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.num_levels: 7 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.window_bits: -14 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.level: 32767 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.strategy: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.enabled: false 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.target_file_size_base: 67108864 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.target_file_size_multiplier: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-03-09T00:29:08.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.arena_block_size: 1048576 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.disable_auto_compactions: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.inplace_update_support: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.inplace_update_num_locks: 10000 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.memtable_huge_page_size: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.bloom_locality: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.max_successive_merges: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.ttl: 2592000 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.enable_blob_files: false 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.min_blob_size: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-03-09T00:29:08.933 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b8ef68a0-9700-4322-a5df-66667f49ff1d 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773016148718626, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773016148720182, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 75347, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 239, "table_properties": {"data_size": 73554, "index_size": 182, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10492, "raw_average_key_size": 49, "raw_value_size": 67731, "raw_average_value_size": 322, "num_data_blocks": 8, "num_entries": 210, "num_filter_entries": 210, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773016148, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b8ef68a0-9700-4322-a5df-66667f49ff1d", "db_session_id": "UD5QM0DPK7PJEHLO57BE", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773016148720240, "job": 1, "event": "recovery_finished"} 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55edddbdae00 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: DB pointer 0x55edddcf0000 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: starting mon.a rank 0 at public addrs [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] at bind addrs [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: ** DB Stats ** 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: ** Compaction Stats [default] ** 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: L0 2/0 75.44 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Sum 2/0 75.44 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: ** Compaction Stats [default] ** 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 53.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: AddFile(Keys): cumulative 0, interval 0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Cumulative compaction: 0.00 GB write, 10.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Interval compaction: 0.00 GB write, 10.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Block cache BinnedLRUCache@0x55edddbd9350#2 capacity: 512.00 MB usage: 26.75 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: Block cache entry stats(count,size,portion): DataBlock(3,25.61 KB,0.0048846%) FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.38 KB,7.15256e-05%) Misc(1,0.00 KB,0%) 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout: ** File Read Latency Histogram By Level [default] ** 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???) e1 preinit fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:08.934 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).mds e1 new map 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).mds e1 print_map 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: e1 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: btime 2026-03-09T00:29:07:788224+0000 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: legacy client fscid: -1 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout: No filesystems configured 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: monmap epoch 1 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: last_changed 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: min_mon_release 19 (squid) 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: election_strategy: 1 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: fsmap 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T00:29:08.935 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:08 vm09 ceph-mon[49458]: mgrmap e1: no daemons active 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.846+0000 7ff84f558640 1 Processor -- start 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.846+0000 7ff84f558640 1 -- start start 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.847+0000 7ff84f558640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff848074c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.847+0000 7ff84f558640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff848075260 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.847+0000 7ff84d2cd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff848074c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.847+0000 7ff84d2cd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff848074c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59002/0 (socket says 192.168.123.109:59002) 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.847+0000 7ff84d2cd640 1 -- 192.168.123.109:0/3186915098 learned_addr learned my addr 192.168.123.109:0/3186915098 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.847+0000 7ff84d2cd640 1 -- 192.168.123.109:0/3186915098 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84810e2a0 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.848+0000 7ff84d2cd640 1 --2- 192.168.123.109:0/3186915098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff848074c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff844009920 tx=0x7ff84402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de760a92b5a24d4 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.848+0000 7ff837fff640 1 -- 192.168.123.109:0/3186915098 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84403c070 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.849+0000 7ff837fff640 1 -- 192.168.123.109:0/3186915098 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7ff844037440 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.849+0000 7ff84f558640 1 -- 192.168.123.109:0/3186915098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 msgr2=0x7ff848074c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.849+0000 7ff837fff640 1 -- 192.168.123.109:0/3186915098 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84403c070 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.849+0000 7ff84f558640 1 --2- 192.168.123.109:0/3186915098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff848074c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff844009920 tx=0x7ff84402ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.850+0000 7ff84f558640 1 -- 192.168.123.109:0/3186915098 shutdown_connections 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.850+0000 7ff84f558640 1 --2- 192.168.123.109:0/3186915098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff848074c90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.850+0000 7ff84f558640 1 -- 192.168.123.109:0/3186915098 >> 192.168.123.109:0/3186915098 conn(0x7ff848070020 msgr2=0x7ff848072480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.850+0000 7ff84f558640 1 -- 192.168.123.109:0/3186915098 shutdown_connections 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.850+0000 7ff84f558640 1 -- 192.168.123.109:0/3186915098 wait complete. 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84f558640 1 Processor -- start 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84f558640 1 -- start start 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84f558640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff8481ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84f558640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810f000 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84d2cd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff8481ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84d2cd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff8481ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59006/0 (socket says 192.168.123.109:59006) 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84d2cd640 1 -- 192.168.123.109:0/1068423772 learned_addr learned my addr 192.168.123.109:0/1068423772 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84d2cd640 1 -- 192.168.123.109:0/1068423772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8481abdc0 con 0x7ff848074890 2026-03-09T00:29:08.958 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.851+0000 7ff84d2cd640 1 --2- 192.168.123.109:0/1068423772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff8481ab880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff844037db0 tx=0x7ff844035610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff844045070 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8481ac050 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8481aed40 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7ff844040450 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84403c070 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff84403e5a0 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.852+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff84404aa40 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.853+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff810005180 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.855+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7ff84404ac90 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.890+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7ff810005470 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.893+0000 7ff8367fc640 1 -- 192.168.123.109:0/1068423772 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 127+0+0 (secure 0 0 0) 0x7ff8440408b0 con 0x7ff848074890 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.894+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 msgr2=0x7ff8481ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.894+0000 7ff84f558640 1 --2- 192.168.123.109:0/1068423772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff8481ab880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff844037db0 tx=0x7ff844035610 comp rx=0 tx=0).stop 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.894+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 shutdown_connections 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.894+0000 7ff84f558640 1 --2- 192.168.123.109:0/1068423772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff848074890 0x7ff8481ab880 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.894+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 >> 192.168.123.109:0/1068423772 conn(0x7ff848070020 msgr2=0x7ff848070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.894+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 shutdown_connections 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:08.895+0000 7ff84f558640 1 -- 192.168.123.109:0/1068423772 wait complete. 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:Wrote config to /etc/ceph/ceph.conf 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:08.959 INFO:teuthology.orchestra.run.vm09.stdout:Creating mgr... 2026-03-09T00:29:08.960 INFO:teuthology.orchestra.run.vm09.stdout:Verifying port 0.0.0.0:9283 ... 2026-03-09T00:29:08.961 INFO:teuthology.orchestra.run.vm09.stdout:Verifying port 0.0.0.0:8765 ... 2026-03-09T00:29:09.125 INFO:teuthology.orchestra.run.vm09.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mgr.y 2026-03-09T00:29:09.125 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mgr.y.service: Unit ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mgr.y.service not loaded. 2026-03-09T00:29:09.258 INFO:teuthology.orchestra.run.vm09.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1.target.wants/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mgr.y.service → /etc/systemd/system/ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@.service. 2026-03-09T00:29:09.479 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 podman[49655]: 2026-03-09 00:29:09.443732483 +0000 UTC m=+0.073762197 container create 5b81946625da14b23a049aa773c839fd7ab058391a15dda499ae600f301a8739 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223) 2026-03-09T00:29:09.479 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 podman[49655]: 2026-03-09 00:29:09.382338855 +0000 UTC m=+0.012368580 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:29:09.728 INFO:teuthology.orchestra.run.vm09.stdout:firewalld does not appear to be present 2026-03-09T00:29:09.728 INFO:teuthology.orchestra.run.vm09.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T00:29:09.728 INFO:teuthology.orchestra.run.vm09.stdout:firewalld does not appear to be present 2026-03-09T00:29:09.728 INFO:teuthology.orchestra.run.vm09.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-03-09T00:29:09.728 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for mgr to start... 2026-03-09T00:29:09.728 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for mgr... 2026-03-09T00:29:09.850 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 podman[49655]: 2026-03-09 00:29:09.553895312 +0000 UTC m=+0.183925026 container init 5b81946625da14b23a049aa773c839fd7ab058391a15dda499ae600f301a8739 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3) 2026-03-09T00:29:09.850 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 podman[49655]: 2026-03-09 00:29:09.557598393 +0000 UTC m=+0.187628107 container start 5b81946625da14b23a049aa773c839fd7ab058391a15dda499ae600f301a8739 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T00:29:09.850 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 bash[49655]: 5b81946625da14b23a049aa773c839fd7ab058391a15dda499ae600f301a8739 2026-03-09T00:29:09.850 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:09.645+0000 7ff4f93ed140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:29:09.850 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 systemd[1]: Started Ceph mgr.y for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:29:09.850 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:09.692+0000 7ff4f93ed140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:29:10.108 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:09 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1068423772' entity='client.admin' 2026-03-09T00:29:10.151 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "fsid": "c172d940-1b4e-11f1-be3e-fb1b568ebce1", 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T00:29:10.152 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 0 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T00:29:10.153 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T00:29:07:788224+0000", 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T00:29:07.792147+0000", 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.041+0000 7f15a49cb640 1 Processor -- start 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.041+0000 7f15a49cb640 1 -- start start 2026-03-09T00:29:10.154 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.041+0000 7f15a49cb640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a0074a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.041+0000 7f15a49cb640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0074ff0 con 0x7f15a0074620 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.043+0000 7f159ed76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a0074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.043+0000 7f159ed76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a0074a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59034/0 (socket says 192.168.123.109:59034) 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.043+0000 7f159ed76640 1 -- 192.168.123.109:0/1974041646 learned_addr learned my addr 192.168.123.109:0/1974041646 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.043+0000 7f159ed76640 1 -- 192.168.123.109:0/1974041646 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a0075170 con 0x7f15a0074620 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.044+0000 7f159ed76640 1 --2- 192.168.123.109:0/1974041646 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a0074a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1594009920 tx=0x7f159402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb580621d2984b40 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.044+0000 7f159dd74640 1 -- 192.168.123.109:0/1974041646 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f159403c070 con 0x7f15a0074620 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.044+0000 7f159dd74640 1 -- 192.168.123.109:0/1974041646 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f1594037440 con 0x7f15a0074620 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.044+0000 7f159dd74640 1 -- 192.168.123.109:0/1974041646 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940354d0 con 0x7f15a0074620 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.044+0000 7f15a49cb640 1 -- 192.168.123.109:0/1974041646 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 msgr2=0x7f15a0074a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.044+0000 7f15a49cb640 1 --2- 192.168.123.109:0/1974041646 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a0074a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1594009920 tx=0x7f159402ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 -- 192.168.123.109:0/1974041646 shutdown_connections 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 --2- 192.168.123.109:0/1974041646 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a0074a20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 -- 192.168.123.109:0/1974041646 >> 192.168.123.109:0/1974041646 conn(0x7f15a006fe50 msgr2=0x7f15a00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 -- 192.168.123.109:0/1974041646 shutdown_connections 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 -- 192.168.123.109:0/1974041646 wait complete. 2026-03-09T00:29:10.155 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 Processor -- start 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 -- start start 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a01ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.045+0000 7f15a49cb640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f15a010ee50 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.046+0000 7f159ed76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a01ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.046+0000 7f159ed76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a01ab650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59050/0 (socket says 192.168.123.109:59050) 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.046+0000 7f159ed76640 1 -- 192.168.123.109:0/1173858906 learned_addr learned my addr 192.168.123.109:0/1173858906 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.046+0000 7f159ed76640 1 -- 192.168.123.109:0/1173858906 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a01abb90 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.046+0000 7f159ed76640 1 --2- 192.168.123.109:0/1173858906 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a01ab650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1594006fd0 tx=0x7f1594035dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1594045070 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a01abe20 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a007afe0 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f159402fbc0 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f159403c070 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f159404a430 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.049+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1594049a10 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.050+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a0074aa0 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.052+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f1594049c60 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.087+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f15a007b450 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.087+0000 7f157ffff640 1 -- 192.168.123.109:0/1173858906 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f1594040450 con 0x7f15a0074620 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.092+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 msgr2=0x7f15a01ab650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.092+0000 7f15a49cb640 1 --2- 192.168.123.109:0/1173858906 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a01ab650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1594006fd0 tx=0x7f1594035dc0 comp rx=0 tx=0).stop 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.093+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 shutdown_connections 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.093+0000 7f15a49cb640 1 --2- 192.168.123.109:0/1173858906 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f15a0074620 0x7f15a01ab650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.093+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 >> 192.168.123.109:0/1173858906 conn(0x7f15a006fe50 msgr2=0x7f15a0070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.095+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 shutdown_connections 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:10.095+0000 7f15a49cb640 1 -- 192.168.123.109:0/1173858906 wait complete. 2026-03-09T00:29:10.156 INFO:teuthology.orchestra.run.vm09.stdout:mgr not available, waiting (1/15)... 2026-03-09T00:29:10.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:10.178+0000 7ff4f93ed140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:10.502+0000 7ff4f93ed140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: from numpy import show_config as show_numpy_config 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:10.595+0000 7ff4f93ed140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:10.637+0000 7ff4f93ed140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:29:10.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:10.722+0000 7ff4f93ed140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:29:11.250 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:10 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1173858906' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T00:29:11.519 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.251+0000 7ff4f93ed140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:29:11.519 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.362+0000 7ff4f93ed140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:11.519 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.403+0000 7ff4f93ed140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:29:11.519 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.438+0000 7ff4f93ed140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:11.519 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.483+0000 7ff4f93ed140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:29:11.783 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.520+0000 7ff4f93ed140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:29:11.783 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.729+0000 7ff4f93ed140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:29:12.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:11.783+0000 7ff4f93ed140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:12.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.030+0000 7ff4f93ed140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:29:12.375 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "fsid": "c172d940-1b4e-11f1-be3e-fb1b568ebce1", 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 0 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T00:29:12.377 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T00:29:07:788224+0000", 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T00:29:07.792147+0000", 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:12.378 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5259d05640 1 Processor -- start 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5259d05640 1 -- start start 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5259d05640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 0x7f5254074910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5259d05640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5254074ee0 con 0x7f5254074510 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5258d03640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 0x7f5254074910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5258d03640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 0x7f5254074910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59054/0 (socket says 192.168.123.109:59054) 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.303+0000 7f5258d03640 1 -- 192.168.123.109:0/1057476336 learned_addr learned my addr 192.168.123.109:0/1057476336 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.304+0000 7f5258d03640 1 -- 192.168.123.109:0/1057476336 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5254075060 con 0x7f5254074510 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.305+0000 7f5258d03640 1 --2- 192.168.123.109:0/1057476336 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 0x7f5254074910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5244008970 tx=0x7f52440312f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71905892310e0cef server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.305+0000 7f52537fe640 1 -- 192.168.123.109:0/1057476336 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5244037070 con 0x7f5254074510 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.305+0000 7f52537fe640 1 -- 192.168.123.109:0/1057476336 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f5244031e30 con 0x7f5254074510 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- 192.168.123.109:0/1057476336 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 msgr2=0x7f5254074910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 --2- 192.168.123.109:0/1057476336 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 0x7f5254074910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5244008970 tx=0x7f52440312f0 comp rx=0 tx=0).stop 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- 192.168.123.109:0/1057476336 shutdown_connections 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 --2- 192.168.123.109:0/1057476336 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254074510 0x7f5254074910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- 192.168.123.109:0/1057476336 >> 192.168.123.109:0/1057476336 conn(0x7f525406fe30 msgr2=0x7f52540722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- 192.168.123.109:0/1057476336 shutdown_connections 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- 192.168.123.109:0/1057476336 wait complete. 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 Processor -- start 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- start start 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 0x7f52540870e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5259d05640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5254079cd0 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.306+0000 7f5258d03640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 0x7f52540870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5258d03640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 0x7f52540870e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59064/0 (socket says 192.168.123.109:59064) 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5258d03640 1 -- 192.168.123.109:0/3814908746 learned_addr learned my addr 192.168.123.109:0/3814908746 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5258d03640 1 -- 192.168.123.109:0/3814908746 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525408a1c0 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5258d03640 1 --2- 192.168.123.109:0/3814908746 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 0x7f52540870e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5244008aa0 tx=0x7f524403ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5244037050 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5259d05640 1 -- 192.168.123.109:0/3814908746 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5254087620 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.307+0000 7f5259d05640 1 -- 192.168.123.109:0/3814908746 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52541b7600 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.308+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f5244003d70 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.308+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5244045c60 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.308+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f524404f440 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.308+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f524403b4f0 con 0x7f5254086cc0 2026-03-09T00:29:12.380 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.310+0000 7f5259d05640 1 -- 192.168.123.109:0/3814908746 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5254074510 con 0x7f5254086cc0 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.311+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5244045e00 con 0x7f5254086cc0 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.344+0000 7f5259d05640 1 -- 192.168.123.109:0/3814908746 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f52541b7c30 con 0x7f5254086cc0 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.344+0000 7f5251ffb640 1 -- 192.168.123.109:0/3814908746 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f52440454a0 con 0x7f5254086cc0 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 -- 192.168.123.109:0/3814908746 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 msgr2=0x7f52540870e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 --2- 192.168.123.109:0/3814908746 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 0x7f52540870e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5244008aa0 tx=0x7f524403ae10 comp rx=0 tx=0).stop 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 -- 192.168.123.109:0/3814908746 shutdown_connections 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 --2- 192.168.123.109:0/3814908746 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5254086cc0 0x7f52540870e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 -- 192.168.123.109:0/3814908746 >> 192.168.123.109:0/3814908746 conn(0x7f525406fe30 msgr2=0x7f52540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 -- 192.168.123.109:0/3814908746 shutdown_connections 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:12.346+0000 7f52237fe640 1 -- 192.168.123.109:0/3814908746 wait complete. 2026-03-09T00:29:12.381 INFO:teuthology.orchestra.run.vm09.stdout:mgr not available, waiting (2/15)... 2026-03-09T00:29:12.464 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.361+0000 7ff4f93ed140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:29:12.464 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.418+0000 7ff4f93ed140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:29:12.464 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:12 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3814908746' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T00:29:12.802 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.465+0000 7ff4f93ed140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:29:12.802 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.556+0000 7ff4f93ed140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:29:12.803 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.597+0000 7ff4f93ed140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:29:12.803 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.681+0000 7ff4f93ed140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:29:13.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.803+0000 7ff4f93ed140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:13.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.945+0000 7ff4f93ed140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:29:13.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:12.986+0000 7ff4f93ed140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: Activating manager daemon y 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: mgrmap e2: y(active, starting, since 0.00385856s) 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: Manager daemon y is now available 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' 2026-03-09T00:29:13.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:13 vm09 ceph-mon[49458]: from='mgr.14100 192.168.123.109:0/3911502824' entity='mgr.y' 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "fsid": "c172d940-1b4e-11f1-be3e-fb1b568ebce1", 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 0 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T00:29:15.928 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T00:29:15.929 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T00:29:07:788224+0000", 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T00:29:15.930 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T00:29:07.792147+0000", 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.617+0000 7f835f744640 1 Processor -- start 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.618+0000 7f835f744640 1 -- start start 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.618+0000 7f835f744640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f835807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.618+0000 7f835f744640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f835807dba0 con 0x7f835807d1d0 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.618+0000 7f835d4b9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f835807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.618+0000 7f835d4b9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f835807d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59134/0 (socket says 192.168.123.109:59134) 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.618+0000 7f835d4b9640 1 -- 192.168.123.109:0/598031776 learned_addr learned my addr 192.168.123.109:0/598031776 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.619+0000 7f835d4b9640 1 -- 192.168.123.109:0/598031776 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835807e420 con 0x7f835807d1d0 2026-03-09T00:29:15.931 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.620+0000 7f835d4b9640 1 --2- 192.168.123.109:0/598031776 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f835807d5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8340009920 tx=0x7f834002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c05e0d71bd20cc server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.620+0000 7f834ffff640 1 -- 192.168.123.109:0/598031776 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f834003c070 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.620+0000 7f834ffff640 1 -- 192.168.123.109:0/598031776 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f8340037440 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 -- 192.168.123.109:0/598031776 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 msgr2=0x7f835807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 --2- 192.168.123.109:0/598031776 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f835807d5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8340009920 tx=0x7f834002ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 -- 192.168.123.109:0/598031776 shutdown_connections 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 --2- 192.168.123.109:0/598031776 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f835807d5d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 -- 192.168.123.109:0/598031776 >> 192.168.123.109:0/598031776 conn(0x7f835807c030 msgr2=0x7f835807c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 -- 192.168.123.109:0/598031776 shutdown_connections 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.621+0000 7f835f744640 1 -- 192.168.123.109:0/598031776 wait complete. 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.622+0000 7f835f744640 1 Processor -- start 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.622+0000 7f835f744640 1 -- start start 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.622+0000 7f835f744640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f83581a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.622+0000 7f835f744640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f835807f660 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.623+0000 7f835d4b9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f83581a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.623+0000 7f835d4b9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f83581a2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59146/0 (socket says 192.168.123.109:59146) 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.623+0000 7f835d4b9640 1 -- 192.168.123.109:0/2596035929 learned_addr learned my addr 192.168.123.109:0/2596035929 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.623+0000 7f835d4b9640 1 -- 192.168.123.109:0/2596035929 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83581a3450 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.623+0000 7f835d4b9640 1 --2- 192.168.123.109:0/2596035929 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f83581a2f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83400376c0 tx=0x7f83400376f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.624+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8340045070 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.624+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f8340037d00 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.624+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f834003c070 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.624+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83581a36e0 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.624+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83581a63d0 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.624+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 3) ==== 50095+0+0 (secure 0 0 0) 0x7f834004a430 con 0x7f835807d1d0 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.625+0000 7f834e7fc640 1 --2- 192.168.123.109:0/2596035929 >> v2:192.168.123.109:6800/770453877 conn(0x7f833403da90 0x7f833403ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:15.932 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.625+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8340076db0 con 0x7f835807d1d0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.625+0000 7f835ccb8640 1 --2- 192.168.123.109:0/2596035929 >> v2:192.168.123.109:6800/770453877 conn(0x7f833403da90 0x7f833403ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.625+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8320005180 con 0x7f835807d1d0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.629+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8340033200 con 0x7f835807d1d0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.629+0000 7f835ccb8640 1 --2- 192.168.123.109:0/2596035929 >> v2:192.168.123.109:6800/770453877 conn(0x7f833403da90 0x7f833403ff50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83480099c0 tx=0x7f8348006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.773+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8320005470 con 0x7f835807d1d0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.775+0000 7f834e7fc640 1 -- 192.168.123.109:0/2596035929 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f8340048c60 con 0x7f835807d1d0 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.778+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 >> v2:192.168.123.109:6800/770453877 conn(0x7f833403da90 msgr2=0x7f833403ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.778+0000 7f835f744640 1 --2- 192.168.123.109:0/2596035929 >> v2:192.168.123.109:6800/770453877 conn(0x7f833403da90 0x7f833403ff50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83480099c0 tx=0x7f8348006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.778+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 msgr2=0x7f83581a2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.778+0000 7f835f744640 1 --2- 192.168.123.109:0/2596035929 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f83581a2f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83400376c0 tx=0x7f83400376f0 comp rx=0 tx=0).stop 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.779+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 shutdown_connections 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.779+0000 7f835f744640 1 --2- 192.168.123.109:0/2596035929 >> v2:192.168.123.109:6800/770453877 conn(0x7f833403da90 0x7f833403ff50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.779+0000 7f835f744640 1 --2- 192.168.123.109:0/2596035929 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f835807d1d0 0x7f83581a2f10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.779+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 >> 192.168.123.109:0/2596035929 conn(0x7f835807c030 msgr2=0x7f8358107370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.779+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 shutdown_connections 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:14.779+0000 7f835f744640 1 -- 192.168.123.109:0/2596035929 wait complete. 2026-03-09T00:29:15.933 INFO:teuthology.orchestra.run.vm09.stdout:mgr is available 2026-03-09T00:29:16.162 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:15 vm09 ceph-mon[49458]: mgrmap e3: y(active, since 1.00794s) 2026-03-09T00:29:16.162 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:15 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2596035929' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout fsid = c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.109:3300,v1:192.168.123.109:6789] 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.048+0000 7f3d81003640 1 Processor -- start 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.048+0000 7f3d81003640 1 -- start start 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.048+0000 7f3d81003640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c104b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.048+0000 7f3d81003640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1050e0 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.049+0000 7f3d7ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.049+0000 7f3d7ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c104b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59150/0 (socket says 192.168.123.109:59150) 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.049+0000 7f3d7ad76640 1 -- 192.168.123.109:0/1084362093 learned_addr learned my addr 192.168.123.109:0/1084362093 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.049+0000 7f3d7ad76640 1 -- 192.168.123.109:0/1084362093 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c1058a0 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d7ad76640 1 --2- 192.168.123.109:0/1084362093 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c104b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009b80 tx=0x7f3d6402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b771010ddbf262 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d79d74640 1 -- 192.168.123.109:0/1084362093 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6403c070 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d79d74640 1 -- 192.168.123.109:0/1084362093 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f3d64037440 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d81003640 1 -- 192.168.123.109:0/1084362093 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 msgr2=0x7f3d7c104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d81003640 1 --2- 192.168.123.109:0/1084362093 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c104b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009b80 tx=0x7f3d6402f190 comp rx=0 tx=0).stop 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d81003640 1 -- 192.168.123.109:0/1084362093 shutdown_connections 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d81003640 1 --2- 192.168.123.109:0/1084362093 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c104b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d81003640 1 -- 192.168.123.109:0/1084362093 >> 192.168.123.109:0/1084362093 conn(0x7f3d7c100250 msgr2=0x7f3d7c1026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.050+0000 7f3d81003640 1 -- 192.168.123.109:0/1084362093 shutdown_connections 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d81003640 1 -- 192.168.123.109:0/1084362093 wait complete. 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d81003640 1 Processor -- start 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d81003640 1 -- start start 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d81003640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c1a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d81003640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c108af0 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d7ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c1a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d7ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c1a2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59164/0 (socket says 192.168.123.109:59164) 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.051+0000 7f3d7ad76640 1 -- 192.168.123.109:0/265673053 learned_addr learned my addr 192.168.123.109:0/265673053 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.052+0000 7f3d7ad76640 1 -- 192.168.123.109:0/265673053 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c1a3510 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.052+0000 7f3d7ad76640 1 --2- 192.168.123.109:0/265673053 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c1a2fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d6402f740 tx=0x7f3d640039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.052+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6403c040 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.052+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f3d64003c40 con 0x7f3d7c104710 2026-03-09T00:29:16.182 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.052+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64035db0 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.053+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c1a37a0 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.053+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c1a6490 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.053+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 4) ==== 50201+0+0 (secure 0 0 0) 0x7f3d6402fa10 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.054+0000 7f3d5bfff640 1 --2- 192.168.123.109:0/265673053 >> v2:192.168.123.109:6800/770453877 conn(0x7f3d5403d7a0 0x7f3d5403fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.054+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3d64076900 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.054+0000 7f3d7a575640 1 --2- 192.168.123.109:0/265673053 >> v2:192.168.123.109:6800/770453877 conn(0x7f3d5403d7a0 0x7f3d5403fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.054+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c104b10 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.054+0000 7f3d7a575640 1 --2- 192.168.123.109:0/265673053 >> v2:192.168.123.109:6800/770453877 conn(0x7f3d5403d7a0 0x7f3d5403fc60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3d700099c0 tx=0x7f3d70006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.057+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3d6403e2e0 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.150+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3d7c1a7880 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.151+0000 7f3d5bfff640 1 -- 192.168.123.109:0/265673053 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+380 (secure 0 0 0) 0x7f3d64036e00 con 0x7f3d7c104710 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 >> v2:192.168.123.109:6800/770453877 conn(0x7f3d5403d7a0 msgr2=0x7f3d5403fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 --2- 192.168.123.109:0/265673053 >> v2:192.168.123.109:6800/770453877 conn(0x7f3d5403d7a0 0x7f3d5403fc60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3d700099c0 tx=0x7f3d70006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 msgr2=0x7f3d7c1a2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 --2- 192.168.123.109:0/265673053 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c1a2fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d6402f740 tx=0x7f3d640039b0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 shutdown_connections 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 --2- 192.168.123.109:0/265673053 >> v2:192.168.123.109:6800/770453877 conn(0x7f3d5403d7a0 0x7f3d5403fc60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 --2- 192.168.123.109:0/265673053 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c104710 0x7f3d7c1a2fd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 >> 192.168.123.109:0/265673053 conn(0x7f3d7c100250 msgr2=0x7f3d7c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 shutdown_connections 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.154+0000 7f3d81003640 1 -- 192.168.123.109:0/265673053 wait complete. 2026-03-09T00:29:16.183 INFO:teuthology.orchestra.run.vm09.stdout:Enabling cephadm module... 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.306+0000 7f3143577640 1 Processor -- start 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.306+0000 7f3143577640 1 -- start start 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.306+0000 7f3143577640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f314407d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.306+0000 7f3143577640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f314407db70 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.307+0000 7f3142575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f314407d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.307+0000 7f3142575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f314407d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59172/0 (socket says 192.168.123.109:59172) 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.307+0000 7f3142575640 1 -- 192.168.123.109:0/909271631 learned_addr learned my addr 192.168.123.109:0/909271631 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.307+0000 7f3142575640 1 -- 192.168.123.109:0/909271631 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314407e3f0 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.308+0000 7f3142575640 1 --2- 192.168.123.109:0/909271631 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f314407d5a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f312c009b80 tx=0x7f312c02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f436898483e04f server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.308+0000 7f3141573640 1 -- 192.168.123.109:0/909271631 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312c03c070 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.308+0000 7f3141573640 1 -- 192.168.123.109:0/909271631 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f312c037440 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.308+0000 7f3141573640 1 -- 192.168.123.109:0/909271631 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312c0353a0 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 -- 192.168.123.109:0/909271631 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 msgr2=0x7f314407d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 --2- 192.168.123.109:0/909271631 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f314407d5a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f312c009b80 tx=0x7f312c02f190 comp rx=0 tx=0).stop 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 -- 192.168.123.109:0/909271631 shutdown_connections 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 --2- 192.168.123.109:0/909271631 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f314407d5a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 -- 192.168.123.109:0/909271631 >> 192.168.123.109:0/909271631 conn(0x7f314407beb0 msgr2=0x7f314407c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 -- 192.168.123.109:0/909271631 shutdown_connections 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.309+0000 7f3143577640 1 -- 192.168.123.109:0/909271631 wait complete. 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3143577640 1 Processor -- start 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3143577640 1 -- start start 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3143577640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f31441a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3143577640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f314407f630 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3142575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f31441a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3142575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f31441a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59182/0 (socket says 192.168.123.109:59182) 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3142575640 1 -- 192.168.123.109:0/2514545362 learned_addr learned my addr 192.168.123.109:0/2514545362 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.310+0000 7f3142575640 1 -- 192.168.123.109:0/2514545362 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31441a3160 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.311+0000 7f3142575640 1 --2- 192.168.123.109:0/2514545362 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f31441a2c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f312c0356a0 tx=0x7f312c0356d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.311+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312c047070 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.311+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f312c042440 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.311+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312c03c070 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.311+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31441a33f0 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.311+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a60e0 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.312+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 4) ==== 50201+0+0 (secure 0 0 0) 0x7f312c0413e0 con 0x7f314407d1a0 2026-03-09T00:29:16.961 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.312+0000 7f31337fe640 1 --2- 192.168.123.109:0/2514545362 >> v2:192.168.123.109:6800/770453877 conn(0x7f311c03dbb0 0x7f311c040070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.312+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f312c077830 con 0x7f314407d1a0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.312+0000 7f3141d74640 1 --2- 192.168.123.109:0/2514545362 >> v2:192.168.123.109:6800/770453877 conn(0x7f311c03dbb0 0x7f311c040070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.312+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314407d5a0 con 0x7f314407d1a0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.316+0000 7f3141d74640 1 --2- 192.168.123.109:0/2514545362 >> v2:192.168.123.109:6800/770453877 conn(0x7f311c03dbb0 0x7f311c040070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3138009a10 tx=0x7f3138006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.316+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f312c040340 con 0x7f314407d1a0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.440+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f314419bda0 con 0x7f314407d1a0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.922+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f312c050170 con 0x7f314407d1a0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.924+0000 7f31337fe640 1 -- 192.168.123.109:0/2514545362 <== mon.0 v2:192.168.123.109:3300/0 8 ==== mgrmap(e 5) ==== 50212+0+0 (secure 0 0 0) 0x7f312c0363a0 con 0x7f314407d1a0 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.927+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 >> v2:192.168.123.109:6800/770453877 conn(0x7f311c03dbb0 msgr2=0x7f311c040070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.927+0000 7f3143577640 1 --2- 192.168.123.109:0/2514545362 >> v2:192.168.123.109:6800/770453877 conn(0x7f311c03dbb0 0x7f311c040070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3138009a10 tx=0x7f3138006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.928+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 msgr2=0x7f31441a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.928+0000 7f3143577640 1 --2- 192.168.123.109:0/2514545362 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f31441a2c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f312c0356a0 tx=0x7f312c0356d0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.928+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 shutdown_connections 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.928+0000 7f3143577640 1 --2- 192.168.123.109:0/2514545362 >> v2:192.168.123.109:6800/770453877 conn(0x7f311c03dbb0 0x7f311c040070 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.928+0000 7f3143577640 1 --2- 192.168.123.109:0/2514545362 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f314407d1a0 0x7f31441a2c20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.928+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 >> 192.168.123.109:0/2514545362 conn(0x7f314407beb0 msgr2=0x7f31441070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.929+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 shutdown_connections 2026-03-09T00:29:16.962 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:16.929+0000 7f3143577640 1 -- 192.168.123.109:0/2514545362 wait complete. 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ignoring --setuser ceph since I am not root 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ignoring --setgroup ceph since I am not root 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:17.101+0000 7f571aa28140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:17.151+0000 7f571aa28140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:16 vm09 ceph-mon[49458]: mgrmap e4: y(active, since 2s) 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:16 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/265673053' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T00:29:17.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:16 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2514545362' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "active_name": "y", 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.096+0000 7f177b442640 1 Processor -- start 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.096+0000 7f177b442640 1 -- start start 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.096+0000 7f177b442640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f1774074a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.096+0000 7f177b442640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1774075020 con 0x7f1774074650 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.098+0000 7f17791b7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f1774074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.098+0000 7f17791b7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f1774074a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59214/0 (socket says 192.168.123.109:59214) 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.098+0000 7f17791b7640 1 -- 192.168.123.109:0/2824994836 learned_addr learned my addr 192.168.123.109:0/2824994836 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:17.278 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.098+0000 7f17791b7640 1 -- 192.168.123.109:0/2824994836 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17740751a0 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.099+0000 7f17791b7640 1 --2- 192.168.123.109:0/2824994836 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f1774074a50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1764009920 tx=0x7f176402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd0a44c6e6667a3 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.099+0000 7f1763fff640 1 -- 192.168.123.109:0/2824994836 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176403c070 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.099+0000 7f1763fff640 1 -- 192.168.123.109:0/2824994836 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f1764037440 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.100+0000 7f177b442640 1 -- 192.168.123.109:0/2824994836 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 msgr2=0x7f1774074a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.100+0000 7f177b442640 1 --2- 192.168.123.109:0/2824994836 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f1774074a50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1764009920 tx=0x7f176402ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.100+0000 7f177b442640 1 -- 192.168.123.109:0/2824994836 shutdown_connections 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.100+0000 7f177b442640 1 --2- 192.168.123.109:0/2824994836 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f1774074a50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.100+0000 7f177b442640 1 -- 192.168.123.109:0/2824994836 >> 192.168.123.109:0/2824994836 conn(0x7f177406fe80 msgr2=0x7f17740722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.101+0000 7f177b442640 1 -- 192.168.123.109:0/2824994836 shutdown_connections 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.101+0000 7f177b442640 1 -- 192.168.123.109:0/2824994836 wait complete. 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.101+0000 7f177b442640 1 Processor -- start 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.101+0000 7f177b442640 1 -- start start 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.101+0000 7f177b442640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f177411bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.101+0000 7f177b442640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f177410ee60 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.102+0000 7f17791b7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f177411bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.102+0000 7f17791b7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f177411bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59224/0 (socket says 192.168.123.109:59224) 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.102+0000 7f17791b7640 1 -- 192.168.123.109:0/355193582 learned_addr learned my addr 192.168.123.109:0/355193582 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.103+0000 7f17791b7640 1 -- 192.168.123.109:0/355193582 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177411c460 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.103+0000 7f17791b7640 1 --2- 192.168.123.109:0/355193582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f177411bf20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f176402f450 tx=0x7f17640357d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.103+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176403c070 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.103+0000 7f177b442640 1 -- 192.168.123.109:0/355193582 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177411c6f0 con 0x7f1774074650 2026-03-09T00:29:17.279 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.103+0000 7f177b442640 1 -- 192.168.123.109:0/355193582 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177411cb10 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.104+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f1764040400 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.104+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176403f3b0 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.105+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 5) ==== 50212+0+0 (secure 0 0 0) 0x7f176403f550 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.105+0000 7f17627fc640 1 --2- 192.168.123.109:0/355193582 >> v2:192.168.123.109:6800/770453877 conn(0x7f175003dc50 0x7f1750040110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.106+0000 7f17789b6640 1 -- 192.168.123.109:0/355193582 >> v2:192.168.123.109:6800/770453877 conn(0x7f175003dc50 msgr2=0x7f1750040110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/770453877 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.106+0000 7f17789b6640 1 --2- 192.168.123.109:0/355193582 >> v2:192.168.123.109:6800/770453877 conn(0x7f175003dc50 0x7f1750040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.106+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1764077510 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.106+0000 7f177b442640 1 -- 192.168.123.109:0/355193582 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c005180 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.110+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1764039110 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.240+0000 7f177b442640 1 -- 192.168.123.109:0/355193582 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f173c005c80 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.241+0000 7f17627fc640 1 -- 192.168.123.109:0/355193582 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f1764077270 con 0x7f1774074650 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.243+0000 7f1743fff640 1 -- 192.168.123.109:0/355193582 >> v2:192.168.123.109:6800/770453877 conn(0x7f175003dc50 msgr2=0x7f1750040110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.243+0000 7f1743fff640 1 --2- 192.168.123.109:0/355193582 >> v2:192.168.123.109:6800/770453877 conn(0x7f175003dc50 0x7f1750040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.243+0000 7f1743fff640 1 -- 192.168.123.109:0/355193582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 msgr2=0x7f177411bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.243+0000 7f1743fff640 1 --2- 192.168.123.109:0/355193582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f177411bf20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f176402f450 tx=0x7f17640357d0 comp rx=0 tx=0).stop 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.245+0000 7f1743fff640 1 -- 192.168.123.109:0/355193582 shutdown_connections 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.245+0000 7f1743fff640 1 --2- 192.168.123.109:0/355193582 >> v2:192.168.123.109:6800/770453877 conn(0x7f175003dc50 0x7f1750040110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.245+0000 7f1743fff640 1 --2- 192.168.123.109:0/355193582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1774074650 0x7f177411bf20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.245+0000 7f1743fff640 1 -- 192.168.123.109:0/355193582 >> 192.168.123.109:0/355193582 conn(0x7f177406fe80 msgr2=0x7f17740709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.245+0000 7f1743fff640 1 -- 192.168.123.109:0/355193582 shutdown_connections 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.245+0000 7f1743fff640 1 -- 192.168.123.109:0/355193582 wait complete. 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for the mgr to restart... 2026-03-09T00:29:17.280 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for mgr epoch 5... 2026-03-09T00:29:17.921 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:17.619+0000 7f571aa28140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:17.950+0000 7f571aa28140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: from numpy import show_config as show_numpy_config 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.038+0000 7f571aa28140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.078+0000 7f571aa28140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.154+0000 7f571aa28140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:17 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2514545362' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:17 vm09 ceph-mon[49458]: mgrmap e5: y(active, since 3s) 2026-03-09T00:29:18.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:17 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/355193582' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T00:29:18.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.676+0000 7f571aa28140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:29:18.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.789+0000 7f571aa28140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:18.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.830+0000 7f571aa28140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:29:18.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.866+0000 7f571aa28140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:18.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.908+0000 7f571aa28140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:29:19.395 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:18 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:18.947+0000 7f571aa28140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:29:19.395 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.122+0000 7f571aa28140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:29:19.395 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.174+0000 7f571aa28140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:19.675 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.396+0000 7f571aa28140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:29:19.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.676+0000 7f571aa28140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:29:19.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.714+0000 7f571aa28140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:29:19.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.757+0000 7f571aa28140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:29:19.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.839+0000 7f571aa28140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:29:19.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.876+0000 7f571aa28140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:29:20.223 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:19.961+0000 7f571aa28140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:29:20.223 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:20 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:20.076+0000 7f571aa28140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:20 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:20.223+0000 7f571aa28140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:20 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:20.264+0000 7f571aa28140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: Active manager daemon y restarted 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: Activating manager daemon y 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: mgrmap e6: y(active, starting, since 0.00564235s) 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: Manager daemon y is now available 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:20.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:20 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:29:21.544 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:21 vm09 ceph-mon[49458]: Found migration_current of "None". Setting to last migration. 2026-03-09T00:29:21.544 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:21 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:29:21.544 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:21 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:21.544 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:21 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:21.544 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:21 vm09 ceph-mon[49458]: mgrmap e7: y(active, since 1.00877s) 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88afda0640 1 Processor -- start 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88afda0640 1 -- start start 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88afda0640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 0x7f88a8075100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88afda0640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f88a80756d0 con 0x7f88a8074d00 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88adb15640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 0x7f88a8075100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88adb15640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 0x7f88a8075100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59228/0 (socket says 192.168.123.109:59228) 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.400+0000 7f88adb15640 1 -- 192.168.123.109:0/1840522853 learned_addr learned my addr 192.168.123.109:0/1840522853 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.401+0000 7f88adb15640 1 -- 192.168.123.109:0/1840522853 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a810e680 con 0x7f88a8074d00 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.401+0000 7f88adb15640 1 --2- 192.168.123.109:0/1840522853 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 0x7f88a8075100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009530 tx=0x7f88a40301d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d65b56d4b3e3c6e server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.401+0000 7f88acb13640 1 -- 192.168.123.109:0/1840522853 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a403d070 con 0x7f88a8074d00 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.401+0000 7f88acb13640 1 -- 192.168.123.109:0/1840522853 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f88a4030d90 con 0x7f88a8074d00 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- 192.168.123.109:0/1840522853 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 msgr2=0x7f88a8075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 --2- 192.168.123.109:0/1840522853 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 0x7f88a8075100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009530 tx=0x7f88a40301d0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.611 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- 192.168.123.109:0/1840522853 shutdown_connections 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 --2- 192.168.123.109:0/1840522853 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8074d00 0x7f88a8075100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- 192.168.123.109:0/1840522853 >> 192.168.123.109:0/1840522853 conn(0x7f88a806fff0 msgr2=0x7f88a8072470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- 192.168.123.109:0/1840522853 shutdown_connections 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- 192.168.123.109:0/1840522853 wait complete. 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 Processor -- start 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- start start 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 0x7f88a8111b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88afda0640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f88a810f0e0 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88adb15640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 0x7f88a8111b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88adb15640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 0x7f88a8111b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59230/0 (socket says 192.168.123.109:59230) 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.402+0000 7f88adb15640 1 -- 192.168.123.109:0/3696333807 learned_addr learned my addr 192.168.123.109:0/3696333807 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.403+0000 7f88adb15640 1 -- 192.168.123.109:0/3696333807 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a8113840 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.403+0000 7f88adb15640 1 --2- 192.168.123.109:0/3696333807 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 0x7f88a8111b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009660 tx=0x7f88a40375d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.403+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a403d030 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.403+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a81120d0 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.403+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a8112550 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f88a4037e70 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a40044b0 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 5) ==== 50212+0+0 (secure 0 0 0) 0x7f88a4003710 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f8896ffd640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f88ad314640 1 -- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 msgr2=0x7f8880040110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/770453877 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f88ad314640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 --> v2:192.168.123.109:6800/770453877 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f88800407e0 con 0x7f888003dc50 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.405+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f88a403e070 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.606+0000 7f88ad314640 1 -- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 msgr2=0x7f8880040110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/770453877 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:17.606+0000 7f88ad314640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:18.006+0000 7f88ad314640 1 -- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 msgr2=0x7f8880040110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/770453877 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:18.006+0000 7f88ad314640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:18.807+0000 7f88ad314640 1 -- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 msgr2=0x7f8880040110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/770453877 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:18.807+0000 7f88ad314640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:20.270+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mgrmap(e 6) ==== 50014+0+0 (secure 0 0 0) 0x7f88a4076380 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:20.270+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 msgr2=0x7f8880040110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:20.270+0000 7f8896ffd640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.272+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mgrmap(e 7) ==== 50106+0+0 (secure 0 0 0) 0x7f88a4076e00 con 0x7f88a8113420 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.272+0000 7f8896ffd640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/3433497319 conn(0x7f8880041580 0x7f8880043970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.272+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 --> v2:192.168.123.109:6800/3433497319 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f88a403fec0 con 0x7f8880041580 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.275+0000 7f88ad314640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/3433497319 conn(0x7f8880041580 0x7f8880043970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.276+0000 7f88ad314640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/3433497319 conn(0x7f8880041580 0x7f8880043970 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f88a0003e00 tx=0x7f88a00073c0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.277+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f88a403fec0 con 0x7f8880041580 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.281+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 --> v2:192.168.123.109:6800/3433497319 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f88a8074d00 con 0x7f8880041580 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.282+0000 7f8896ffd640 1 -- 192.168.123.109:0/3696333807 <== mgr.14118 v2:192.168.123.109:6800/3433497319 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f88a8074d00 con 0x7f8880041580 2026-03-09T00:29:21.612 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.285+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/3433497319 conn(0x7f8880041580 msgr2=0x7f8880043970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.285+0000 7f88afda0640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/3433497319 conn(0x7f8880041580 0x7f8880043970 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f88a0003e00 tx=0x7f88a00073c0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.285+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 msgr2=0x7f88a8111b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.285+0000 7f88afda0640 1 --2- 192.168.123.109:0/3696333807 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 0x7f88a8111b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009660 tx=0x7f88a40375d0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 shutdown_connections 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/3433497319 conn(0x7f8880041580 0x7f8880043970 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 --2- 192.168.123.109:0/3696333807 >> v2:192.168.123.109:6800/770453877 conn(0x7f888003dc50 0x7f8880040110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 --2- 192.168.123.109:0/3696333807 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f88a8113420 0x7f88a8111b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 >> 192.168.123.109:0/3696333807 conn(0x7f88a806fff0 msgr2=0x7f88a8070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 shutdown_connections 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.286+0000 7f88afda0640 1 -- 192.168.123.109:0/3696333807 wait complete. 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:mgr epoch 5 is available 2026-03-09T00:29:21.613 INFO:teuthology.orchestra.run.vm09.stdout:Setting orchestrator backend to cephadm... 2026-03-09T00:29:21.888 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.735+0000 7f1cc3577640 1 Processor -- start 2026-03-09T00:29:21.888 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc3577640 1 -- start start 2026-03-09T00:29:21.888 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc3577640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 0x7f1cc4074910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc3577640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4074ee0 con 0x7f1cc4074510 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc2575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 0x7f1cc4074910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc2575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 0x7f1cc4074910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41428/0 (socket says 192.168.123.109:41428) 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc2575640 1 -- 192.168.123.109:0/163926883 learned_addr learned my addr 192.168.123.109:0/163926883 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.736+0000 7f1cc2575640 1 -- 192.168.123.109:0/163926883 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc4075060 con 0x7f1cc4074510 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.737+0000 7f1cc2575640 1 --2- 192.168.123.109:0/163926883 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 0x7f1cc4074910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4008970 tx=0x7f1cb40312f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75820a2e82ce7db8 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.737+0000 7f1cc1573640 1 -- 192.168.123.109:0/163926883 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb4037070 con 0x7f1cc4074510 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.737+0000 7f1cc1573640 1 -- 192.168.123.109:0/163926883 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f1cb4031e30 con 0x7f1cc4074510 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- 192.168.123.109:0/163926883 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 msgr2=0x7f1cc4074910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 --2- 192.168.123.109:0/163926883 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 0x7f1cc4074910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4008970 tx=0x7f1cb40312f0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- 192.168.123.109:0/163926883 shutdown_connections 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 --2- 192.168.123.109:0/163926883 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4074510 0x7f1cc4074910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- 192.168.123.109:0/163926883 >> 192.168.123.109:0/163926883 conn(0x7f1cc406fe30 msgr2=0x7f1cc40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- 192.168.123.109:0/163926883 shutdown_connections 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- 192.168.123.109:0/163926883 wait complete. 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 Processor -- start 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- start start 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 0x7f1cc40870e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.738+0000 7f1cc3577640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4079cd0 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc2575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 0x7f1cc40870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc2575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 0x7f1cc40870e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41434/0 (socket says 192.168.123.109:41434) 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc2575640 1 -- 192.168.123.109:0/3281276456 learned_addr learned my addr 192.168.123.109:0/3281276456 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc2575640 1 -- 192.168.123.109:0/3281276456 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc408a1c0 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc2575640 1 --2- 192.168.123.109:0/3281276456 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 0x7f1cc40870e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4008aa0 tx=0x7f1cb403ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb4037050 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc3577640 1 -- 192.168.123.109:0/3281276456 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc4087620 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.739+0000 7f1cc3577640 1 -- 192.168.123.109:0/3281276456 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc41b7600 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.740+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f1cb4003d70 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.740+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb4045c60 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.740+0000 7f1cc3577640 1 -- 192.168.123.109:0/3281276456 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc4074510 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.741+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 7) ==== 50106+0+0 (secure 0 0 0) 0x7f1cb404f440 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.741+0000 7f1cb37fe640 1 --2- 192.168.123.109:0/3281276456 >> v2:192.168.123.109:6800/3433497319 conn(0x7f1ca803db30 0x7f1ca803fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.741+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f1cb4078ed0 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.744+0000 7f1cc1d74640 1 --2- 192.168.123.109:0/3281276456 >> v2:192.168.123.109:6800/3433497319 conn(0x7f1ca803db30 0x7f1ca803fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.744+0000 7f1cc1d74640 1 --2- 192.168.123.109:0/3281276456 >> v2:192.168.123.109:6800/3433497319 conn(0x7f1ca803db30 0x7f1ca803fff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00ad30 tx=0x7f1cbc0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.745+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1cb4040260 con 0x7f1cc4086cc0 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.848+0000 7f1cc3577640 1 -- 192.168.123.109:0/3281276456 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1cc4070eb0 con 0x7f1ca803db30 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.859+0000 7f1cb37fe640 1 -- 192.168.123.109:0/3281276456 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1cc4070eb0 con 0x7f1ca803db30 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 -- 192.168.123.109:0/3281276456 >> v2:192.168.123.109:6800/3433497319 conn(0x7f1ca803db30 msgr2=0x7f1ca803fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:21.889 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 --2- 192.168.123.109:0/3281276456 >> v2:192.168.123.109:6800/3433497319 conn(0x7f1ca803db30 0x7f1ca803fff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00ad30 tx=0x7f1cbc0093f0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 -- 192.168.123.109:0/3281276456 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 msgr2=0x7f1cc40870e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 --2- 192.168.123.109:0/3281276456 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 0x7f1cc40870e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4008aa0 tx=0x7f1cb403ae10 comp rx=0 tx=0).stop 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 -- 192.168.123.109:0/3281276456 shutdown_connections 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 --2- 192.168.123.109:0/3281276456 >> v2:192.168.123.109:6800/3433497319 conn(0x7f1ca803db30 0x7f1ca803fff0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 --2- 192.168.123.109:0/3281276456 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1cc4086cc0 0x7f1cc40870e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 -- 192.168.123.109:0/3281276456 >> 192.168.123.109:0/3281276456 conn(0x7f1cc406fe30 msgr2=0x7f1cc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 -- 192.168.123.109:0/3281276456 shutdown_connections 2026-03-09T00:29:21.890 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:21.862+0000 7f1cb17fa640 1 -- 192.168.123.109:0/3281276456 wait complete. 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout value unchanged 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.014+0000 7f9d2df9f640 1 Processor -- start 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.014+0000 7f9d2df9f640 1 -- start start 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.014+0000 7f9d2df9f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 0x7f9d28074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.014+0000 7f9d2df9f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280755a0 con 0x7f9d28074bd0 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.015+0000 7f9d2cf9d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 0x7f9d28074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.015+0000 7f9d2cf9d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 0x7f9d28074fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41448/0 (socket says 192.168.123.109:41448) 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.015+0000 7f9d2cf9d640 1 -- 192.168.123.109:0/263904365 learned_addr learned my addr 192.168.123.109:0/263904365 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.015+0000 7f9d2cf9d640 1 -- 192.168.123.109:0/263904365 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2810e4c0 con 0x7f9d28074bd0 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.015+0000 7f9d2cf9d640 1 --2- 192.168.123.109:0/263904365 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 0x7f9d28074fd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d180073f0 tx=0x7f9d1802fff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4d79ba13b06091 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d277fe640 1 -- 192.168.123.109:0/263904365 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d18008e40 con 0x7f9d28074bd0 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d277fe640 1 -- 192.168.123.109:0/263904365 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f9d18030c40 con 0x7f9d28074bd0 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 -- 192.168.123.109:0/263904365 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 msgr2=0x7f9d28074fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 --2- 192.168.123.109:0/263904365 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 0x7f9d28074fd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d180073f0 tx=0x7f9d1802fff0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 -- 192.168.123.109:0/263904365 shutdown_connections 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 --2- 192.168.123.109:0/263904365 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d28074bd0 0x7f9d28074fd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.453 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 -- 192.168.123.109:0/263904365 >> 192.168.123.109:0/263904365 conn(0x7f9d2806fe30 msgr2=0x7f9d280722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 -- 192.168.123.109:0/263904365 shutdown_connections 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.016+0000 7f9d2df9f640 1 -- 192.168.123.109:0/263904365 wait complete. 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2df9f640 1 Processor -- start 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2df9f640 1 -- start start 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2df9f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 0x7f9d281ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2df9f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2810ef30 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2cf9d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 0x7f9d281ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2cf9d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 0x7f9d281ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41462/0 (socket says 192.168.123.109:41462) 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2cf9d640 1 -- 192.168.123.109:0/977670705 learned_addr learned my addr 192.168.123.109:0/977670705 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.017+0000 7f9d2cf9d640 1 -- 192.168.123.109:0/977670705 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d281abdf0 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.018+0000 7f9d2cf9d640 1 --2- 192.168.123.109:0/977670705 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 0x7f9d281ab8b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d18030d90 tx=0x7f9d18030dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.018+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d18047070 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.018+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d281ac080 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.018+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d281aebe0 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.019+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f9d18007c30 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.019+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d180081e0 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.019+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 7) ==== 50106+0+0 (secure 0 0 0) 0x7f9d18008440 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.019+0000 7f9d25ffb640 1 --2- 192.168.123.109:0/977670705 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9d0c03dc00 0x7f9d0c0400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.019+0000 7f9d27fff640 1 --2- 192.168.123.109:0/977670705 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9d0c03dc00 0x7f9d0c0400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.019+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f9d1803f070 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.020+0000 7f9d27fff640 1 --2- 192.168.123.109:0/977670705 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9d0c03dc00 0x7f9d0c0400c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000ad30 tx=0x7f9d200093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.020+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d28074bd0 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.023+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9d18034e60 con 0x7f9d281ab490 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.133+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f9d28070e00 con 0x7f9d0c03dc00 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.138+0000 7f9d25ffb640 1 -- 192.168.123.109:0/977670705 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f9d28070e00 con 0x7f9d0c03dc00 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.140+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9d0c03dc00 msgr2=0x7f9d0c0400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.140+0000 7f9d2df9f640 1 --2- 192.168.123.109:0/977670705 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9d0c03dc00 0x7f9d0c0400c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000ad30 tx=0x7f9d200093f0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.140+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 msgr2=0x7f9d281ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.140+0000 7f9d2df9f640 1 --2- 192.168.123.109:0/977670705 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 0x7f9d281ab8b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d18030d90 tx=0x7f9d18030dc0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.141+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 shutdown_connections 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.141+0000 7f9d2df9f640 1 --2- 192.168.123.109:0/977670705 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9d0c03dc00 0x7f9d0c0400c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.141+0000 7f9d2df9f640 1 --2- 192.168.123.109:0/977670705 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9d281ab490 0x7f9d281ab8b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.141+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 >> 192.168.123.109:0/977670705 conn(0x7f9d2806fe30 msgr2=0x7f9d280706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.141+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 shutdown_connections 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.141+0000 7f9d2df9f640 1 -- 192.168.123.109:0/977670705 wait complete. 2026-03-09T00:29:22.454 INFO:teuthology.orchestra.run.vm09.stdout:Generating ssh key... 2026-03-09T00:29:22.770 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.589+0000 7f42e3466640 1 Processor -- start 2026-03-09T00:29:22.770 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.590+0000 7f42e3466640 1 -- start start 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.590+0000 7f42e3466640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc108f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.590+0000 7f42e3466640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc109520 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.590+0000 7f42e11db640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.590+0000 7f42e11db640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41474/0 (socket says 192.168.123.109:41474) 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.590+0000 7f42e11db640 1 -- 192.168.123.109:0/2534372101 learned_addr learned my addr 192.168.123.109:0/2534372101 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.591+0000 7f42e11db640 1 -- 192.168.123.109:0/2534372101 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc109d50 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.591+0000 7f42e11db640 1 --2- 192.168.123.109:0/2534372101 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc108f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009920 tx=0x7f42cc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d533f28c36256d4c server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42cbfff640 1 -- 192.168.123.109:0/2534372101 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc03c070 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42cbfff640 1 -- 192.168.123.109:0/2534372101 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f42cc037440 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42cbfff640 1 -- 192.168.123.109:0/2534372101 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc0354d0 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 -- 192.168.123.109:0/2534372101 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 msgr2=0x7f42dc108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 --2- 192.168.123.109:0/2534372101 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc108f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009920 tx=0x7f42cc02ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 -- 192.168.123.109:0/2534372101 shutdown_connections 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 --2- 192.168.123.109:0/2534372101 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc108f50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 -- 192.168.123.109:0/2534372101 >> 192.168.123.109:0/2534372101 conn(0x7f42dc07c030 msgr2=0x7f42dc07c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 -- 192.168.123.109:0/2534372101 shutdown_connections 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.592+0000 7f42e3466640 1 -- 192.168.123.109:0/2534372101 wait complete. 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.593+0000 7f42e3466640 1 Processor -- start 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.593+0000 7f42e3466640 1 -- start start 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.593+0000 7f42e3466640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.593+0000 7f42e3466640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc10cf80 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.593+0000 7f42e11db640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.593+0000 7f42e11db640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc19e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41480/0 (socket says 192.168.123.109:41480) 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42e11db640 1 -- 192.168.123.109:0/1297356001 learned_addr learned my addr 192.168.123.109:0/1297356001 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42e11db640 1 -- 192.168.123.109:0/1297356001 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc19eef0 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42e11db640 1 --2- 192.168.123.109:0/1297356001 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc19e9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006fd0 tx=0x7f42cc035e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc045070 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f42cc040450 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc03c070 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc19f180 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.594+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc19f5a0 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.595+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 7) ==== 50106+0+0 (secure 0 0 0) 0x7f42cc0364a0 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.595+0000 7f42ca7fc640 1 --2- 192.168.123.109:0/1297356001 >> v2:192.168.123.109:6800/3433497319 conn(0x7f42b003dae0 0x7f42b003ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.596+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f42cc077450 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.597+0000 7f42e09da640 1 --2- 192.168.123.109:0/1297356001 >> v2:192.168.123.109:6800/3433497319 conn(0x7f42b003dae0 0x7f42b003ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.597+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a0005180 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.598+0000 7f42e09da640 1 --2- 192.168.123.109:0/1297356001 >> v2:192.168.123.109:6800/3433497319 conn(0x7f42b003dae0 0x7f42b003ffa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42d00099c0 tx=0x7f42d0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.600+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f42cc043120 con 0x7f42dc108b50 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.698+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f42a0002bf0 con 0x7f42b003dae0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.724+0000 7f42ca7fc640 1 -- 192.168.123.109:0/1297356001 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f42a0002bf0 con 0x7f42b003dae0 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 >> v2:192.168.123.109:6800/3433497319 conn(0x7f42b003dae0 msgr2=0x7f42b003ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 --2- 192.168.123.109:0/1297356001 >> v2:192.168.123.109:6800/3433497319 conn(0x7f42b003dae0 0x7f42b003ffa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42d00099c0 tx=0x7f42d0006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 msgr2=0x7f42dc19e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 --2- 192.168.123.109:0/1297356001 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc19e9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006fd0 tx=0x7f42cc035e80 comp rx=0 tx=0).stop 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 shutdown_connections 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 --2- 192.168.123.109:0/1297356001 >> v2:192.168.123.109:6800/3433497319 conn(0x7f42b003dae0 0x7f42b003ffa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 --2- 192.168.123.109:0/1297356001 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f42dc108b50 0x7f42dc19e9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.726+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 >> 192.168.123.109:0/1297356001 conn(0x7f42dc07c030 msgr2=0x7f42dc106080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.727+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 shutdown_connections 2026-03-09T00:29:22.771 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.727+0000 7f42e3466640 1 -- 192.168.123.109:0/1297356001 wait complete. 2026-03-09T00:29:23.002 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:22 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Generating public/private ed25519 key pair. 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Your identification has been saved in /tmp/tmp9y8hr_mz/key 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Your public key has been saved in /tmp/tmp9y8hr_mz/key.pub 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: The key fingerprint is: 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: SHA256:WN0Q0q73+kseKu1GkyJmDW/YGMcM3hv6Pt6sfjqESPQ ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: The key's randomart image is: 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: +--[ED25519 256]--+ 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | ..o. | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | . . o.o | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | . o =... . | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | . Eo* . | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | . ..%S+ . | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | . O X = | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | o = = oo | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | =o++.. | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: | +*X*o+. | 2026-03-09T00:29:23.003 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: +----[SHA256]-----+ 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINU90cffsIliat3tyxcehrAEF5jFnBZRIinbaA1J/sWY ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.892+0000 7fde21252640 1 Processor -- start 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde21252640 1 -- start start 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde21252640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c07ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde21252640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c07b170 con 0x7fde1c07c7d0 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde1ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c07ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde1ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c07ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41488/0 (socket says 192.168.123.109:41488) 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde1ad76640 1 -- 192.168.123.109:0/1126580051 learned_addr learned my addr 192.168.123.109:0/1126580051 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.893+0000 7fde1ad76640 1 -- 192.168.123.109:0/1126580051 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c07b2f0 con 0x7fde1c07c7d0 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.894+0000 7fde1ad76640 1 --2- 192.168.123.109:0/1126580051 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c07ac30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde1001c080 tx=0x7fde10040520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a4d8444a52fb08 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.894+0000 7fde19d74640 1 -- 192.168.123.109:0/1126580051 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1004c070 con 0x7fde1c07c7d0 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.894+0000 7fde19d74640 1 -- 192.168.123.109:0/1126580051 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fde1001a200 con 0x7fde1c07c7d0 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 -- 192.168.123.109:0/1126580051 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 msgr2=0x7fde1c07ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 --2- 192.168.123.109:0/1126580051 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c07ac30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde1001c080 tx=0x7fde10040520 comp rx=0 tx=0).stop 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 -- 192.168.123.109:0/1126580051 shutdown_connections 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 --2- 192.168.123.109:0/1126580051 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c07ac30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 -- 192.168.123.109:0/1126580051 >> 192.168.123.109:0/1126580051 conn(0x7fde1c102090 msgr2=0x7fde1c1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 -- 192.168.123.109:0/1126580051 shutdown_connections 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 -- 192.168.123.109:0/1126580051 wait complete. 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 Processor -- start 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.895+0000 7fde21252640 1 -- start start 2026-03-09T00:29:23.052 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde21252640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde21252640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c1088a0 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde1ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde1ad76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41500/0 (socket says 192.168.123.109:41500) 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde1ad76640 1 -- 192.168.123.109:0/1795033171 learned_addr learned my addr 192.168.123.109:0/1795033171 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde1ad76640 1 -- 192.168.123.109:0/1795033171 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c19aa00 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.896+0000 7fde1ad76640 1 --2- 192.168.123.109:0/1795033171 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c19a4c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde10040a50 tx=0x7fde10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.897+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde10055030 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.897+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fde10004570 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.897+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1c19ac90 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.897+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1c19d980 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.898+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1004c040 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.898+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7fde10051ab0 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.898+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde8005180 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.898+0000 7fddfbfff640 1 --2- 192.168.123.109:0/1795033171 >> v2:192.168.123.109:6800/3433497319 conn(0x7fddf003d890 0x7fddf003fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.898+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fde10056070 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.901+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fde100593b0 con 0x7fde1c07c7d0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.901+0000 7fde1a575640 1 --2- 192.168.123.109:0/1795033171 >> v2:192.168.123.109:6800/3433497319 conn(0x7fddf003d890 0x7fddf003fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:22.902+0000 7fde1a575640 1 --2- 192.168.123.109:0/1795033171 >> v2:192.168.123.109:6800/3433497319 conn(0x7fddf003d890 0x7fddf003fd50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde04009a10 tx=0x7fde04006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.001+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fdde8002bf0 con 0x7fddf003d890 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.002+0000 7fddfbfff640 1 -- 192.168.123.109:0/1795033171 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7fdde8002bf0 con 0x7fddf003d890 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.007+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 >> v2:192.168.123.109:6800/3433497319 conn(0x7fddf003d890 msgr2=0x7fddf003fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.007+0000 7fde21252640 1 --2- 192.168.123.109:0/1795033171 >> v2:192.168.123.109:6800/3433497319 conn(0x7fddf003d890 0x7fddf003fd50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde04009a10 tx=0x7fde04006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.008+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 msgr2=0x7fde1c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.008+0000 7fde21252640 1 --2- 192.168.123.109:0/1795033171 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c19a4c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde10040a50 tx=0x7fde10004270 comp rx=0 tx=0).stop 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.008+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 shutdown_connections 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.008+0000 7fde21252640 1 --2- 192.168.123.109:0/1795033171 >> v2:192.168.123.109:6800/3433497319 conn(0x7fddf003d890 0x7fddf003fd50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.008+0000 7fde21252640 1 --2- 192.168.123.109:0/1795033171 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fde1c07c7d0 0x7fde1c19a4c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.009+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 >> 192.168.123.109:0/1795033171 conn(0x7fde1c102090 msgr2=0x7fde1c102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.009+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 shutdown_connections 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.009+0000 7fde21252640 1 -- 192.168.123.109:0/1795033171 wait complete. 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:Adding key to root@localhost authorized_keys... 2026-03-09T00:29:23.053 INFO:teuthology.orchestra.run.vm09.stdout:Adding host vm09... 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:22] ENGINE Bus STARTING 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:22] ENGINE Serving on https://192.168.123.109:7150 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:22] ENGINE Client ('192.168.123.109', 34016) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:22] ENGINE Serving on http://192.168.123.109:8765 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:22] ENGINE Bus STARTED 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: Generating ssh key... 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: mgrmap e8: y(active, since 2s) 2026-03-09T00:29:24.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:23 vm09 ceph-mon[49458]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout Added host 'vm09' with addr '192.168.123.109' 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.170+0000 7fef99501640 1 Processor -- start 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.171+0000 7fef99501640 1 -- start start 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.171+0000 7fef99501640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef941049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.171+0000 7fef99501640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fef94104f20 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.171+0000 7fef92ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef941049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.172+0000 7fef92ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef941049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41510/0 (socket says 192.168.123.109:41510) 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.172+0000 7fef92ffd640 1 -- 192.168.123.109:0/2945161605 learned_addr learned my addr 192.168.123.109:0/2945161605 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.172+0000 7fef92ffd640 1 -- 192.168.123.109:0/2945161605 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef941050a0 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.173+0000 7fef92ffd640 1 --2- 192.168.123.109:0/2945161605 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef941049e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fef80009b80 tx=0x7fef8002f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a3fb1158e1f149 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.173+0000 7fef91ffb640 1 -- 192.168.123.109:0/2945161605 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8003c070 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.173+0000 7fef91ffb640 1 -- 192.168.123.109:0/2945161605 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fef80037440 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.173+0000 7fef91ffb640 1 -- 192.168.123.109:0/2945161605 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef800353a0 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 -- 192.168.123.109:0/2945161605 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 msgr2=0x7fef941049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 --2- 192.168.123.109:0/2945161605 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef941049e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fef80009b80 tx=0x7fef8002f190 comp rx=0 tx=0).stop 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 -- 192.168.123.109:0/2945161605 shutdown_connections 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 --2- 192.168.123.109:0/2945161605 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef941049e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 -- 192.168.123.109:0/2945161605 >> 192.168.123.109:0/2945161605 conn(0x7fef94100250 msgr2=0x7fef941026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 -- 192.168.123.109:0/2945161605 shutdown_connections 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.174+0000 7fef99501640 1 -- 192.168.123.109:0/2945161605 wait complete. 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef99501640 1 Processor -- start 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef99501640 1 -- start start 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef99501640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef9419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef99501640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fef94106880 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef92ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef9419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef92ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef9419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41522/0 (socket says 192.168.123.109:41522) 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.175+0000 7fef92ffd640 1 -- 192.168.123.109:0/420155644 learned_addr learned my addr 192.168.123.109:0/420155644 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef92ffd640 1 -- 192.168.123.109:0/420155644 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9419a9d0 con 0x7fef941045e0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef92ffd640 1 --2- 192.168.123.109:0/420155644 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef9419a490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef80037ba0 tx=0x7fef800356a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:24.838 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80047070 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fef80035e10 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8003c070 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9419ac60 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.176+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9419d950 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.178+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7fef8004c430 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.178+0000 7fef6ffff640 1 --2- 192.168.123.109:0/420155644 >> v2:192.168.123.109:6800/3433497319 conn(0x7fef6803dc00 0x7fef680400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.178+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fef80077be0 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.178+0000 7fef927fc640 1 --2- 192.168.123.109:0/420155644 >> v2:192.168.123.109:6800/3433497319 conn(0x7fef6803dc00 0x7fef680400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.179+0000 7fef927fc640 1 --2- 192.168.123.109:0/420155644 >> v2:192.168.123.109:6800/3433497319 conn(0x7fef6803dc00 0x7fef680400c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef880099c0 tx=0x7fef88006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.179+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5c005180 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.182+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fef80042e20 con 0x7fef941045e0 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:23.289+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "vm09", "addr": "192.168.123.109", "target": ["mon-mgr", ""]}) -- 0x7fef5c002bf0 con 0x7fef6803dc00 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.806+0000 7fef6ffff640 1 -- 192.168.123.109:0/420155644 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7fef5c002bf0 con 0x7fef6803dc00 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.809+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 >> v2:192.168.123.109:6800/3433497319 conn(0x7fef6803dc00 msgr2=0x7fef680400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.809+0000 7fef99501640 1 --2- 192.168.123.109:0/420155644 >> v2:192.168.123.109:6800/3433497319 conn(0x7fef6803dc00 0x7fef680400c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef880099c0 tx=0x7fef88006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.809+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 msgr2=0x7fef9419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.809+0000 7fef99501640 1 --2- 192.168.123.109:0/420155644 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef9419a490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef80037ba0 tx=0x7fef800356a0 comp rx=0 tx=0).stop 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.810+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 shutdown_connections 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.810+0000 7fef99501640 1 --2- 192.168.123.109:0/420155644 >> v2:192.168.123.109:6800/3433497319 conn(0x7fef6803dc00 0x7fef680400c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.810+0000 7fef99501640 1 --2- 192.168.123.109:0/420155644 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fef941045e0 0x7fef9419a490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.810+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 >> 192.168.123.109:0/420155644 conn(0x7fef94100250 msgr2=0x7fef94191110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.810+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 shutdown_connections 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.810+0000 7fef99501640 1 -- 192.168.123.109:0/420155644 wait complete. 2026-03-09T00:29:24.839 INFO:teuthology.orchestra.run.vm09.stdout:Deploying unmanaged mon service... 2026-03-09T00:29:25.090 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:24 vm09 ceph-mon[49458]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm09", "addr": "192.168.123.109", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:25.090 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:24 vm09 ceph-mon[49458]: Deploying cephadm binary to vm09 2026-03-09T00:29:25.090 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:24 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:25.090 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:24 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.962+0000 7f716e2d4640 1 Processor -- start 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.963+0000 7f716e2d4640 1 -- start start 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.963+0000 7f716e2d4640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168104950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.963+0000 7f716e2d4640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7168104f20 con 0x7f7168104550 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.968+0000 7f716d2d2640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.968+0000 7f716d2d2640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41534/0 (socket says 192.168.123.109:41534) 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.968+0000 7f716d2d2640 1 -- 192.168.123.109:0/1298047222 learned_addr learned my addr 192.168.123.109:0/1298047222 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.969+0000 7f716d2d2640 1 -- 192.168.123.109:0/1298047222 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71681056e0 con 0x7f7168104550 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.969+0000 7f716d2d2640 1 --2- 192.168.123.109:0/1298047222 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168104950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7158009b80 tx=0x7f715802f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310c75a60dcea998 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.969+0000 7f7157fff640 1 -- 192.168.123.109:0/1298047222 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715803c070 con 0x7f7168104550 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.969+0000 7f7157fff640 1 -- 192.168.123.109:0/1298047222 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f7158037440 con 0x7f7168104550 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.970+0000 7f716e2d4640 1 -- 192.168.123.109:0/1298047222 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 msgr2=0x7f7168104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.970+0000 7f716e2d4640 1 --2- 192.168.123.109:0/1298047222 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168104950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7158009b80 tx=0x7f715802f190 comp rx=0 tx=0).stop 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 -- 192.168.123.109:0/1298047222 shutdown_connections 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 --2- 192.168.123.109:0/1298047222 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168104950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 -- 192.168.123.109:0/1298047222 >> 192.168.123.109:0/1298047222 conn(0x7f71681000d0 msgr2=0x7f71681024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 -- 192.168.123.109:0/1298047222 shutdown_connections 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 -- 192.168.123.109:0/1298047222 wait complete. 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 Processor -- start 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 -- start start 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.972+0000 7f716e2d4640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.973+0000 7f716e2d4640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7168108930 con 0x7f7168104550 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.973+0000 7f716d2d2640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.973+0000 7f716d2d2640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41548/0 (socket says 192.168.123.109:41548) 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.973+0000 7f716d2d2640 1 -- 192.168.123.109:0/360365692 learned_addr learned my addr 192.168.123.109:0/360365692 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:25.126 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.973+0000 7f716d2d2640 1 -- 192.168.123.109:0/360365692 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71680741e0 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.974+0000 7f716d2d2640 1 --2- 192.168.123.109:0/360365692 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168073ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f715802f740 tx=0x7f71580039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.974+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715803c040 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.974+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7168074470 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.974+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681aede0 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.975+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f7158003c40 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.975+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7158035db0 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.976+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7f7158030050 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.976+0000 7f71567fc640 1 --2- 192.168.123.109:0/360365692 >> v2:192.168.123.109:6800/3433497319 conn(0x7f715003dc80 0x7f7150040140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.976+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f7158077c10 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.977+0000 7f716cad1640 1 --2- 192.168.123.109:0/360365692 >> v2:192.168.123.109:6800/3433497319 conn(0x7f715003dc80 0x7f7150040140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.977+0000 7f716cad1640 1 --2- 192.168.123.109:0/360365692 >> v2:192.168.123.109:6800/3433497319 conn(0x7f715003dc80 0x7f7150040140 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f715c009a10 tx=0x7f715c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.979+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7130005180 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:24.984+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7158051240 con 0x7f7168104550 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.090+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7130002bf0 con 0x7f715003dc80 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.096+0000 7f71567fc640 1 -- 192.168.123.109:0/360365692 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7130002bf0 con 0x7f715003dc80 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.098+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 >> v2:192.168.123.109:6800/3433497319 conn(0x7f715003dc80 msgr2=0x7f7150040140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.098+0000 7f716e2d4640 1 --2- 192.168.123.109:0/360365692 >> v2:192.168.123.109:6800/3433497319 conn(0x7f715003dc80 0x7f7150040140 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f715c009a10 tx=0x7f715c006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.098+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 msgr2=0x7f7168073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.098+0000 7f716e2d4640 1 --2- 192.168.123.109:0/360365692 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168073ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f715802f740 tx=0x7f71580039b0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.099+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 shutdown_connections 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.099+0000 7f716e2d4640 1 --2- 192.168.123.109:0/360365692 >> v2:192.168.123.109:6800/3433497319 conn(0x7f715003dc80 0x7f7150040140 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.099+0000 7f716e2d4640 1 --2- 192.168.123.109:0/360365692 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7168104550 0x7f7168073ca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.099+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 >> 192.168.123.109:0/360365692 conn(0x7f71681000d0 msgr2=0x7f7168100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.099+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 shutdown_connections 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.099+0000 7f716e2d4640 1 -- 192.168.123.109:0/360365692 wait complete. 2026-03-09T00:29:25.127 INFO:teuthology.orchestra.run.vm09.stdout:Deploying unmanaged mgr service... 2026-03-09T00:29:25.401 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.245+0000 7fc273242640 1 Processor -- start 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.246+0000 7fc273242640 1 -- start start 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.246+0000 7fc273242640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c1082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.246+0000 7fc273242640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c07ca70 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.246+0000 7fc270fb7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c1082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.246+0000 7fc270fb7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c1082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41560/0 (socket says 192.168.123.109:41560) 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.246+0000 7fc270fb7640 1 -- 192.168.123.109:0/2757164511 learned_addr learned my addr 192.168.123.109:0/2757164511 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.247+0000 7fc270fb7640 1 -- 192.168.123.109:0/2757164511 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c108800 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.247+0000 7fc270fb7640 1 --2- 192.168.123.109:0/2757164511 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c1082c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009920 tx=0x7fc25c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec97a97fff9743d2 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc2637fe640 1 -- 192.168.123.109:0/2757164511 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c03c070 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc2637fe640 1 -- 192.168.123.109:0/2757164511 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fc25c037440 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc2637fe640 1 -- 192.168.123.109:0/2757164511 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c0354d0 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc273242640 1 -- 192.168.123.109:0/2757164511 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 msgr2=0x7fc26c1082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc273242640 1 --2- 192.168.123.109:0/2757164511 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c1082c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009920 tx=0x7fc25c02ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc273242640 1 -- 192.168.123.109:0/2757164511 shutdown_connections 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc273242640 1 --2- 192.168.123.109:0/2757164511 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c1082c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.248+0000 7fc273242640 1 -- 192.168.123.109:0/2757164511 >> 192.168.123.109:0/2757164511 conn(0x7fc26c102090 msgr2=0x7fc26c1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.249+0000 7fc273242640 1 -- 192.168.123.109:0/2757164511 shutdown_connections 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.249+0000 7fc273242640 1 -- 192.168.123.109:0/2757164511 wait complete. 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.249+0000 7fc273242640 1 Processor -- start 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc273242640 1 -- start start 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc273242640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc273242640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c1070f0 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc270fb7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc270fb7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41562/0 (socket says 192.168.123.109:41562) 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc270fb7640 1 -- 192.168.123.109:0/3509039085 learned_addr learned my addr 192.168.123.109:0/3509039085 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc270fb7640 1 -- 192.168.123.109:0/3509039085 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c19eeb0 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.250+0000 7fc270fb7640 1 --2- 192.168.123.109:0/3509039085 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c19e970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc25c006fd0 tx=0x7fc25c035dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.251+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c045070 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.251+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7fc25c02fbc0 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.251+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c03c070 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.251+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c19f140 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.251+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c1a1e30 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.252+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7fc25c04a430 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.252+0000 7fc261ffb640 1 --2- 192.168.123.109:0/3509039085 >> v2:192.168.123.109:6800/3433497319 conn(0x7fc24803dc00 0x7fc2480400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.252+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fc25c0777e0 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.252+0000 7fc263fff640 1 --2- 192.168.123.109:0/3509039085 >> v2:192.168.123.109:6800/3433497319 conn(0x7fc24803dc00 0x7fc2480400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.255+0000 7fc263fff640 1 --2- 192.168.123.109:0/3509039085 >> v2:192.168.123.109:6800/3433497319 conn(0x7fc24803dc00 0x7fc2480400c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2540099c0 tx=0x7fc254006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.257+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc234005180 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.261+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc25c033200 con 0x7fc26c107ec0 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.366+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 --> v2:192.168.123.109:6800/3433497319 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc234002bf0 con 0x7fc24803dc00 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.371+0000 7fc261ffb640 1 -- 192.168.123.109:0/3509039085 <== mgr.14118 v2:192.168.123.109:6800/3433497319 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc234002bf0 con 0x7fc24803dc00 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 >> v2:192.168.123.109:6800/3433497319 conn(0x7fc24803dc00 msgr2=0x7fc2480400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 --2- 192.168.123.109:0/3509039085 >> v2:192.168.123.109:6800/3433497319 conn(0x7fc24803dc00 0x7fc2480400c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2540099c0 tx=0x7fc254006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 msgr2=0x7fc26c19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 --2- 192.168.123.109:0/3509039085 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c19e970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc25c006fd0 tx=0x7fc25c035dc0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 shutdown_connections 2026-03-09T00:29:25.402 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 --2- 192.168.123.109:0/3509039085 >> v2:192.168.123.109:6800/3433497319 conn(0x7fc24803dc00 0x7fc2480400c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.403 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 --2- 192.168.123.109:0/3509039085 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc26c107ec0 0x7fc26c19e970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.403 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 >> 192.168.123.109:0/3509039085 conn(0x7fc26c102090 msgr2=0x7fc26c102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:25.403 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 shutdown_connections 2026-03-09T00:29:25.403 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.374+0000 7fc273242640 1 -- 192.168.123.109:0/3509039085 wait complete. 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.520+0000 7f441cda6640 1 Processor -- start 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.521+0000 7f441cda6640 1 -- start start 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.521+0000 7f441cda6640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f441807d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.521+0000 7f441cda6640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f441807dba0 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.521+0000 7f4416575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f441807d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.521+0000 7f4416575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f441807d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41572/0 (socket says 192.168.123.109:41572) 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.521+0000 7f4416575640 1 -- 192.168.123.109:0/835362881 learned_addr learned my addr 192.168.123.109:0/835362881 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.522+0000 7f4416575640 1 -- 192.168.123.109:0/835362881 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441807e420 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.523+0000 7f4416575640 1 --2- 192.168.123.109:0/835362881 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f441807d5d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f440c009920 tx=0x7f440c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162135b9e4180e1e server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.523+0000 7f4415573640 1 -- 192.168.123.109:0/835362881 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440c03c070 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.523+0000 7f4415573640 1 -- 192.168.123.109:0/835362881 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f440c037440 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 -- 192.168.123.109:0/835362881 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 msgr2=0x7f441807d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 --2- 192.168.123.109:0/835362881 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f441807d5d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f440c009920 tx=0x7f440c02ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 -- 192.168.123.109:0/835362881 shutdown_connections 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 --2- 192.168.123.109:0/835362881 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f441807d5d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 -- 192.168.123.109:0/835362881 >> 192.168.123.109:0/835362881 conn(0x7f441807c030 msgr2=0x7f441807c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 -- 192.168.123.109:0/835362881 shutdown_connections 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.524+0000 7f441cda6640 1 -- 192.168.123.109:0/835362881 wait complete. 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f441cda6640 1 Processor -- start 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f441cda6640 1 -- start start 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f441cda6640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f44181a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f441cda6640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f441807f660 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f4416575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f44181a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f4416575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f44181a2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41576/0 (socket says 192.168.123.109:41576) 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.525+0000 7f4416575640 1 -- 192.168.123.109:0/2189076748 learned_addr learned my addr 192.168.123.109:0/2189076748 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f4416575640 1 -- 192.168.123.109:0/2189076748 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44181a3250 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f4416575640 1 --2- 192.168.123.109:0/2189076748 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f44181a2d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f440c03a030 tx=0x7f440c0357d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440c045070 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f440c035c00 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44181a34e0 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44181a61c0 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.526+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440c03c070 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.527+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7f440c0493b0 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.528+0000 7f44037fe640 1 --2- 192.168.123.109:0/2189076748 >> v2:192.168.123.109:6800/3433497319 conn(0x7f43f003dc00 0x7f43f00400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.528+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f440c077490 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.528+0000 7f4415d74640 1 --2- 192.168.123.109:0/2189076748 >> v2:192.168.123.109:6800/3433497319 conn(0x7f43f003dc00 0x7f43f00400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.528+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441807d5d0 con 0x7f441807d1d0 2026-03-09T00:29:25.996 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.530+0000 7f4415d74640 1 --2- 192.168.123.109:0/2189076748 >> v2:192.168.123.109:6800/3433497319 conn(0x7f43f003dc00 0x7f43f00400c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44040099c0 tx=0x7f4404006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.531+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f440c03f3b0 con 0x7f441807d1d0 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.635+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f441819c1e0 con 0x7f441807d1d0 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.639+0000 7f44037fe640 1 -- 192.168.123.109:0/2189076748 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f440c076e00 con 0x7f441807d1d0 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.644+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 >> v2:192.168.123.109:6800/3433497319 conn(0x7f43f003dc00 msgr2=0x7f43f00400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.644+0000 7f441cda6640 1 --2- 192.168.123.109:0/2189076748 >> v2:192.168.123.109:6800/3433497319 conn(0x7f43f003dc00 0x7f43f00400c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44040099c0 tx=0x7f4404006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.644+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 msgr2=0x7f44181a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.644+0000 7f441cda6640 1 --2- 192.168.123.109:0/2189076748 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f44181a2d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f440c03a030 tx=0x7f440c0357d0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.645+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 shutdown_connections 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.645+0000 7f441cda6640 1 --2- 192.168.123.109:0/2189076748 >> v2:192.168.123.109:6800/3433497319 conn(0x7f43f003dc00 0x7f43f00400c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.645+0000 7f441cda6640 1 --2- 192.168.123.109:0/2189076748 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f441807d1d0 0x7f44181a2d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.645+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 >> 192.168.123.109:0/2189076748 conn(0x7f441807c030 msgr2=0x7f4418106d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.645+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 shutdown_connections 2026-03-09T00:29:25.997 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:25.645+0000 7f441cda6640 1 -- 192.168.123.109:0/2189076748 wait complete. 2026-03-09T00:29:26.241 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:25 vm09 ceph-mon[49458]: Added host vm09 2026-03-09T00:29:26.242 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:25 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:26.242 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:25 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:26.242 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:25 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2189076748' entity='client.admin' 2026-03-09T00:29:26.271 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.119+0000 7f5e4f422640 1 Processor -- start 2026-03-09T00:29:26.271 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.120+0000 7f5e4f422640 1 -- start start 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.120+0000 7f5e4f422640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e481047b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.120+0000 7f5e4f422640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48104cf0 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.121+0000 7f5e4e420640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e481047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.121+0000 7f5e4e420640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e481047b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41588/0 (socket says 192.168.123.109:41588) 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.121+0000 7f5e4e420640 1 -- 192.168.123.109:0/1849673565 learned_addr learned my addr 192.168.123.109:0/1849673565 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.121+0000 7f5e4e420640 1 -- 192.168.123.109:0/1849673565 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e48104e70 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.122+0000 7f5e4e420640 1 --2- 192.168.123.109:0/1849673565 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e481047b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009920 tx=0x7f5e3802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e917ef94a087ffa8 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.122+0000 7f5e4d41e640 1 -- 192.168.123.109:0/1849673565 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3803c070 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.122+0000 7f5e4d41e640 1 -- 192.168.123.109:0/1849673565 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f5e38037440 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.122+0000 7f5e4d41e640 1 -- 192.168.123.109:0/1849673565 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e380354d0 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 -- 192.168.123.109:0/1849673565 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 msgr2=0x7f5e481047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 --2- 192.168.123.109:0/1849673565 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e481047b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009920 tx=0x7f5e3802ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 -- 192.168.123.109:0/1849673565 shutdown_connections 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 --2- 192.168.123.109:0/1849673565 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e481047b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 -- 192.168.123.109:0/1849673565 >> 192.168.123.109:0/1849673565 conn(0x7f5e48100040 msgr2=0x7f5e48102480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 -- 192.168.123.109:0/1849673565 shutdown_connections 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.123+0000 7f5e4f422640 1 -- 192.168.123.109:0/1849673565 wait complete. 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4f422640 1 Processor -- start 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4f422640 1 -- start start 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4f422640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e4819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4f422640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4810a920 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4e420640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e4819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4e420640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e4819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41596/0 (socket says 192.168.123.109:41596) 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.124+0000 7f5e4e420640 1 -- 192.168.123.109:0/3277597121 learned_addr learned my addr 192.168.123.109:0/3277597121 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e4e420640 1 -- 192.168.123.109:0/3277597121 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4819ed20 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e4e420640 1 --2- 192.168.123.109:0/3277597121 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e4819e7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009a50 tx=0x7f5e38035d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3803c030 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f5e3803e070 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38042c70 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4819efb0 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.125+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e48191c50 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.126+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7f5e3804c430 con 0x7f5e481043b0 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.127+0000 7f5e3f7fe640 1 --2- 192.168.123.109:0/3277597121 >> v2:192.168.123.109:6800/3433497319 conn(0x7f5e24046660 0x7f5e24048b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:26.272 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.127+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f5e3803d070 con 0x7f5e481043b0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.127+0000 7f5e4dc1f640 1 --2- 192.168.123.109:0/3277597121 >> v2:192.168.123.109:6800/3433497319 conn(0x7f5e24046660 0x7f5e24048b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.127+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e10005180 con 0x7f5e481043b0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.130+0000 7f5e4dc1f640 1 --2- 192.168.123.109:0/3277597121 >> v2:192.168.123.109:6800/3433497319 conn(0x7f5e24046660 0x7f5e24048b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e300099c0 tx=0x7f5e30006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.130+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5e38042e10 con 0x7f5e481043b0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.223+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f5e10005470 con 0x7f5e481043b0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.227+0000 7f5e3f7fe640 1 -- 192.168.123.109:0/3277597121 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v7)=0 v7) ==== 130+0+0 (secure 0 0 0) 0x7f5e38033c90 con 0x7f5e481043b0 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.231+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 >> v2:192.168.123.109:6800/3433497319 conn(0x7f5e24046660 msgr2=0x7f5e24048b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.231+0000 7f5e4f422640 1 --2- 192.168.123.109:0/3277597121 >> v2:192.168.123.109:6800/3433497319 conn(0x7f5e24046660 0x7f5e24048b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e300099c0 tx=0x7f5e30006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 msgr2=0x7f5e4819e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 --2- 192.168.123.109:0/3277597121 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e4819e7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009a50 tx=0x7f5e38035d70 comp rx=0 tx=0).stop 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 shutdown_connections 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 --2- 192.168.123.109:0/3277597121 >> v2:192.168.123.109:6800/3433497319 conn(0x7f5e24046660 0x7f5e24048b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 --2- 192.168.123.109:0/3277597121 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f5e481043b0 0x7f5e4819e7e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 >> 192.168.123.109:0/3277597121 conn(0x7f5e48100040 msgr2=0x7f5e48100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 shutdown_connections 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.232+0000 7f5e4f422640 1 -- 192.168.123.109:0/3277597121 wait complete. 2026-03-09T00:29:26.273 INFO:teuthology.orchestra.run.vm09.stdout:Enabling the dashboard module... 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: Saving service mon spec with placement count:5 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: Saving service mgr spec with placement count:2 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3277597121' entity='client.admin' 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/608349928' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T00:29:27.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:26 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc612d640 1 Processor -- start 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc612d640 1 -- start start 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc612d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc0074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc612d640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc00755a0 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc512b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc0074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc512b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc0074fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41612/0 (socket says 192.168.123.109:41612) 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.411+0000 7f9bc512b640 1 -- 192.168.123.109:0/2730088420 learned_addr learned my addr 192.168.123.109:0/2730088420 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.412+0000 7f9bc512b640 1 -- 192.168.123.109:0/2730088420 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc010e4c0 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.412+0000 7f9bc512b640 1 --2- 192.168.123.109:0/2730088420 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc0074fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009530 tx=0x7f9bbc0301d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed2c5a7e412cde4 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.412+0000 7f9baffff640 1 -- 192.168.123.109:0/2730088420 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc03d070 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9baffff640 1 -- 192.168.123.109:0/2730088420 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f9bbc030d90 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 -- 192.168.123.109:0/2730088420 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 msgr2=0x7f9bc0074fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 --2- 192.168.123.109:0/2730088420 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc0074fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009530 tx=0x7f9bbc0301d0 comp rx=0 tx=0).stop 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 -- 192.168.123.109:0/2730088420 shutdown_connections 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 --2- 192.168.123.109:0/2730088420 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc0074fd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 -- 192.168.123.109:0/2730088420 >> 192.168.123.109:0/2730088420 conn(0x7f9bc006fe30 msgr2=0x7f9bc00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 -- 192.168.123.109:0/2730088420 shutdown_connections 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.413+0000 7f9bc612d640 1 -- 192.168.123.109:0/2730088420 wait complete. 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc612d640 1 Processor -- start 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc612d640 1 -- start start 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc612d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc01132f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc612d640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc010ef90 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc512b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc01132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc512b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc01132f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41616/0 (socket says 192.168.123.109:41616) 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc512b640 1 -- 192.168.123.109:0/608349928 learned_addr learned my addr 192.168.123.109:0/608349928 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.414+0000 7f9bc512b640 1 -- 192.168.123.109:0/608349928 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc0113830 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.415+0000 7f9bc512b640 1 --2- 192.168.123.109:0/608349928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc01132f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0386a0 tx=0x7f9bbc0386d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.415+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc046070 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.415+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 998+0+0 (secure 0 0 0) 0x7f9bbc041450 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.415+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc03d070 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.415+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc0111a20 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.415+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc0111f00 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.416+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8c005180 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.419+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 8) ==== 50212+0+0 (secure 0 0 0) 0x7f9bbc053080 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.419+0000 7f9bae7fc640 1 --2- 192.168.123.109:0/608349928 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9b9803dcd0 0x7f9b98040190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.419+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f9bbc076e80 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.419+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9bbc03d210 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.420+0000 7f9bc492a640 1 --2- 192.168.123.109:0/608349928 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9b9803dcd0 0x7f9b98040190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.420+0000 7f9bc492a640 1 --2- 192.168.123.109:0/608349928 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9b9803dcd0 0x7f9b98040190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ad30 tx=0x7f9bb80093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.507+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 7 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f9bbc04fe00 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:26.557+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f9b8c005470 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.505+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f9bbc0416b0 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.507+0000 7f9bae7fc640 1 -- 192.168.123.109:0/608349928 <== mon.0 v2:192.168.123.109:3300/0 9 ==== mgrmap(e 9) ==== 50225+0+0 (secure 0 0 0) 0x7f9bbc075890 con 0x7f9bc0074bd0 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.508+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9b9803dcd0 msgr2=0x7f9b98040190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.508+0000 7f9bc612d640 1 --2- 192.168.123.109:0/608349928 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9b9803dcd0 0x7f9b98040190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ad30 tx=0x7f9bb80093f0 comp rx=0 tx=0).stop 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.508+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 msgr2=0x7f9bc01132f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.508+0000 7f9bc612d640 1 --2- 192.168.123.109:0/608349928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc01132f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0386a0 tx=0x7f9bbc0386d0 comp rx=0 tx=0).stop 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.508+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 shutdown_connections 2026-03-09T00:29:27.607 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.508+0000 7f9bc612d640 1 --2- 192.168.123.109:0/608349928 >> v2:192.168.123.109:6800/3433497319 conn(0x7f9b9803dcd0 0x7f9b98040190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:27.608 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.509+0000 7f9bc612d640 1 --2- 192.168.123.109:0/608349928 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9bc0074bd0 0x7f9bc01132f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:27.608 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.509+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 >> 192.168.123.109:0/608349928 conn(0x7f9bc006fe30 msgr2=0x7f9bc0070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:27.608 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.509+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 shutdown_connections 2026-03-09T00:29:27.608 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.509+0000 7f9bc612d640 1 -- 192.168.123.109:0/608349928 wait complete. 2026-03-09T00:29:27.819 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:27 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ignoring --setuser ceph since I am not root 2026-03-09T00:29:27.819 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:27 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ignoring --setgroup ceph since I am not root 2026-03-09T00:29:27.819 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:27 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:27.671+0000 7fcb2139c140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:29:27.819 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:27 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:27.712+0000 7fcb2139c140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "active_name": "y", 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.984+0000 7f38d4d9d640 1 Processor -- start 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.985+0000 7f38d4d9d640 1 -- start start 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.985+0000 7f38d4d9d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d0075000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.985+0000 7f38d4d9d640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00755d0 con 0x7f38d0074c00 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.986+0000 7f38ce575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d0075000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.986+0000 7f38ce575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d0075000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41654/0 (socket says 192.168.123.109:41654) 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.986+0000 7f38ce575640 1 -- 192.168.123.109:0/968668084 learned_addr learned my addr 192.168.123.109:0/968668084 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.986+0000 7f38ce575640 1 -- 192.168.123.109:0/968668084 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d010e4f0 con 0x7f38d0074c00 2026-03-09T00:29:28.213 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.987+0000 7f38ce575640 1 --2- 192.168.123.109:0/968668084 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d0075000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009530 tx=0x7f38c00301d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf98ebe322ec6bfc server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.987+0000 7f38cd573640 1 -- 192.168.123.109:0/968668084 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c003d070 con 0x7f38d0074c00 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.987+0000 7f38cd573640 1 -- 192.168.123.109:0/968668084 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f38c0030d90 con 0x7f38d0074c00 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.988+0000 7f38d4d9d640 1 -- 192.168.123.109:0/968668084 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 msgr2=0x7f38d0075000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.988+0000 7f38d4d9d640 1 --2- 192.168.123.109:0/968668084 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d0075000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009530 tx=0x7f38c00301d0 comp rx=0 tx=0).stop 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 -- 192.168.123.109:0/968668084 shutdown_connections 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 --2- 192.168.123.109:0/968668084 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d0075000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 -- 192.168.123.109:0/968668084 >> 192.168.123.109:0/968668084 conn(0x7f38d006fe80 msgr2=0x7f38d00722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 -- 192.168.123.109:0/968668084 shutdown_connections 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 -- 192.168.123.109:0/968668084 wait complete. 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 Processor -- start 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.989+0000 7f38d4d9d640 1 -- start start 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.990+0000 7f38d4d9d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d01a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.990+0000 7f38d4d9d640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f38d010f020 con 0x7f38d0074c00 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.990+0000 7f38ce575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d01a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.990+0000 7f38ce575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d01a2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41658/0 (socket says 192.168.123.109:41658) 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.990+0000 7f38ce575640 1 -- 192.168.123.109:0/332456864 learned_addr learned my addr 192.168.123.109:0/332456864 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.990+0000 7f38ce575640 1 -- 192.168.123.109:0/332456864 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d01a3250 con 0x7f38d0074c00 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.991+0000 7f38ce575640 1 --2- 192.168.123.109:0/332456864 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d01a2d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f38c0038930 tx=0x7f38c0038960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:28.214 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.992+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c0046070 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.992+0000 7f38d4d9d640 1 -- 192.168.123.109:0/332456864 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d01a34e0 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.992+0000 7f38d4d9d640 1 -- 192.168.123.109:0/332456864 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d01a3940 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.993+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f38c0041880 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.993+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c003d030 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.994+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 9) ==== 50225+0+0 (secure 0 0 0) 0x7f38c00376e0 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.994+0000 7f38bf7fe640 1 --2- 192.168.123.109:0/332456864 >> v2:192.168.123.109:6800/3433497319 conn(0x7f38a803dcf0 0x7f38a80401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.994+0000 7f38cdd74640 1 -- 192.168.123.109:0/332456864 >> v2:192.168.123.109:6800/3433497319 conn(0x7f38a803dcf0 msgr2=0x7f38a80401b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/3433497319 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.994+0000 7f38cdd74640 1 --2- 192.168.123.109:0/332456864 >> v2:192.168.123.109:6800/3433497319 conn(0x7f38a803dcf0 0x7f38a80401b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.994+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f38c003e070 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.995+0000 7f38d4d9d640 1 -- 192.168.123.109:0/332456864 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3894005180 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:27.998+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f38c0076ef0 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.122+0000 7f38d4d9d640 1 -- 192.168.123.109:0/332456864 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f3894005c80 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.123+0000 7f38bf7fe640 1 -- 192.168.123.109:0/332456864 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f38c0041d30 con 0x7f38d0074c00 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.128+0000 7f38bd7fa640 1 -- 192.168.123.109:0/332456864 >> v2:192.168.123.109:6800/3433497319 conn(0x7f38a803dcf0 msgr2=0x7f38a80401b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.128+0000 7f38bd7fa640 1 --2- 192.168.123.109:0/332456864 >> v2:192.168.123.109:6800/3433497319 conn(0x7f38a803dcf0 0x7f38a80401b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.128+0000 7f38bd7fa640 1 -- 192.168.123.109:0/332456864 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 msgr2=0x7f38d01a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.128+0000 7f38bd7fa640 1 --2- 192.168.123.109:0/332456864 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d01a2d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f38c0038930 tx=0x7f38c0038960 comp rx=0 tx=0).stop 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.128+0000 7f38bd7fa640 1 -- 192.168.123.109:0/332456864 shutdown_connections 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.128+0000 7f38bd7fa640 1 --2- 192.168.123.109:0/332456864 >> v2:192.168.123.109:6800/3433497319 conn(0x7f38a803dcf0 0x7f38a80401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.129+0000 7f38bd7fa640 1 --2- 192.168.123.109:0/332456864 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38d0074c00 0x7f38d01a2d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.129+0000 7f38bd7fa640 1 -- 192.168.123.109:0/332456864 >> 192.168.123.109:0/332456864 conn(0x7f38d006fe80 msgr2=0x7f38d0070960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.129+0000 7f38bd7fa640 1 -- 192.168.123.109:0/332456864 shutdown_connections 2026-03-09T00:29:28.215 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.129+0000 7f38bd7fa640 1 -- 192.168.123.109:0/332456864 wait complete. 2026-03-09T00:29:28.216 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for the mgr to restart... 2026-03-09T00:29:28.216 INFO:teuthology.orchestra.run.vm09.stdout:Waiting for mgr epoch 9... 2026-03-09T00:29:28.361 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:28.138+0000 7fcb2139c140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:29:28.361 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:28 vm09 ceph-mon[49458]: from='mgr.14118 192.168.123.109:0/3907920743' entity='mgr.y' 2026-03-09T00:29:28.362 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:28 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/608349928' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T00:29:28.362 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:28 vm09 ceph-mon[49458]: mgrmap e9: y(active, since 7s) 2026-03-09T00:29:28.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:28.486+0000 7fcb2139c140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:29:28.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:29:28.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:29:28.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: from numpy import show_config as show_numpy_config 2026-03-09T00:29:28.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:28.576+0000 7fcb2139c140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:29:28.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:28.612+0000 7fcb2139c140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:29:28.971 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:28 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:28.681+0000 7fcb2139c140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:29:29.283 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:29 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/332456864' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T00:29:29.283 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.173+0000 7fcb2139c140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:29:29.615 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.284+0000 7fcb2139c140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:29.615 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.324+0000 7fcb2139c140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:29:29.615 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.360+0000 7fcb2139c140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:29.615 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.399+0000 7fcb2139c140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:29:29.615 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.434+0000 7fcb2139c140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:29:29.889 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.615+0000 7fcb2139c140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:29:29.890 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.672+0000 7fcb2139c140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:30.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:29 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:29.890+0000 7fcb2139c140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:29:30.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.174+0000 7fcb2139c140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:29:30.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.211+0000 7fcb2139c140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:29:30.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.258+0000 7fcb2139c140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:29:30.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.335+0000 7fcb2139c140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:29:30.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.379+0000 7fcb2139c140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:29:30.714 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.460+0000 7fcb2139c140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:29:30.714 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.578+0000 7fcb2139c140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:31.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.714+0000 7fcb2139c140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:29:31.180 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:30 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:30.750+0000 7fcb2139c140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: Active manager daemon y restarted 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: Activating manager daemon y 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: mgrmap e10: y(active, starting, since 0.00498467s) 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: Manager daemon y is now available 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:29:31.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.361+0000 7f241986a640 1 Processor -- start 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.362+0000 7f241986a640 1 -- start start 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.362+0000 7f241986a640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f2414074a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.362+0000 7f241986a640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2414075020 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.364+0000 7f2412ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f2414074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.364+0000 7f2412ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f2414074a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41660/0 (socket says 192.168.123.109:41660) 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.364+0000 7f2412ffd640 1 -- 192.168.123.109:0/2748049720 learned_addr learned my addr 192.168.123.109:0/2748049720 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.364+0000 7f2412ffd640 1 -- 192.168.123.109:0/2748049720 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24140751a0 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.365+0000 7f2412ffd640 1 --2- 192.168.123.109:0/2748049720 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f2414074a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2408009920 tx=0x7f240802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994a5c37dcb1b8f8 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.365+0000 7f2411ffb640 1 -- 192.168.123.109:0/2748049720 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240803c070 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.365+0000 7f2411ffb640 1 -- 192.168.123.109:0/2748049720 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f2408037440 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.365+0000 7f2411ffb640 1 -- 192.168.123.109:0/2748049720 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24080354d0 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 -- 192.168.123.109:0/2748049720 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 msgr2=0x7f2414074a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 --2- 192.168.123.109:0/2748049720 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f2414074a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2408009920 tx=0x7f240802ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 -- 192.168.123.109:0/2748049720 shutdown_connections 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 --2- 192.168.123.109:0/2748049720 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f2414074a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 -- 192.168.123.109:0/2748049720 >> 192.168.123.109:0/2748049720 conn(0x7f241406fe80 msgr2=0x7f24140722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 -- 192.168.123.109:0/2748049720 shutdown_connections 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.366+0000 7f241986a640 1 -- 192.168.123.109:0/2748049720 wait complete. 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f241986a640 1 Processor -- start 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f241986a640 1 -- start start 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f241986a640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f24141ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f241986a640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f241410eed0 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f2412ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f24141ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f2412ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f24141ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:41668/0 (socket says 192.168.123.109:41668) 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.367+0000 7f2412ffd640 1 -- 192.168.123.109:0/1668406472 learned_addr learned my addr 192.168.123.109:0/1668406472 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.368+0000 7f2412ffd640 1 -- 192.168.123.109:0/1668406472 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24141abba0 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.368+0000 7f2412ffd640 1 --2- 192.168.123.109:0/1668406472 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f24141ab660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2408002410 tx=0x7f24080365d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.368+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2408047070 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.369+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24141abe30 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.369+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241407afe0 con 0x7f2414074650 2026-03-09T00:29:32.029 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.369+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f2408042460 con 0x7f2414074650 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.369+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240803c070 con 0x7f2414074650 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.370+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 9) ==== 50225+0+0 (secure 0 0 0) 0x7f2408042610 con 0x7f2414074650 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.370+0000 7f2418868640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.370+0000 7f24127fc640 1 -- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 msgr2=0x7f23ec040160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/3433497319 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.370+0000 7f24127fc640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.370+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f24080768c0 con 0x7f2414074650 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.372+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 --> v2:192.168.123.109:6800/3433497319 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f23e0000d10 con 0x7f23ec03dca0 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.570+0000 7f24127fc640 1 -- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 msgr2=0x7f23ec040160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/3433497319 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.570+0000 7f24127fc640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.971+0000 7f24127fc640 1 -- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 msgr2=0x7f23ec040160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/3433497319 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:28.971+0000 7f24127fc640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:29.772+0000 7f24127fc640 1 -- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 msgr2=0x7f23ec040160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:192.168.123.109:6800/3433497319 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:29.772+0000 7f24127fc640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:30.756+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mgrmap(e 10) ==== 50027+0+0 (secure 0 0 0) 0x7f24080756c0 con 0x7f2414074650 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:30.756+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 msgr2=0x7f23ec040160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:30.756+0000 7f2418868640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.909+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mgrmap(e 11) ==== 50119+0+0 (secure 0 0 0) 0x7f2408075dc0 con 0x7f2414074650 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.909+0000 7f2418868640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/82853931 conn(0x7f23ec041500 0x7f23ec0438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.909+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 --> v2:192.168.123.109:6800/82853931 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2408003540 con 0x7f23ec041500 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.912+0000 7f24127fc640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/82853931 conn(0x7f23ec041500 0x7f23ec0438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.912+0000 7f24127fc640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/82853931 conn(0x7f23ec041500 0x7f23ec0438f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f23fc003a80 tx=0x7f23fc0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.913+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f2408003540 con 0x7f23ec041500 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.917+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 --> v2:192.168.123.109:6800/82853931 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f23e0002880 con 0x7f23ec041500 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.917+0000 7f2418868640 1 -- 192.168.123.109:0/1668406472 <== mgr.14150 v2:192.168.123.109:6800/82853931 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f23e0002880 con 0x7f23ec041500 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.921+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/82853931 conn(0x7f23ec041500 msgr2=0x7f23ec0438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.921+0000 7f241986a640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/82853931 conn(0x7f23ec041500 0x7f23ec0438f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f23fc003a80 tx=0x7f23fc0092b0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.921+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 msgr2=0x7f24141ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.921+0000 7f241986a640 1 --2- 192.168.123.109:0/1668406472 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f24141ab660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2408002410 tx=0x7f24080365d0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 shutdown_connections 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/82853931 conn(0x7f23ec041500 0x7f23ec0438f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 --2- 192.168.123.109:0/1668406472 >> v2:192.168.123.109:6800/3433497319 conn(0x7f23ec03dca0 0x7f23ec040160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 --2- 192.168.123.109:0/1668406472 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2414074650 0x7f24141ab660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 >> 192.168.123.109:0/1668406472 conn(0x7f241406fe80 msgr2=0x7f2414070880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 shutdown_connections 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:31.923+0000 7f241986a640 1 -- 192.168.123.109:0/1668406472 wait complete. 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:mgr epoch 9 is available 2026-03-09T00:29:32.030 INFO:teuthology.orchestra.run.vm09.stdout:Generating a dashboard self-signed certificate... 2026-03-09T00:29:32.414 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:32 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:32.414 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:32 vm09 ceph-mon[49458]: mgrmap e11: y(active, since 1.15987s) 2026-03-09T00:29:32.414 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:32 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.224+0000 7f22960fb640 1 Processor -- start 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.225+0000 7f22960fb640 1 -- start start 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.225+0000 7f22960fb640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 0x7f22900750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.225+0000 7f22960fb640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2290075690 con 0x7f2290074cc0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.228+0000 7f228f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 0x7f22900750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.228+0000 7f228f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 0x7f22900750c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:60968/0 (socket says 192.168.123.109:60968) 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.228+0000 7f228f7fe640 1 -- 192.168.123.109:0/3264550886 learned_addr learned my addr 192.168.123.109:0/3264550886 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.229+0000 7f228f7fe640 1 -- 192.168.123.109:0/3264550886 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229010e6b0 con 0x7f2290074cc0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.230+0000 7f228f7fe640 1 --2- 192.168.123.109:0/3264550886 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 0x7f22900750c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22840089a0 tx=0x7f2284031440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b81f0d8d1f4264 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.230+0000 7f228e7fc640 1 -- 192.168.123.109:0/3264550886 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228403c480 con 0x7f2290074cc0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.230+0000 7f228e7fc640 1 -- 192.168.123.109:0/3264550886 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f228403ca90 con 0x7f2290074cc0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.230+0000 7f22960fb640 1 -- 192.168.123.109:0/3264550886 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 msgr2=0x7f22900750c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.230+0000 7f22960fb640 1 --2- 192.168.123.109:0/3264550886 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 0x7f22900750c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22840089a0 tx=0x7f2284031440 comp rx=0 tx=0).stop 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 -- 192.168.123.109:0/3264550886 shutdown_connections 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 --2- 192.168.123.109:0/3264550886 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2290074cc0 0x7f22900750c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 -- 192.168.123.109:0/3264550886 >> 192.168.123.109:0/3264550886 conn(0x7f2290070020 msgr2=0x7f2290072480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 -- 192.168.123.109:0/3264550886 shutdown_connections 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 -- 192.168.123.109:0/3264550886 wait complete. 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 Processor -- start 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 -- start start 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 0x7f22901a3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f22960fb640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f229010f0c0 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.231+0000 7f228f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 0x7f22901a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f228f7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 0x7f22901a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:60978/0 (socket says 192.168.123.109:60978) 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f228f7fe640 1 -- 192.168.123.109:0/3278993956 learned_addr learned my addr 192.168.123.109:0/3278993956 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f228f7fe640 1 -- 192.168.123.109:0/3278993956 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22901a3670 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f228f7fe640 1 --2- 192.168.123.109:0/3278993956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 0x7f22901a3130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2284009c80 tx=0x7f2284009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228403bed0 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f22960fb640 1 -- 192.168.123.109:0/3278993956 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22901a3900 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f22960fb640 1 -- 192.168.123.109:0/3278993956 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22901a6460 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.232+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f2284031e50 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.233+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228400b400 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.233+0000 7f22960fb640 1 -- 192.168.123.109:0/3278993956 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2290074cc0 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.239+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 11) ==== 50119+0+0 (secure 0 0 0) 0x7f228400bce0 con 0x7f22901a2d10 2026-03-09T00:29:32.521 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.239+0000 7f228cff9640 1 --2- 192.168.123.109:0/3278993956 >> v2:192.168.123.109:6800/82853931 conn(0x7f227003dbb0 0x7f2270040070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.239+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f2284076490 con 0x7f22901a2d10 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.239+0000 7f228effd640 1 --2- 192.168.123.109:0/3278993956 >> v2:192.168.123.109:6800/82853931 conn(0x7f227003dbb0 0x7f2270040070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.239+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2284076950 con 0x7f22901a2d10 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.239+0000 7f228effd640 1 --2- 192.168.123.109:0/3278993956 >> v2:192.168.123.109:6800/82853931 conn(0x7f227003dbb0 0x7f2270040070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f22780099c0 tx=0x7f2278006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.375+0000 7f22960fb640 1 -- 192.168.123.109:0/3278993956 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f22901a6b10 con 0x7f227003dbb0 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.482+0000 7f228cff9640 1 -- 192.168.123.109:0/3278993956 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f22901a6b10 con 0x7f227003dbb0 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 -- 192.168.123.109:0/3278993956 >> v2:192.168.123.109:6800/82853931 conn(0x7f227003dbb0 msgr2=0x7f2270040070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 --2- 192.168.123.109:0/3278993956 >> v2:192.168.123.109:6800/82853931 conn(0x7f227003dbb0 0x7f2270040070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f22780099c0 tx=0x7f2278006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 -- 192.168.123.109:0/3278993956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 msgr2=0x7f22901a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 --2- 192.168.123.109:0/3278993956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 0x7f22901a3130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2284009c80 tx=0x7f2284009cb0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 -- 192.168.123.109:0/3278993956 shutdown_connections 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 --2- 192.168.123.109:0/3278993956 >> v2:192.168.123.109:6800/82853931 conn(0x7f227003dbb0 0x7f2270040070 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 --2- 192.168.123.109:0/3278993956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f22901a2d10 0x7f22901a3130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 -- 192.168.123.109:0/3278993956 >> 192.168.123.109:0/3278993956 conn(0x7f2290070020 msgr2=0x7f22900709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.485+0000 7f226e7fc640 1 -- 192.168.123.109:0/3278993956 shutdown_connections 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.486+0000 7f226e7fc640 1 -- 192.168.123.109:0/3278993956 wait complete. 2026-03-09T00:29:32.522 INFO:teuthology.orchestra.run.vm09.stdout:Creating initial admin user... 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$fPH3dRkWP5dufnODVsRe4ugzLHh19yQDN1XmoVsiNpT4Td1zPua1G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1773016172, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.661+0000 7f4329883640 1 Processor -- start 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4329883640 1 -- start start 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4329883640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f4324106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4329883640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f43241070a0 con 0x7f43241066d0 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4328881640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f4324106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4328881640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f4324106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:60994/0 (socket says 192.168.123.109:60994) 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4328881640 1 -- 192.168.123.109:0/1238818469 learned_addr learned my addr 192.168.123.109:0/1238818469 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.662+0000 7f4328881640 1 -- 192.168.123.109:0/1238818469 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43241078d0 con 0x7f43241066d0 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.663+0000 7f4328881640 1 --2- 192.168.123.109:0/1238818469 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f4324106ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f430c00dec0 tx=0x7f430c0378f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2b1edba144efdf server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.663+0000 7f431b7fe640 1 -- 192.168.123.109:0/1238818469 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f430c043070 con 0x7f43241066d0 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.663+0000 7f431b7fe640 1 -- 192.168.123.109:0/1238818469 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f430c00d410 con 0x7f43241066d0 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.663+0000 7f4329883640 1 -- 192.168.123.109:0/1238818469 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 msgr2=0x7f4324106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.663+0000 7f4329883640 1 --2- 192.168.123.109:0/1238818469 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f4324106ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f430c00dec0 tx=0x7f430c0378f0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 -- 192.168.123.109:0/1238818469 shutdown_connections 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 --2- 192.168.123.109:0/1238818469 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f4324106ad0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 -- 192.168.123.109:0/1238818469 >> 192.168.123.109:0/1238818469 conn(0x7f4324101e20 msgr2=0x7f43241042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 -- 192.168.123.109:0/1238818469 shutdown_connections 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 -- 192.168.123.109:0/1238818469 wait complete. 2026-03-09T00:29:32.974 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 Processor -- start 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 -- start start 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f43241ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.667+0000 7f4329883640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f4324108760 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.668+0000 7f4328881640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f43241ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.668+0000 7f4328881640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f43241ab650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32768/0 (socket says 192.168.123.109:32768) 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.668+0000 7f4328881640 1 -- 192.168.123.109:0/162828557 learned_addr learned my addr 192.168.123.109:0/162828557 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.668+0000 7f4328881640 1 -- 192.168.123.109:0/162828557 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43241abb90 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.668+0000 7f4328881640 1 --2- 192.168.123.109:0/162828557 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f43241ab650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f430c00d310 tx=0x7f430c00d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.669+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f430c043070 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.669+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f430c016c70 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.669+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f430c03d430 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.669+0000 7f4329883640 1 -- 192.168.123.109:0/162828557 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43241abe20 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.669+0000 7f4329883640 1 -- 192.168.123.109:0/162828557 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43241aeb10 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.670+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4324106ad0 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.673+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 11) ==== 50119+0+0 (secure 0 0 0) 0x7f430c050050 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.673+0000 7f4319ffb640 1 --2- 192.168.123.109:0/162828557 >> v2:192.168.123.109:6800/82853931 conn(0x7f42f403d810 0x7f42f403fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.673+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f430c077150 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.673+0000 7f431bfff640 1 --2- 192.168.123.109:0/162828557 >> v2:192.168.123.109:6800/82853931 conn(0x7f42f403d810 0x7f42f403fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.673+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f430c00d3e0 con 0x7f43241066d0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.673+0000 7f431bfff640 1 --2- 192.168.123.109:0/162828557 >> v2:192.168.123.109:6800/82853931 conn(0x7f42f403d810 0x7f42f403fcd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f43140099c0 tx=0x7f4314006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.782+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f43241a3b70 con 0x7f42f403d810 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.945+0000 7f4319ffb640 1 -- 192.168.123.109:0/162828557 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f43241a3b70 con 0x7f42f403d810 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 >> v2:192.168.123.109:6800/82853931 conn(0x7f42f403d810 msgr2=0x7f42f403fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 --2- 192.168.123.109:0/162828557 >> v2:192.168.123.109:6800/82853931 conn(0x7f42f403d810 0x7f42f403fcd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f43140099c0 tx=0x7f4314006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 msgr2=0x7f43241ab650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 --2- 192.168.123.109:0/162828557 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f43241ab650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f430c00d310 tx=0x7f430c00d340 comp rx=0 tx=0).stop 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 shutdown_connections 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 --2- 192.168.123.109:0/162828557 >> v2:192.168.123.109:6800/82853931 conn(0x7f42f403d810 0x7f42f403fcd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 --2- 192.168.123.109:0/162828557 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f43241066d0 0x7f43241ab650 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 >> 192.168.123.109:0/162828557 conn(0x7f4324101e20 msgr2=0x7f43241042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 shutdown_connections 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:32.948+0000 7f43137fe640 1 -- 192.168.123.109:0/162828557 wait complete. 2026-03-09T00:29:32.975 INFO:teuthology.orchestra.run.vm09.stdout:Fetching dashboard port number... 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stdout 8443 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.140+0000 7f0cca5b8640 1 Processor -- start 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.140+0000 7f0cca5b8640 1 -- start start 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.141+0000 7f0cca5b8640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc4104980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.141+0000 7f0cca5b8640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc4104f50 con 0x7f0cc4104580 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.141+0000 7f0cc3fff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc4104980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.141+0000 7f0cc3fff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc4104980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32780/0 (socket says 192.168.123.109:32780) 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.141+0000 7f0cc3fff640 1 -- 192.168.123.109:0/1813214068 learned_addr learned my addr 192.168.123.109:0/1813214068 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.141+0000 7f0cc3fff640 1 -- 192.168.123.109:0/1813214068 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4105710 con 0x7f0cc4104580 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cc3fff640 1 --2- 192.168.123.109:0/1813214068 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc4104980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009920 tx=0x7f0ca802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a8cf6784ef3878 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cc2ffd640 1 -- 192.168.123.109:0/1813214068 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca803c070 con 0x7f0cc4104580 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cc2ffd640 1 -- 192.168.123.109:0/1813214068 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f0ca8037440 con 0x7f0cc4104580 2026-03-09T00:29:33.302 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cc2ffd640 1 -- 192.168.123.109:0/1813214068 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca80354d0 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1813214068 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 msgr2=0x7f0cc4104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cca5b8640 1 --2- 192.168.123.109:0/1813214068 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc4104980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009920 tx=0x7f0ca802ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1813214068 shutdown_connections 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cca5b8640 1 --2- 192.168.123.109:0/1813214068 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc4104980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.142+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1813214068 >> 192.168.123.109:0/1813214068 conn(0x7f0cc4100100 msgr2=0x7f0cc4102520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1813214068 shutdown_connections 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1813214068 wait complete. 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cca5b8640 1 Processor -- start 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cca5b8640 1 -- start start 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cca5b8640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc41134d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cca5b8640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc4108960 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cc3fff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc41134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cc3fff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc41134d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32788/0 (socket says 192.168.123.109:32788) 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.143+0000 7f0cc3fff640 1 -- 192.168.123.109:0/1033438665 learned_addr learned my addr 192.168.123.109:0/1033438665 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cc3fff640 1 -- 192.168.123.109:0/1033438665 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4113a10 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cc3fff640 1 --2- 192.168.123.109:0/1033438665 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc41134d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ca802ff50 tx=0x7f0ca802ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca8047070 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1033438665 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc4113ca0 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cca5b8640 1 -- 192.168.123.109:0/1033438665 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc4114180 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f0ca8042440 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.144+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca803c070 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.145+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc4104980 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.145+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 11) ==== 50119+0+0 (secure 0 0 0) 0x7f0ca80428f0 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.146+0000 7f0cc17fa640 1 --2- 192.168.123.109:0/1033438665 >> v2:192.168.123.109:6800/82853931 conn(0x7f0c9403db80 0x7f0c94040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.146+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f0ca8076a50 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.148+0000 7f0cc37fe640 1 --2- 192.168.123.109:0/1033438665 >> v2:192.168.123.109:6800/82853931 conn(0x7f0c9403db80 0x7f0c94040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.148+0000 7f0cc37fe640 1 --2- 192.168.123.109:0/1033438665 >> v2:192.168.123.109:6800/82853931 conn(0x7f0c9403db80 0x7f0c94040040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00099c0 tx=0x7f0cb0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.148+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0ca803e350 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.244+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f0cc4063880 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.245+0000 7f0cc17fa640 1 -- 192.168.123.109:0/1033438665 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f0ca803ee70 con 0x7f0cc4104580 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.249+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 >> v2:192.168.123.109:6800/82853931 conn(0x7f0c9403db80 msgr2=0x7f0c94040040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.249+0000 7f0cb6ffd640 1 --2- 192.168.123.109:0/1033438665 >> v2:192.168.123.109:6800/82853931 conn(0x7f0c9403db80 0x7f0c94040040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00099c0 tx=0x7f0cb0006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.250+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 msgr2=0x7f0cc41134d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.250+0000 7f0cb6ffd640 1 --2- 192.168.123.109:0/1033438665 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc41134d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ca802ff50 tx=0x7f0ca802ff80 comp rx=0 tx=0).stop 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.250+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 shutdown_connections 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.250+0000 7f0cb6ffd640 1 --2- 192.168.123.109:0/1033438665 >> v2:192.168.123.109:6800/82853931 conn(0x7f0c9403db80 0x7f0c94040040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.250+0000 7f0cb6ffd640 1 --2- 192.168.123.109:0/1033438665 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0cc4104580 0x7f0cc41134d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.251+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 >> 192.168.123.109:0/1033438665 conn(0x7f0cc4100100 msgr2=0x7f0cc4100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.251+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 shutdown_connections 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.251+0000 7f0cb6ffd640 1 -- 192.168.123.109:0/1033438665 wait complete. 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:firewalld does not appear to be present 2026-03-09T00:29:33.303 INFO:teuthology.orchestra.run.vm09.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout:Ceph Dashboard is now available at: 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout: URL: https://vm09.local:8443/ 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout: User: admin 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout: Password: lwc746vyrq 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.304 INFO:teuthology.orchestra.run.vm09.stdout:Saving cluster configuration to /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config directory 2026-03-09T00:29:33.634 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.421+0000 7ff9badd1640 1 Processor -- start 2026-03-09T00:29:33.634 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.421+0000 7ff9badd1640 1 -- start start 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.422+0000 7ff9badd1640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b4108f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.422+0000 7ff9badd1640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4109520 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.422+0000 7ff9b8b46640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b4108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.422+0000 7ff9b8b46640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b4108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32792/0 (socket says 192.168.123.109:32792) 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.422+0000 7ff9b8b46640 1 -- 192.168.123.109:0/3744228927 learned_addr learned my addr 192.168.123.109:0/3744228927 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.422+0000 7ff9b8b46640 1 -- 192.168.123.109:0/3744228927 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4109d50 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.423+0000 7ff9b8b46640 1 --2- 192.168.123.109:0/3744228927 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b4108f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009920 tx=0x7ff9a402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62631a952741dcf server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.423+0000 7ff9ab7fe640 1 -- 192.168.123.109:0/3744228927 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a403c070 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.423+0000 7ff9ab7fe640 1 -- 192.168.123.109:0/3744228927 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7ff9a4037440 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.423+0000 7ff9ab7fe640 1 -- 192.168.123.109:0/3744228927 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a40354d0 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.423+0000 7ff9badd1640 1 -- 192.168.123.109:0/3744228927 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 msgr2=0x7ff9b4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.423+0000 7ff9badd1640 1 --2- 192.168.123.109:0/3744228927 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b4108f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009920 tx=0x7ff9a402ef20 comp rx=0 tx=0).stop 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.424+0000 7ff9badd1640 1 -- 192.168.123.109:0/3744228927 shutdown_connections 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.424+0000 7ff9badd1640 1 --2- 192.168.123.109:0/3744228927 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b4108f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.424+0000 7ff9badd1640 1 -- 192.168.123.109:0/3744228927 >> 192.168.123.109:0/3744228927 conn(0x7ff9b407c030 msgr2=0x7ff9b407c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.424+0000 7ff9badd1640 1 -- 192.168.123.109:0/3744228927 shutdown_connections 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.424+0000 7ff9badd1640 1 -- 192.168.123.109:0/3744228927 wait complete. 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.424+0000 7ff9badd1640 1 Processor -- start 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9badd1640 1 -- start start 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9badd1640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9badd1640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410cf80 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9b8b46640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9b8b46640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32808/0 (socket says 192.168.123.109:32808) 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9b8b46640 1 -- 192.168.123.109:0/1531061295 learned_addr learned my addr 192.168.123.109:0/1531061295 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9b8b46640 1 -- 192.168.123.109:0/1531061295 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b419ee80 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.425+0000 7ff9b8b46640 1 --2- 192.168.123.109:0/1531061295 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b419e940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9a402fd00 tx=0x7ff9a402fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.426+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a4047070 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.426+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7ff9a4042440 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.426+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a403c070 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.426+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b419f110 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.426+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b407cc60 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.427+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 11) ==== 50119+0+0 (secure 0 0 0) 0x7ff9a403e4e0 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.428+0000 7ff9a9ffb640 1 --2- 192.168.123.109:0/1531061295 >> v2:192.168.123.109:6800/82853931 conn(0x7ff99003db80 0x7ff990040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.428+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7ff9a40778d0 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.428+0000 7ff9abfff640 1 --2- 192.168.123.109:0/1531061295 >> v2:192.168.123.109:6800/82853931 conn(0x7ff99003db80 0x7ff990040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.428+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97c005180 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.431+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff9a40342a0 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.432+0000 7ff9abfff640 1 --2- 192.168.123.109:0/1531061295 >> v2:192.168.123.109:6800/82853931 conn(0x7ff99003db80 0x7ff990040040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009a10 tx=0x7ff99c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.533+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mgrmap(e 12) ==== 50225+0+0 (secure 0 0 0) 0x7ff9a403eb30 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.579+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7ff97c005470 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.582+0000 7ff9a9ffb640 1 -- 192.168.123.109:0/1531061295 <== mon.0 v2:192.168.123.109:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7ff9a404aa10 con 0x7ff9b4108b50 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 >> v2:192.168.123.109:6800/82853931 conn(0x7ff99003db80 msgr2=0x7ff990040040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 --2- 192.168.123.109:0/1531061295 >> v2:192.168.123.109:6800/82853931 conn(0x7ff99003db80 0x7ff990040040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009a10 tx=0x7ff99c006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 msgr2=0x7ff9b419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 --2- 192.168.123.109:0/1531061295 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b419e940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9a402fd00 tx=0x7ff9a402fd30 comp rx=0 tx=0).stop 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 shutdown_connections 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 --2- 192.168.123.109:0/1531061295 >> v2:192.168.123.109:6800/82853931 conn(0x7ff99003db80 0x7ff990040040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 --2- 192.168.123.109:0/1531061295 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff9b4108b50 0x7ff9b419e940 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 >> 192.168.123.109:0/1531061295 conn(0x7ff9b407c030 msgr2=0x7ff9b4105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 shutdown_connections 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:/usr/bin/ceph: stderr 2026-03-09T00:29:33.585+0000 7ff9badd1640 1 -- 192.168.123.109:0/1531061295 wait complete. 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout: sudo /sbin/cephadm shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout:Or, if you are only running a single cluster on this host: 2026-03-09T00:29:33.635 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: sudo /sbin/cephadm shell 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout:Please consider enabling telemetry to help improve Ceph: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: ceph telemetry on 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout:For more information see: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:33.636 INFO:teuthology.orchestra.run.vm09.stdout:Bootstrap complete. 2026-03-09T00:29:33.667 INFO:tasks.cephadm:Fetching config... 2026-03-09T00:29:33.667 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:33.667 DEBUG:teuthology.orchestra.run.vm09:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-03-09T00:29:33.688 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-03-09T00:29:33.688 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:33.688 DEBUG:teuthology.orchestra.run.vm09:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-03-09T00:29:33.764 INFO:tasks.cephadm:Fetching mon keyring... 2026-03-09T00:29:33.764 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:33.764 DEBUG:teuthology.orchestra.run.vm09:> sudo dd if=/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/keyring of=/dev/stdout 2026-03-09T00:29:33.808 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T00:29:33.808 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T00:29:33.809 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:33.809 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:33.809 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:33.809 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:33.809 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:33 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1033438665' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T00:29:33.835 INFO:tasks.cephadm:Fetching pub ssh key... 2026-03-09T00:29:33.835 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:33.835 DEBUG:teuthology.orchestra.run.vm09:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-03-09T00:29:33.898 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-03-09T00:29:33.898 DEBUG:teuthology.orchestra.run.vm09:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINU90cffsIliat3tyxcehrAEF5jFnBZRIinbaA1J/sWY ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-03-09T00:29:33.982 INFO:teuthology.orchestra.run.vm09.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINU90cffsIliat3tyxcehrAEF5jFnBZRIinbaA1J/sWY ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:34.000 DEBUG:teuthology.orchestra.run.vm11:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINU90cffsIliat3tyxcehrAEF5jFnBZRIinbaA1J/sWY ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-03-09T00:29:34.032 INFO:teuthology.orchestra.run.vm11.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINU90cffsIliat3tyxcehrAEF5jFnBZRIinbaA1J/sWY ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:34.042 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-03-09T00:29:34.263 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.463+0000 7f9f93659640 1 -- 192.168.123.109:0/777091092 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 msgr2=0x7f9f8c075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.463+0000 7f9f93659640 1 --2- 192.168.123.109:0/777091092 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c075500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f840099b0 tx=0x7f9f8402f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.464+0000 7f9f93659640 1 -- 192.168.123.109:0/777091092 shutdown_connections 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.464+0000 7f9f93659640 1 --2- 192.168.123.109:0/777091092 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c075500 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.464+0000 7f9f93659640 1 -- 192.168.123.109:0/777091092 >> 192.168.123.109:0/777091092 conn(0x7f9f8c0fd8f0 msgr2=0x7f9f8c0ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.464+0000 7f9f93659640 1 -- 192.168.123.109:0/777091092 shutdown_connections 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.465+0000 7f9f93659640 1 -- 192.168.123.109:0/777091092 wait complete. 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.465+0000 7f9f93659640 1 Processor -- start 2026-03-09T00:29:34.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.465+0000 7f9f93659640 1 -- start start 2026-03-09T00:29:34.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f93659640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:34.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f93659640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c1054f0 con 0x7f9f8c0770a0 2026-03-09T00:29:34.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f92657640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:34.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f92657640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c19f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32812/0 (socket says 192.168.123.109:32812) 2026-03-09T00:29:34.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f92657640 1 -- 192.168.123.109:0/2983922069 learned_addr learned my addr 192.168.123.109:0/2983922069 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:34.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f92657640 1 -- 192.168.123.109:0/2983922069 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8c19faf0 con 0x7f9f8c0770a0 2026-03-09T00:29:34.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f92657640 1 --2- 192.168.123.109:0/2983922069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c19f5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f84005ec0 tx=0x7f9f84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:34.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f84047070 con 0x7f9f8c0770a0 2026-03-09T00:29:34.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.466+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f9f8403e070 con 0x7f9f8c0770a0 2026-03-09T00:29:34.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.467+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8c19fd80 con 0x7f9f8c0770a0 2026-03-09T00:29:34.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.467+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8c1a2a70 con 0x7f9f8c0770a0 2026-03-09T00:29:34.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.467+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f84038550 con 0x7f9f8c0770a0 2026-03-09T00:29:34.470 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.468+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f54005180 con 0x7f9f8c0770a0 2026-03-09T00:29:34.470 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.468+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 12) ==== 50225+0+0 (secure 0 0 0) 0x7f9f840386f0 con 0x7f9f8c0770a0 2026-03-09T00:29:34.470 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.469+0000 7f9f777fe640 1 --2- 192.168.123.109:0/2983922069 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f6803dc00 0x7f9f680400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:34.470 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.469+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f9f84076c10 con 0x7f9f8c0770a0 2026-03-09T00:29:34.470 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.471+0000 7f9f91e56640 1 --2- 192.168.123.109:0/2983922069 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f6803dc00 0x7f9f680400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:34.472 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.473+0000 7f9f91e56640 1 --2- 192.168.123.109:0/2983922069 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f6803dc00 0x7f9f680400c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9f780099c0 tx=0x7f9f78006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:34.473 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.474+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9f84036370 con 0x7f9f8c0770a0 2026-03-09T00:29:34.579 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.579+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f9f54005470 con 0x7f9f8c0770a0 2026-03-09T00:29:34.583 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.584+0000 7f9f777fe640 1 -- 192.168.123.109:0/2983922069 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f9f84034280 con 0x7f9f8c0770a0 2026-03-09T00:29:34.591 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.592+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f6803dc00 msgr2=0x7f9f680400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:34.592 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.592+0000 7f9f93659640 1 --2- 192.168.123.109:0/2983922069 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f6803dc00 0x7f9f680400c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9f780099c0 tx=0x7f9f78006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:34.592 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.592+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 msgr2=0x7f9f8c19f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:34.592 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.592+0000 7f9f93659640 1 --2- 192.168.123.109:0/2983922069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c19f5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f84005ec0 tx=0x7f9f84004270 comp rx=0 tx=0).stop 2026-03-09T00:29:34.592 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.593+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 shutdown_connections 2026-03-09T00:29:34.592 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.593+0000 7f9f93659640 1 --2- 192.168.123.109:0/2983922069 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f6803dc00 0x7f9f680400c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:34.592 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.593+0000 7f9f93659640 1 --2- 192.168.123.109:0/2983922069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f8c0770a0 0x7f9f8c19f5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:34.593 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.593+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 >> 192.168.123.109:0/2983922069 conn(0x7f9f8c0fd8f0 msgr2=0x7f9f8c0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:34.593 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.593+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 shutdown_connections 2026-03-09T00:29:34.593 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:34.593+0000 7f9f93659640 1 -- 192.168.123.109:0/2983922069 wait complete. 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:32] ENGINE Bus STARTING 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:32] ENGINE Serving on http://192.168.123.109:8765 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:33] ENGINE Serving on https://192.168.123.109:7150 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:33] ENGINE Bus STARTED 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: [09/Mar/2026:00:29:33] ENGINE Client ('192.168.123.109', 57496) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: mgrmap e12: y(active, since 2s) 2026-03-09T00:29:34.625 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:34 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1531061295' entity='client.admin' 2026-03-09T00:29:34.688 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-03-09T00:29:34.688 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-03-09T00:29:34.897 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.027+0000 7f0ddebdf640 1 -- 192.168.123.109:0/2891812239 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 msgr2=0x7f0dd81049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.027+0000 7f0ddebdf640 1 --2- 192.168.123.109:0/2891812239 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd81049f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80099b0 tx=0x7f0dc802f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.027+0000 7f0ddebdf640 1 -- 192.168.123.109:0/2891812239 shutdown_connections 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.027+0000 7f0ddebdf640 1 --2- 192.168.123.109:0/2891812239 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd81049f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.027+0000 7f0ddebdf640 1 -- 192.168.123.109:0/2891812239 >> 192.168.123.109:0/2891812239 conn(0x7f0dd80ffda0 msgr2=0x7f0dd81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.028+0000 7f0ddebdf640 1 -- 192.168.123.109:0/2891812239 shutdown_connections 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.028+0000 7f0ddebdf640 1 -- 192.168.123.109:0/2891812239 wait complete. 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.028+0000 7f0ddebdf640 1 Processor -- start 2026-03-09T00:29:35.027 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.028+0000 7f0ddebdf640 1 -- start start 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddebdf640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddebdf640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8109c30 con 0x7f0dd81045f0 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddc954640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddc954640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd819b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32832/0 (socket says 192.168.123.109:32832) 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddc954640 1 -- 192.168.123.109:0/1143090212 learned_addr learned my addr 192.168.123.109:0/1143090212 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddc954640 1 -- 192.168.123.109:0/1143090212 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd819b7d0 con 0x7f0dd81045f0 2026-03-09T00:29:35.028 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.029+0000 7f0ddc954640 1 --2- 192.168.123.109:0/1143090212 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd819b290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8004290 tx=0x7f0dc80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:35.030 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.030+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dc8047070 con 0x7f0dd81045f0 2026-03-09T00:29:35.030 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.030+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f0dc803e070 con 0x7f0dd81045f0 2026-03-09T00:29:35.030 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.030+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dc8042780 con 0x7f0dd81045f0 2026-03-09T00:29:35.030 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.030+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd819ba60 con 0x7f0dd81045f0 2026-03-09T00:29:35.030 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.030+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd819e750 con 0x7f0dd81045f0 2026-03-09T00:29:35.030 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.031+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 12) ==== 50225+0+0 (secure 0 0 0) 0x7f0dc804c440 con 0x7f0dd81045f0 2026-03-09T00:29:35.031 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.031+0000 7f0dcdffb640 1 --2- 192.168.123.109:0/1143090212 >> v2:192.168.123.109:6800/82853931 conn(0x7f0db003dc50 0x7f0db0040110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:35.031 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.031+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f0dc8077b70 con 0x7f0dd81045f0 2026-03-09T00:29:35.031 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.031+0000 7f0dcffff640 1 --2- 192.168.123.109:0/1143090212 >> v2:192.168.123.109:6800/82853931 conn(0x7f0db003dc50 0x7f0db0040110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:35.031 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.032+0000 7f0dcffff640 1 --2- 192.168.123.109:0/1143090212 >> v2:192.168.123.109:6800/82853931 conn(0x7f0db003dc50 0x7f0db0040110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009a10 tx=0x7f0dc0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:35.031 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.032+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da0005180 con 0x7f0dd81045f0 2026-03-09T00:29:35.035 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.035+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0dc80071c0 con 0x7f0dd81045f0 2026-03-09T00:29:35.137 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.137+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f0da0002bf0 con 0x7f0db003dc50 2026-03-09T00:29:35.140 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.141+0000 7f0dcdffb640 1 -- 192.168.123.109:0/1143090212 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0da0002bf0 con 0x7f0db003dc50 2026-03-09T00:29:35.147 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.147+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 >> v2:192.168.123.109:6800/82853931 conn(0x7f0db003dc50 msgr2=0x7f0db0040110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:35.147 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.147+0000 7f0ddebdf640 1 --2- 192.168.123.109:0/1143090212 >> v2:192.168.123.109:6800/82853931 conn(0x7f0db003dc50 0x7f0db0040110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009a10 tx=0x7f0dc0006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.147 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.148+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 msgr2=0x7f0dd819b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:35.147 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.148+0000 7f0ddebdf640 1 --2- 192.168.123.109:0/1143090212 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd819b290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8004290 tx=0x7f0dc80042c0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.149 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.149+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 shutdown_connections 2026-03-09T00:29:35.149 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.149+0000 7f0ddebdf640 1 --2- 192.168.123.109:0/1143090212 >> v2:192.168.123.109:6800/82853931 conn(0x7f0db003dc50 0x7f0db0040110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.149 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.149+0000 7f0ddebdf640 1 --2- 192.168.123.109:0/1143090212 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0dd81045f0 0x7f0dd819b290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.149 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.150+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 >> 192.168.123.109:0/1143090212 conn(0x7f0dd80ffda0 msgr2=0x7f0dd81007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:35.149 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.150+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 shutdown_connections 2026-03-09T00:29:35.149 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.150+0000 7f0ddebdf640 1 -- 192.168.123.109:0/1143090212 wait complete. 2026-03-09T00:29:35.203 INFO:tasks.cephadm:Writing (initial) conf and keyring to vm11 2026-03-09T00:29:35.204 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:29:35.204 DEBUG:teuthology.orchestra.run.vm11:> dd of=/etc/ceph/ceph.conf 2026-03-09T00:29:35.222 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:29:35.222 DEBUG:teuthology.orchestra.run.vm11:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:35.279 INFO:tasks.cephadm:Adding host vm11 to orchestrator... 2026-03-09T00:29:35.280 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch host add vm11 2026-03-09T00:29:35.464 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 -- 192.168.123.109:0/3159901457 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 msgr2=0x7f9b70073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 --2- 192.168.123.109:0/3159901457 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70073850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b600099b0 tx=0x7f9b6002f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 -- 192.168.123.109:0/3159901457 shutdown_connections 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 --2- 192.168.123.109:0/3159901457 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70073850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 -- 192.168.123.109:0/3159901457 >> 192.168.123.109:0/3159901457 conn(0x7f9b7006ef40 msgr2=0x7f9b70071380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 -- 192.168.123.109:0/3159901457 shutdown_connections 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.613+0000 7f9b75d8a640 1 -- 192.168.123.109:0/3159901457 wait complete. 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b75d8a640 1 Processor -- start 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b75d8a640 1 -- start start 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b75d8a640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b75d8a640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7010df00 con 0x7f9b70073450 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b74d88640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b74d88640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32860/0 (socket says 192.168.123.109:32860) 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b74d88640 1 -- 192.168.123.109:0/545941820 learned_addr learned my addr 192.168.123.109:0/545941820 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b74d88640 1 -- 192.168.123.109:0/545941820 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b701a2280 con 0x7f9b70073450 2026-03-09T00:29:35.613 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.614+0000 7f9b74d88640 1 --2- 192.168.123.109:0/545941820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70119050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b60002410 tx=0x7f9b600043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.615+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b6002fd40 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.615+0000 7f9b75d8a640 1 -- 192.168.123.109:0/545941820 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b701a2510 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.615+0000 7f9b75d8a640 1 -- 192.168.123.109:0/545941820 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701a29f0 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.615+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f9b60033040 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.615+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b600386b0 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.616+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 12) ==== 50225+0+0 (secure 0 0 0) 0x7f9b6004a070 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.616+0000 7f9b6dffb640 1 --2- 192.168.123.109:0/545941820 >> v2:192.168.123.109:6800/82853931 conn(0x7f9b5003dca0 0x7f9b50040160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.616+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f9b6003e030 con 0x7f9b70073450 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.616+0000 7f9b6ffff640 1 --2- 192.168.123.109:0/545941820 >> v2:192.168.123.109:6800/82853931 conn(0x7f9b5003dca0 0x7f9b50040160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.616+0000 7f9b6ffff640 1 --2- 192.168.123.109:0/545941820 >> v2:192.168.123.109:6800/82853931 conn(0x7f9b5003dca0 0x7f9b50040160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400ad30 tx=0x7f9b640093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:35.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.616+0000 7f9b75d8a640 1 -- 192.168.123.109:0/545941820 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7010e6a0 con 0x7f9b70073450 2026-03-09T00:29:35.619 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.620+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9b60041e60 con 0x7f9b70073450 2026-03-09T00:29:35.726 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:35.727+0000 7f9b75d8a640 1 -- 192.168.123.109:0/545941820 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "vm11", "target": ["mon-mgr", ""]}) -- 0x7f9b70111dc0 con 0x7f9b5003dca0 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2983922069' entity='client.admin' 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: Updating vm09:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:37.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:36 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stdout:Added host 'vm11' with addr '192.168.123.111' 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.323+0000 7f9b6dffb640 1 -- 192.168.123.109:0/545941820 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f9b70111dc0 con 0x7f9b5003dca0 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.325+0000 7f9b437fe640 1 -- 192.168.123.109:0/545941820 >> v2:192.168.123.109:6800/82853931 conn(0x7f9b5003dca0 msgr2=0x7f9b50040160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.325+0000 7f9b437fe640 1 --2- 192.168.123.109:0/545941820 >> v2:192.168.123.109:6800/82853931 conn(0x7f9b5003dca0 0x7f9b50040160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400ad30 tx=0x7f9b640093f0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 -- 192.168.123.109:0/545941820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 msgr2=0x7f9b70119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 --2- 192.168.123.109:0/545941820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70119050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b60002410 tx=0x7f9b600043c0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 -- 192.168.123.109:0/545941820 shutdown_connections 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 --2- 192.168.123.109:0/545941820 >> v2:192.168.123.109:6800/82853931 conn(0x7f9b5003dca0 0x7f9b50040160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 --2- 192.168.123.109:0/545941820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9b70073450 0x7f9b70119050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 -- 192.168.123.109:0/545941820 >> 192.168.123.109:0/545941820 conn(0x7f9b7006ef40 msgr2=0x7f9b70071380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 -- 192.168.123.109:0/545941820 shutdown_connections 2026-03-09T00:29:37.325 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.326+0000 7f9b437fe640 1 -- 192.168.123.109:0/545941820 wait complete. 2026-03-09T00:29:37.379 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch host ls --format=json 2026-03-09T00:29:37.569 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:37.704 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.704+0000 7f04560d7640 1 -- 192.168.123.109:0/3721709246 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 msgr2=0x7f0450103350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:37.704 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.704+0000 7f04560d7640 1 --2- 192.168.123.109:0/3721709246 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f0450103350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04400099b0 tx=0x7f044002f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.704 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.705+0000 7f04560d7640 1 -- 192.168.123.109:0/3721709246 shutdown_connections 2026-03-09T00:29:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.705+0000 7f04560d7640 1 --2- 192.168.123.109:0/3721709246 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f0450103350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.705+0000 7f04560d7640 1 -- 192.168.123.109:0/3721709246 >> 192.168.123.109:0/3721709246 conn(0x7f04500fc420 msgr2=0x7f04500fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.705+0000 7f04560d7640 1 -- 192.168.123.109:0/3721709246 shutdown_connections 2026-03-09T00:29:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.705+0000 7f04560d7640 1 -- 192.168.123.109:0/3721709246 wait complete. 2026-03-09T00:29:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.706+0000 7f04560d7640 1 Processor -- start 2026-03-09T00:29:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.706+0000 7f04560d7640 1 -- start start 2026-03-09T00:29:37.706 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.706+0000 7f04560d7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f045019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:37.706 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.706+0000 7f04560d7640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f045010dfa0 con 0x7f0450102f70 2026-03-09T00:29:37.706 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.707+0000 7f04550d5640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f045019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:37.706 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.707+0000 7f04550d5640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f045019b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32878/0 (socket says 192.168.123.109:32878) 2026-03-09T00:29:37.706 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.707+0000 7f04550d5640 1 -- 192.168.123.109:0/1970623098 learned_addr learned my addr 192.168.123.109:0/1970623098 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:37.706 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.707+0000 7f04550d5640 1 -- 192.168.123.109:0/1970623098 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045019ba00 con 0x7f0450102f70 2026-03-09T00:29:37.707 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.707+0000 7f04550d5640 1 --2- 192.168.123.109:0/1970623098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f045019b4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0440002a80 tx=0x7f0440002ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:37.708 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.708+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0440047070 con 0x7f0450102f70 2026-03-09T00:29:37.708 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.708+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f044003e070 con 0x7f0450102f70 2026-03-09T00:29:37.708 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.708+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04400425f0 con 0x7f0450102f70 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.708+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045019bc90 con 0x7f0450102f70 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.708+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045019c030 con 0x7f0450102f70 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.709+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 12) ==== 50225+0+0 (secure 0 0 0) 0x7f044004c440 con 0x7f0450102f70 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.709+0000 7f04467fc640 1 --2- 192.168.123.109:0/1970623098 >> v2:192.168.123.109:6800/82853931 conn(0x7f043403dc50 0x7f0434040110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.709+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f0440077a00 con 0x7f0450102f70 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.709+0000 7f04548d4640 1 --2- 192.168.123.109:0/1970623098 >> v2:192.168.123.109:6800/82853931 conn(0x7f043403dc50 0x7f0434040110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.710+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c005180 con 0x7f0450102f70 2026-03-09T00:29:37.712 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.713+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f04400071c0 con 0x7f0450102f70 2026-03-09T00:29:37.712 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.713+0000 7f04548d4640 1 --2- 192.168.123.109:0/1970623098 >> v2:192.168.123.109:6800/82853931 conn(0x7f043403dc50 0x7f0434040110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0438009a10 tx=0x7f0438006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:37.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.740+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7f0440047d00 con 0x7f0450102f70 2026-03-09T00:29:37.817 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.817+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f041c002bf0 con 0x7f043403dc50 2026-03-09T00:29:37.817 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.818+0000 7f04467fc640 1 -- 192.168.123.109:0/1970623098 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+155 (secure 0 0 0) 0x7f041c002bf0 con 0x7f043403dc50 2026-03-09T00:29:37.817 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:37.817 INFO:teuthology.orchestra.run.vm09.stdout:[{"addr": "192.168.123.109", "hostname": "vm09", "labels": [], "status": ""}, {"addr": "192.168.123.111", "hostname": "vm11", "labels": [], "status": ""}] 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 >> v2:192.168.123.109:6800/82853931 conn(0x7f043403dc50 msgr2=0x7f0434040110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 --2- 192.168.123.109:0/1970623098 >> v2:192.168.123.109:6800/82853931 conn(0x7f043403dc50 0x7f0434040110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0438009a10 tx=0x7f0438006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 msgr2=0x7f045019b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 --2- 192.168.123.109:0/1970623098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f045019b4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0440002a80 tx=0x7f0440002ab0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 shutdown_connections 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 --2- 192.168.123.109:0/1970623098 >> v2:192.168.123.109:6800/82853931 conn(0x7f043403dc50 0x7f0434040110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 --2- 192.168.123.109:0/1970623098 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f0450102f70 0x7f045019b4c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 >> 192.168.123.109:0/1970623098 conn(0x7f04500fc420 msgr2=0x7f04500fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 shutdown_connections 2026-03-09T00:29:37.820 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:37.821+0000 7f04560d7640 1 -- 192.168.123.109:0/1970623098 wait complete. 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm11", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: Deploying cephadm binary to vm11 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: Added host vm11 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:37.847 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:37.886 INFO:tasks.cephadm:Setting crush tunables to default 2026-03-09T00:29:37.886 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd crush tunables default 2026-03-09T00:29:38.057 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.194+0000 7f515f99e640 1 -- 192.168.123.109:0/2787313504 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 msgr2=0x7f515810aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.194+0000 7f515f99e640 1 --2- 192.168.123.109:0/2787313504 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515810aa40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f51480099b0 tx=0x7f514802f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.195+0000 7f515f99e640 1 -- 192.168.123.109:0/2787313504 shutdown_connections 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.195+0000 7f515f99e640 1 --2- 192.168.123.109:0/2787313504 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515810aa40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.195+0000 7f515f99e640 1 -- 192.168.123.109:0/2787313504 >> 192.168.123.109:0/2787313504 conn(0x7f5158100250 msgr2=0x7f5158102670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.195+0000 7f515f99e640 1 -- 192.168.123.109:0/2787313504 shutdown_connections 2026-03-09T00:29:38.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.195+0000 7f515f99e640 1 -- 192.168.123.109:0/2787313504 wait complete. 2026-03-09T00:29:38.195 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.195+0000 7f515f99e640 1 Processor -- start 2026-03-09T00:29:38.195 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515f99e640 1 -- start start 2026-03-09T00:29:38.195 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515f99e640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:38.195 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515f99e640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f515810e1c0 con 0x7f515810a660 2026-03-09T00:29:38.196 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515d713640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:38.196 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515d713640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:32894/0 (socket says 192.168.123.109:32894) 2026-03-09T00:29:38.196 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515d713640 1 -- 192.168.123.109:0/3730772648 learned_addr learned my addr 192.168.123.109:0/3730772648 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:38.196 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.196+0000 7f515d713640 1 -- 192.168.123.109:0/3730772648 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515819bb70 con 0x7f515810a660 2026-03-09T00:29:38.196 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.197+0000 7f515d713640 1 --2- 192.168.123.109:0/3730772648 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515819b630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51480042c0 tx=0x7f51480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:38.197 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.197+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5148047070 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.197+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f514803e070 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.197+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5148042710 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.197+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515819be00 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.197+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515819ff00 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.198+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7f514804c440 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.198+0000 7f514e7fc640 1 --2- 192.168.123.109:0/3730772648 >> v2:192.168.123.109:6800/82853931 conn(0x7f513403dd40 0x7f5134040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.198+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f5148077bb0 con 0x7f515810a660 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.199+0000 7f515cf12640 1 --2- 192.168.123.109:0/3730772648 >> v2:192.168.123.109:6800/82853931 conn(0x7f513403dd40 0x7f5134040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:38.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.199+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5158105cd0 con 0x7f515810a660 2026-03-09T00:29:38.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.202+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f514802fe20 con 0x7f515810a660 2026-03-09T00:29:38.203 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.203+0000 7f515cf12640 1 --2- 192.168.123.109:0/3730772648 >> v2:192.168.123.109:6800/82853931 conn(0x7f513403dd40 0x7f5134040200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f51400099c0 tx=0x7f5140006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:38.299 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.299+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f515810aac0 con 0x7f515810a660 2026-03-09T00:29:38.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.743+0000 7f514e7fc640 1 -- 192.168.123.109:0/3730772648 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f5148038ac0 con 0x7f515810a660 2026-03-09T00:29:38.743 INFO:teuthology.orchestra.run.vm09.stderr:adjusted tunables profile to default 2026-03-09T00:29:38.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.746+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 >> v2:192.168.123.109:6800/82853931 conn(0x7f513403dd40 msgr2=0x7f5134040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:38.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.746+0000 7f515f99e640 1 --2- 192.168.123.109:0/3730772648 >> v2:192.168.123.109:6800/82853931 conn(0x7f513403dd40 0x7f5134040200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f51400099c0 tx=0x7f5140006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:38.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.746+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 msgr2=0x7f515819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:38.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.746+0000 7f515f99e640 1 --2- 192.168.123.109:0/3730772648 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515819b630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51480042c0 tx=0x7f51480042f0 comp rx=0 tx=0).stop 2026-03-09T00:29:38.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.747+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 shutdown_connections 2026-03-09T00:29:38.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.747+0000 7f515f99e640 1 --2- 192.168.123.109:0/3730772648 >> v2:192.168.123.109:6800/82853931 conn(0x7f513403dd40 0x7f5134040200 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:38.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.747+0000 7f515f99e640 1 --2- 192.168.123.109:0/3730772648 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f515810a660 0x7f515819b630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:38.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.747+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 >> 192.168.123.109:0/3730772648 conn(0x7f5158100250 msgr2=0x7f5158100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:38.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.747+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 shutdown_connections 2026-03-09T00:29:38.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:38.747+0000 7f515f99e640 1 -- 192.168.123.109:0/3730772648 wait complete. 2026-03-09T00:29:38.793 INFO:tasks.cephadm:Adding mon.a on vm09 2026-03-09T00:29:38.793 INFO:tasks.cephadm:Adding mon.c on vm09 2026-03-09T00:29:38.793 INFO:tasks.cephadm:Adding mon.b on vm11 2026-03-09T00:29:38.793 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply mon '3;vm09:192.168.123.109=a;vm09:[v2:192.168.123.109:3301,v1:192.168.123.109:6790]=c;vm11:192.168.123.111=b' 2026-03-09T00:29:38.999 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /etc/ceph/ceph.conf 2026-03-09T00:29:39.052 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /etc/ceph/ceph.conf 2026-03-09T00:29:39.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:38 vm09 ceph-mon[49458]: mgrmap e13: y(active, since 6s) 2026-03-09T00:29:39.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:38 vm09 ceph-mon[49458]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:29:39.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:38 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3730772648' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T00:29:39.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:39.217 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.217+0000 7fd9feeee640 1 -- 192.168.123.111:0/1198217364 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 msgr2=0x7fd9f8073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:39.217 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.217+0000 7fd9feeee640 1 --2- 192.168.123.111:0/1198217364 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8073850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80099b0 tx=0x7fd9e802f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.220 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.222+0000 7fd9feeee640 1 -- 192.168.123.111:0/1198217364 shutdown_connections 2026-03-09T00:29:39.220 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.222+0000 7fd9feeee640 1 --2- 192.168.123.111:0/1198217364 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8073850 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.220 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.222+0000 7fd9feeee640 1 -- 192.168.123.111:0/1198217364 >> 192.168.123.111:0/1198217364 conn(0x7fd9f806ef40 msgr2=0x7fd9f8071380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:39.220 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.222+0000 7fd9feeee640 1 -- 192.168.123.111:0/1198217364 shutdown_connections 2026-03-09T00:29:39.221 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.222+0000 7fd9feeee640 1 -- 192.168.123.111:0/1198217364 wait complete. 2026-03-09T00:29:39.221 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.222+0000 7fd9feeee640 1 Processor -- start 2026-03-09T00:29:39.221 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.223+0000 7fd9feeee640 1 -- start start 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.223+0000 7fd9feeee640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8118f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.223+0000 7fd9feeee640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f810df00 con 0x7fd9f8073450 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.223+0000 7fd9fdeec640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8118f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.223+0000 7fd9fdeec640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8118f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:47248/0 (socket says 192.168.123.111:47248) 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.223+0000 7fd9fdeec640 1 -- 192.168.123.111:0/3450741651 learned_addr learned my addr 192.168.123.111:0/3450741651 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.224+0000 7fd9fdeec640 1 -- 192.168.123.111:0/3450741651 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f81b3690 con 0x7fd9f8073450 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.224+0000 7fd9fdeec640 1 --2- 192.168.123.111:0/3450741651 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8118f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8002410 tx=0x7fd9e8002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:39.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.224+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80387f0 con 0x7fd9f8073450 2026-03-09T00:29:39.223 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.224+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f81b3860 con 0x7fd9f8073450 2026-03-09T00:29:39.223 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.224+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f81b3c00 con 0x7fd9f8073450 2026-03-09T00:29:39.223 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.224+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fd9e8038e00 con 0x7fd9f8073450 2026-03-09T00:29:39.223 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.225+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8041d80 con 0x7fd9f8073450 2026-03-09T00:29:39.224 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.225+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7fd9e8038990 con 0x7fd9f8073450 2026-03-09T00:29:39.224 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.225+0000 7fd9e6ffd640 1 --2- 192.168.123.111:0/3450741651 >> v2:192.168.123.109:6800/82853931 conn(0x7fd9cc03d980 0x7fd9cc03fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:39.224 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.226+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fd9e803e070 con 0x7fd9f8073450 2026-03-09T00:29:39.224 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.226+0000 7fd9fd6eb640 1 --2- 192.168.123.111:0/3450741651 >> v2:192.168.123.109:6800/82853931 conn(0x7fd9cc03d980 0x7fd9cc03fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:39.225 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.226+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c0005180 con 0x7fd9f8073450 2026-03-09T00:29:39.226 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.227+0000 7fd9fd6eb640 1 --2- 192.168.123.111:0/3450741651 >> v2:192.168.123.109:6800/82853931 conn(0x7fd9cc03d980 0x7fd9cc03fe40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0099c0 tx=0x7fd9ec006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:39.229 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.230+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd9e8035320 con 0x7fd9f8073450 2026-03-09T00:29:39.338 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.339+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;vm09:192.168.123.109=a;vm09:[v2:192.168.123.109:3301,v1:192.168.123.109:6790]=c;vm11:192.168.123.111=b", "target": ["mon-mgr", ""]}) -- 0x7fd9c0002cc0 con 0x7fd9cc03d980 2026-03-09T00:29:39.343 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.345+0000 7fd9e6ffd640 1 -- 192.168.123.111:0/3450741651 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd9c0002cc0 con 0x7fd9cc03d980 2026-03-09T00:29:39.344 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled mon update... 2026-03-09T00:29:39.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 >> v2:192.168.123.109:6800/82853931 conn(0x7fd9cc03d980 msgr2=0x7fd9cc03fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 --2- 192.168.123.111:0/3450741651 >> v2:192.168.123.109:6800/82853931 conn(0x7fd9cc03d980 0x7fd9cc03fe40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0099c0 tx=0x7fd9ec006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 msgr2=0x7fd9f8118f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 --2- 192.168.123.111:0/3450741651 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8118f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8002410 tx=0x7fd9e8002820 comp rx=0 tx=0).stop 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 shutdown_connections 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 --2- 192.168.123.111:0/3450741651 >> v2:192.168.123.109:6800/82853931 conn(0x7fd9cc03d980 0x7fd9cc03fe40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 --2- 192.168.123.111:0/3450741651 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd9f8073450 0x7fd9f8118f90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 >> 192.168.123.111:0/3450741651 conn(0x7fd9f806ef40 msgr2=0x7fd9f8071380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 shutdown_connections 2026-03-09T00:29:39.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.348+0000 7fd9feeee640 1 -- 192.168.123.111:0/3450741651 wait complete. 2026-03-09T00:29:39.402 DEBUG:teuthology.orchestra.run.vm09:mon.c> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.c.service 2026-03-09T00:29:39.403 DEBUG:teuthology.orchestra.run.vm11:mon.b> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mon.b.service 2026-03-09T00:29:39.405 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-03-09T00:29:39.405 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph mon dump -f json 2026-03-09T00:29:39.639 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /etc/ceph/ceph.conf 2026-03-09T00:29:39.672 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /etc/ceph/ceph.conf 2026-03-09T00:29:39.817 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.818+0000 7fb38905f640 1 -- 192.168.123.111:0/184329056 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 msgr2=0x7fb384104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:39.817 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.818+0000 7fb38905f640 1 --2- 192.168.123.111:0/184329056 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb384104810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3780099b0 tx=0x7fb37802f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.818 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.819+0000 7fb38905f640 1 -- 192.168.123.111:0/184329056 shutdown_connections 2026-03-09T00:29:39.818 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.819+0000 7fb38905f640 1 --2- 192.168.123.111:0/184329056 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb384104810 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.818 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.819+0000 7fb38905f640 1 -- 192.168.123.111:0/184329056 >> 192.168.123.111:0/184329056 conn(0x7fb3840ffba0 msgr2=0x7fb384101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:39.818 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.819+0000 7fb38905f640 1 -- 192.168.123.111:0/184329056 shutdown_connections 2026-03-09T00:29:39.818 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.819+0000 7fb38905f640 1 -- 192.168.123.111:0/184329056 wait complete. 2026-03-09T00:29:39.818 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.820+0000 7fb38905f640 1 Processor -- start 2026-03-09T00:29:39.819 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.820+0000 7fb38905f640 1 -- start start 2026-03-09T00:29:39.819 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.820+0000 7fb38905f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb38419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:39.819 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.820+0000 7fb38905f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb384109a50 con 0x7fb384104410 2026-03-09T00:29:39.819 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.821+0000 7fb382d76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb38419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:39.819 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.821+0000 7fb382d76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb38419b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:47268/0 (socket says 192.168.123.111:47268) 2026-03-09T00:29:39.819 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.821+0000 7fb382d76640 1 -- 192.168.123.111:0/1988391907 learned_addr learned my addr 192.168.123.111:0/1988391907 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:29:39.820 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.821+0000 7fb382d76640 1 -- 192.168.123.111:0/1988391907 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38419b610 con 0x7fb384104410 2026-03-09T00:29:39.820 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.822+0000 7fb382d76640 1 --2- 192.168.123.111:0/1988391907 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb38419b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb378004290 tx=0x7fb3780042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:39.821 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.822+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb378047070 con 0x7fb384104410 2026-03-09T00:29:39.821 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.822+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fb37803e070 con 0x7fb384104410 2026-03-09T00:29:39.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.823+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38419b8a0 con 0x7fb384104410 2026-03-09T00:29:39.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.823+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38419e590 con 0x7fb384104410 2026-03-09T00:29:39.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.823+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb38410a1f0 con 0x7fb384104410 2026-03-09T00:29:39.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.823+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb378042780 con 0x7fb384104410 2026-03-09T00:29:39.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.824+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7fb378042920 con 0x7fb384104410 2026-03-09T00:29:39.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.825+0000 7fb363fff640 1 --2- 192.168.123.111:0/1988391907 >> v2:192.168.123.109:6800/82853931 conn(0x7fb35803d980 0x7fb35803fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:39.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.825+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fb3780771c0 con 0x7fb384104410 2026-03-09T00:29:39.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.825+0000 7fb382575640 1 --2- 192.168.123.111:0/1988391907 >> v2:192.168.123.109:6800/82853931 conn(0x7fb35803d980 0x7fb35803fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:39.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.826+0000 7fb382575640 1 --2- 192.168.123.111:0/1988391907 >> v2:192.168.123.109:6800/82853931 conn(0x7fb35803d980 0x7fb35803fe40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0099c0 tx=0x7fb36c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:39.826 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.827+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb37803edb0 con 0x7fb384104410 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stdout:{"epoch":1,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","modified":"2026-03-09T00:29:06.502670Z","created":"2026-03-09T00:29:06.502670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:3300","nonce":0},{"type":"v1","addr":"192.168.123.109:6789","nonce":0}]},"addr":"192.168.123.109:6789/0","public_addr":"192.168.123.109:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.984+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb3841948f0 con 0x7fb384104410 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.985+0000 7fb363fff640 1 -- 192.168.123.111:0/1988391907 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+753 (secure 0 0 0) 0x7fb378075b30 con 0x7fb384104410 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:dumped monmap epoch 1 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 >> v2:192.168.123.109:6800/82853931 conn(0x7fb35803d980 msgr2=0x7fb35803fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 --2- 192.168.123.111:0/1988391907 >> v2:192.168.123.109:6800/82853931 conn(0x7fb35803d980 0x7fb35803fe40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0099c0 tx=0x7fb36c006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 msgr2=0x7fb38419b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 --2- 192.168.123.111:0/1988391907 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb38419b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb378004290 tx=0x7fb3780042c0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.990 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 shutdown_connections 2026-03-09T00:29:39.991 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 --2- 192.168.123.111:0/1988391907 >> v2:192.168.123.109:6800/82853931 conn(0x7fb35803d980 0x7fb35803fe40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.991 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.990+0000 7fb38905f640 1 --2- 192.168.123.111:0/1988391907 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb384104410 0x7fb38419b0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:39.991 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.991+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 >> 192.168.123.111:0/1988391907 conn(0x7fb3840ffba0 msgr2=0x7fb384100610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:39.991 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.991+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 shutdown_connections 2026-03-09T00:29:39.991 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:39.991+0000 7fb38905f640 1 -- 192.168.123.111:0/1988391907 wait complete. 2026-03-09T00:29:40.179 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:39 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3730772648' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T00:29:40.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:39 vm09 ceph-mon[49458]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:40.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:39 vm09 ceph-mon[49458]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;vm09:192.168.123.109=a;vm09:[v2:192.168.123.109:3301,v1:192.168.123.109:6790]=c;vm11:192.168.123.111=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:40.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:39 vm09 ceph-mon[49458]: Saving service mon spec with placement vm09:192.168.123.109=a;vm09:[v2:192.168.123.109:3301,v1:192.168.123.109:6790]=c;vm11:192.168.123.111=b;count:3 2026-03-09T00:29:40.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.045 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-03-09T00:29:41.045 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph mon dump -f json 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/1988391907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: Updating vm11:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:41.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:40 vm09 ceph-mon[49458]: Deploying daemon mon.b on vm11 2026-03-09T00:29:41.267 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:29:41.549 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.550+0000 7ff05ad64640 1 -- 192.168.123.111:0/4160282228 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 msgr2=0x7ff054075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:41.550 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.550+0000 7ff05ad64640 1 --2- 192.168.123.111:0/4160282228 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff054075410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff0440099b0 tx=0x7ff04402f340 comp rx=0 tx=0).stop 2026-03-09T00:29:41.550 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.551+0000 7ff05ad64640 1 -- 192.168.123.111:0/4160282228 shutdown_connections 2026-03-09T00:29:41.550 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.551+0000 7ff05ad64640 1 --2- 192.168.123.111:0/4160282228 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff054075410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:41.550 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.551+0000 7ff05ad64640 1 -- 192.168.123.111:0/4160282228 >> 192.168.123.111:0/4160282228 conn(0x7ff054079240 msgr2=0x7ff054100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:41.550 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.551+0000 7ff05ad64640 1 -- 192.168.123.111:0/4160282228 shutdown_connections 2026-03-09T00:29:41.550 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.552+0000 7ff05ad64640 1 -- 192.168.123.111:0/4160282228 wait complete. 2026-03-09T00:29:41.551 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.552+0000 7ff05ad64640 1 Processor -- start 2026-03-09T00:29:41.551 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.552+0000 7ff05ad64640 1 -- start start 2026-03-09T00:29:41.551 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.552+0000 7ff05ad64640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff0541a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:41.551 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.552+0000 7ff05ad64640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff054112750 con 0x7ff054106270 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.553+0000 7ff058ad9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff0541a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.553+0000 7ff058ad9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff0541a58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:47286/0 (socket says 192.168.123.111:47286) 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.553+0000 7ff058ad9640 1 -- 192.168.123.111:0/3375906154 learned_addr learned my addr 192.168.123.111:0/3375906154 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.553+0000 7ff058ad9640 1 -- 192.168.123.111:0/3375906154 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0541a5e10 con 0x7ff054106270 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.553+0000 7ff058ad9640 1 --2- 192.168.123.111:0/3375906154 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff0541a58d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff044002410 tx=0x7ff044004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.553+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0440044e0 con 0x7ff054106270 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.554+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7ff044046070 con 0x7ff054106270 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.554+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0440416d0 con 0x7ff054106270 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.554+0000 7ff05ad64640 1 -- 192.168.123.111:0/3375906154 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0541a60a0 con 0x7ff054106270 2026-03-09T00:29:41.553 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.554+0000 7ff05ad64640 1 -- 192.168.123.111:0/3375906154 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05419fa90 con 0x7ff054106270 2026-03-09T00:29:41.554 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.554+0000 7ff05ad64640 1 -- 192.168.123.111:0/3375906154 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff054076b50 con 0x7ff054106270 2026-03-09T00:29:41.554 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.555+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7ff044038470 con 0x7ff054106270 2026-03-09T00:29:41.554 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.555+0000 7ff049ffb640 1 --2- 192.168.123.111:0/3375906154 >> v2:192.168.123.109:6800/82853931 conn(0x7ff03003dcf0 0x7ff0300401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:41.554 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.555+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7ff0440767d0 con 0x7ff054106270 2026-03-09T00:29:41.557 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.558+0000 7ff04bfff640 1 --2- 192.168.123.111:0/3375906154 >> v2:192.168.123.109:6800/82853931 conn(0x7ff03003dcf0 0x7ff0300401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:41.557 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.558+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff0440373d0 con 0x7ff054106270 2026-03-09T00:29:41.559 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.561+0000 7ff04bfff640 1 --2- 192.168.123.111:0/3375906154 >> v2:192.168.123.109:6800/82853931 conn(0x7ff03003dcf0 0x7ff0300401b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0099c0 tx=0x7ff03c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:41.732 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.733+0000 7ff05ad64640 1 -- 192.168.123.111:0/3375906154 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff054075490 con 0x7ff054106270 2026-03-09T00:29:41.734 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:29:41.734 INFO:teuthology.orchestra.run.vm11.stdout:{"epoch":1,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","modified":"2026-03-09T00:29:06.502670Z","created":"2026-03-09T00:29:06.502670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:3300","nonce":0},{"type":"v1","addr":"192.168.123.109:6789","nonce":0}]},"addr":"192.168.123.109:6789/0","public_addr":"192.168.123.109:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-03-09T00:29:41.734 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.734+0000 7ff049ffb640 1 -- 192.168.123.111:0/3375906154 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+753 (secure 0 0 0) 0x7ff044048d80 con 0x7ff054106270 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:dumped monmap epoch 1 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 -- 192.168.123.111:0/3375906154 >> v2:192.168.123.109:6800/82853931 conn(0x7ff03003dcf0 msgr2=0x7ff0300401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 --2- 192.168.123.111:0/3375906154 >> v2:192.168.123.109:6800/82853931 conn(0x7ff03003dcf0 0x7ff0300401b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0099c0 tx=0x7ff03c006eb0 comp rx=0 tx=0).stop 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 -- 192.168.123.111:0/3375906154 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 msgr2=0x7ff0541a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 --2- 192.168.123.111:0/3375906154 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff0541a58d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff044002410 tx=0x7ff044004060 comp rx=0 tx=0).stop 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 -- 192.168.123.111:0/3375906154 shutdown_connections 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 --2- 192.168.123.111:0/3375906154 >> v2:192.168.123.109:6800/82853931 conn(0x7ff03003dcf0 0x7ff0300401b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 --2- 192.168.123.111:0/3375906154 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff054106270 0x7ff0541a58d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 -- 192.168.123.111:0/3375906154 >> 192.168.123.111:0/3375906154 conn(0x7ff054079240 msgr2=0x7ff0541056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 -- 192.168.123.111:0/3375906154 shutdown_connections 2026-03-09T00:29:41.735 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:41.736+0000 7ff0237fe640 1 -- 192.168.123.111:0/3375906154 wait complete. 2026-03-09T00:29:42.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:42 vm11 ceph-mon[53379]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-03-09T00:29:42.265 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:41 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/3375906154' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:42.873 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-03-09T00:29:42.873 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph mon dump -f json 2026-03-09T00:29:43.061 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:29:43.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:42 vm09 ceph-mon[56118]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: Deploying daemon mon.c on vm09 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: mon.a calling monitor election 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: mon.b calling monitor election 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: monmap epoch 2 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: last_changed 2026-03-09T00:29:42.057749+0000 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: min_mon_release 19 (squid) 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: election_strategy: 1 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: 1: [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] mon.b 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: fsmap 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: mgrmap e13: y(active, since 16s) 2026-03-09T00:29:47.415 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: overall HEALTH_OK 2026-03-09T00:29:47.416 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.416 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.416 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.416 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.421 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: Deploying daemon mon.c on vm09 2026-03-09T00:29:47.421 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:47.421 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.421 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: mon.a calling monitor election 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: mon.b calling monitor election 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: monmap epoch 2 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: last_changed 2026-03-09T00:29:42.057749+0000 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: min_mon_release 19 (squid) 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: election_strategy: 1 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: 1: [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] mon.b 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: fsmap 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: mgrmap e13: y(active, since 16s) 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: overall HEALTH_OK 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.422 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:47.704 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.703+0000 7ffacbfff640 1 -- 192.168.123.111:0/1106444142 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 msgr2=0x7ffaa8005680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:47.704 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.703+0000 7ffacbfff640 1 --2- 192.168.123.111:0/1106444142 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffaa8005680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffac0002a00 tx=0x7ffac0030c80 comp rx=0 tx=0).stop 2026-03-09T00:29:47.704 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 -- 192.168.123.111:0/1106444142 shutdown_connections 2026-03-09T00:29:47.704 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 --2- 192.168.123.111:0/1106444142 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffaa8005680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:47.704 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 -- 192.168.123.111:0/1106444142 >> 192.168.123.111:0/1106444142 conn(0x7ffacc1001a0 msgr2=0x7ffacc1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 -- 192.168.123.111:0/1106444142 shutdown_connections 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 -- 192.168.123.111:0/1106444142 wait complete. 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 Processor -- start 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.705+0000 7ffacbfff640 1 -- start start 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacbfff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffacc19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacbfff640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 0x7ffacc19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacbfff640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc10bb10 con 0x7ffacc10a550 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacbfff640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc10b990 con 0x7ffacc19ba90 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacaffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffacc19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffaca7fc640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 0x7ffacc19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacaffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffacc19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:49638/0 (socket says 192.168.123.111:49638) 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffacaffd640 1 -- 192.168.123.111:0/1778637417 learned_addr learned my addr 192.168.123.111:0/1778637417 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffaca7fc640 1 -- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 msgr2=0x7ffacc19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffaca7fc640 1 -- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 msgr2=0x7ffacc19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffaca7fc640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 0x7ffacc19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.706+0000 7ffaca7fc640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 0x7ffacc19fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.707+0000 7ffacaffd640 1 -- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 msgr2=0x7ffacc19fe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.707+0000 7ffacaffd640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 0x7ffacc19fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:47.705 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.707+0000 7ffacaffd640 1 -- 192.168.123.111:0/1778637417 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc19c140 con 0x7ffacc10a550 2026-03-09T00:29:47.706 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.708+0000 7ffacaffd640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffacc19b550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005bb0 tx=0x7ffac0032c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.708+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ffac0032e10 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.708+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7ffac0005410 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.708+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ffac003ab90 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.708+0000 7ffacbfff640 1 -- 192.168.123.111:0/1778637417 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc1a0360 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.708+0000 7ffacbfff640 1 -- 192.168.123.111:0/1778637417 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1a0970 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.709+0000 7ffacbfff640 1 -- 192.168.123.111:0/1778637417 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa98005180 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.709+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7ffac000f040 con 0x7ffacc10a550 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.709+0000 7ffaaffff640 1 --2- 192.168.123.111:0/1778637417 >> v2:192.168.123.109:6800/82853931 conn(0x7ffaa403d960 0x7ffaa403fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:47.708 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.709+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7ffac0047070 con 0x7ffacc10a550 2026-03-09T00:29:47.709 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.710+0000 7ffaca7fc640 1 --2- 192.168.123.111:0/1778637417 >> v2:192.168.123.109:6800/82853931 conn(0x7ffaa403d960 0x7ffaa403fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:47.709 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.711+0000 7ffaca7fc640 1 --2- 192.168.123.111:0/1778637417 >> v2:192.168.123.109:6800/82853931 conn(0x7ffaa403d960 0x7ffaa403fe20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffab8006fb0 tx=0x7ffab8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:47.715 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.713+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffac00417f0 con 0x7ffacc10a550 2026-03-09T00:29:47.858 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.859+0000 7ffacbfff640 1 -- 192.168.123.111:0/1778637417 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ffa98005470 con 0x7ffacc10a550 2026-03-09T00:29:47.858 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.860+0000 7ffaaffff640 1 -- 192.168.123.111:0/1778637417 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1031 (secure 0 0 0) 0x7ffac0051240 con 0x7ffacc10a550 2026-03-09T00:29:47.859 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:29:47.859 INFO:teuthology.orchestra.run.vm11.stdout:{"epoch":2,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","modified":"2026-03-09T00:29:42.057749Z","created":"2026-03-09T00:29:06.502670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:3300","nonce":0},{"type":"v1","addr":"192.168.123.109:6789","nonce":0}]},"addr":"192.168.123.109:6789/0","public_addr":"192.168.123.109:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:3300","nonce":0},{"type":"v1","addr":"192.168.123.111:6789","nonce":0}]},"addr":"192.168.123.111:6789/0","public_addr":"192.168.123.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-03-09T00:29:47.859 INFO:teuthology.orchestra.run.vm11.stderr:dumped monmap epoch 2 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 -- 192.168.123.111:0/1778637417 >> v2:192.168.123.109:6800/82853931 conn(0x7ffaa403d960 msgr2=0x7ffaa403fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 --2- 192.168.123.111:0/1778637417 >> v2:192.168.123.109:6800/82853931 conn(0x7ffaa403d960 0x7ffaa403fe20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffab8006fb0 tx=0x7ffab8008040 comp rx=0 tx=0).stop 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 -- 192.168.123.111:0/1778637417 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 msgr2=0x7ffacc19b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffacc19b550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005bb0 tx=0x7ffac0032c20 comp rx=0 tx=0).stop 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 -- 192.168.123.111:0/1778637417 shutdown_connections 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 --2- 192.168.123.111:0/1778637417 >> v2:192.168.123.109:6800/82853931 conn(0x7ffaa403d960 0x7ffaa403fe20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ffacc19ba90 0x7ffacc19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 --2- 192.168.123.111:0/1778637417 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ffacc10a550 0x7ffacc19b550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 -- 192.168.123.111:0/1778637417 >> 192.168.123.111:0/1778637417 conn(0x7ffacc1001a0 msgr2=0x7ffacc108870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:47.864 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.865+0000 7ffaadffb640 1 -- 192.168.123.111:0/1778637417 shutdown_connections 2026-03-09T00:29:47.865 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:47.866+0000 7ffaadffb640 1 -- 192.168.123.111:0/1778637417 wait complete. 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/1778637417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:48.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:48 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/1778637417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:48.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:48 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:49.046 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-03-09T00:29:49.067 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph mon dump -f json 2026-03-09T00:29:49.068 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:49 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:49.056+0000 7fcaed701640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-03-09T00:29:49.236 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.600+0000 7f3fc8373640 1 -- 192.168.123.111:0/3926867080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc010a640 msgr2=0x7f3fc010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.600+0000 7f3fc8373640 1 --2- 192.168.123.111:0/3926867080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc010a640 0x7f3fc010aa20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40099b0 tx=0x7f3fb402f2b0 comp rx=0 tx=0).stop 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.601+0000 7f3fc8373640 1 -- 192.168.123.111:0/3926867080 shutdown_connections 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.601+0000 7f3fc8373640 1 --2- 192.168.123.111:0/3926867080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc010a640 0x7f3fc010aa20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.601+0000 7f3fc8373640 1 -- 192.168.123.111:0/3926867080 >> 192.168.123.111:0/3926867080 conn(0x7f3fc01006d0 msgr2=0x7f3fc0102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.601+0000 7f3fc8373640 1 -- 192.168.123.111:0/3926867080 shutdown_connections 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.601+0000 7f3fc8373640 1 -- 192.168.123.111:0/3926867080 wait complete. 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.602+0000 7f3fc8373640 1 Processor -- start 2026-03-09T00:29:49.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.602+0000 7f3fc8373640 1 -- start start 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc8373640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc8373640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc8373640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc8373640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010e1c0 con 0x7f3fc01a4c80 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc8373640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010e040 con 0x7f3fc01a03b0 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc8373640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc010e340 con 0x7f3fc010a640 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc58e7640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.111:43640/0 (socket says 192.168.123.111:43640) 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 learned_addr learned my addr 192.168.123.111:0/4008040904 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:49.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.603+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: Deploying daemon mon.c on vm09 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: mon.a calling monitor election 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: mon.b calling monitor election 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: monmap epoch 2 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: last_changed 2026-03-09T00:29:42.057749+0000 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: min_mon_release 19 (squid) 2026-03-09T00:29:49.619 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: election_strategy: 1 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: 1: [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] mon.b 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: fsmap 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: mgrmap e13: y(active, since 16s) 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: overall HEALTH_OK 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/1778637417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:49.620 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.804+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.804+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.804+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.804+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.804+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.804+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:49.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:49.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:49.805+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:50.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.205+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:50.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:50.206+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:51.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:51.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.008+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:51.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.009+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:51.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.009+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:51.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.009+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:51.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:51.009+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:52.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 msgr2=0x7f3fc019fe70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:52.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3fc010a640 0x7f3fc019fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:52.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 msgr2=0x7f3fc01a4740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3fc01a03b0 0x7f3fc01a4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 msgr2=0x7f3fc01a5130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3fc01a4c80 0x7f3fc01a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010e1c0 con 0x7f3f8c008cc0 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010e040 con 0x7f3f8c006200 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc010e340 con 0x7f3f8c0037b0 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:52.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.604+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.605+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.605+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.605+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.605+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:52.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.605+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:52.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.805+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.805+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:52.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:52.806+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-03-09T00:29:53.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.206+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:53.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:53.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:53.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:53.207+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-03-09T00:29:54.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:54.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:54.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:54.007 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc60e8640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.008+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.009+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.009+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.009+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:54.008 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:54.009+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: mon.a calling monitor election 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: mon.b calling monitor election 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: mon.c calling monitor election 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: monmap epoch 3 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: last_changed 2026-03-09T00:29:49.395442+0000 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: min_mon_release 19 (squid) 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: election_strategy: 1 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: 1: [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] mon.b 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: 2: [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] mon.c 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: fsmap 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: mgrmap e13: y(active, since 23s) 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: overall HEALTH_OK 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: mon.a calling monitor election 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: mon.b calling monitor election 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: mon.c calling monitor election 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: monmap epoch 3 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: last_changed 2026-03-09T00:29:49.395442+0000 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: min_mon_release 19 (squid) 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: election_strategy: 1 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: 1: [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] mon.b 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: 2: [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] mon.c 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: fsmap 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: mgrmap e13: y(active, since 23s) 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: overall HEALTH_OK 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:54.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: mon.a calling monitor election 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: mon.b calling monitor election 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: mon.c calling monitor election 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: monmap epoch 3 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: last_changed 2026-03-09T00:29:49.395442+0000 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: created 2026-03-09T00:29:06.502670+0000 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: min_mon_release 19 (squid) 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: election_strategy: 1 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: 0: [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] mon.a 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: 1: [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] mon.b 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: 2: [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] mon.c 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: fsmap 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: mgrmap e13: y(active, since 23s) 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: overall HEALTH_OK 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:54.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:55.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.603+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:55.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.603+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010e1c0 con 0x7f3f8c008cc0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010e040 con 0x7f3f8c006200 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fae7fc640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc010e340 con 0x7f3f8c0037b0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.604+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc58e7640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc58e7640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 msgr2=0x7f3f8c005be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 msgr2=0x7f3f8c008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc68e9640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc01ac9f0 con 0x7f3f8c008cc0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.605+0000 7f3fc68e9640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fc01a5060 tx=0x7f3fbc00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.606+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc025470 con 0x7f3f8c008cc0 2026-03-09T00:29:55.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.606+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc019fed0 con 0x7f3f8c008cc0 2026-03-09T00:29:55.605 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.606+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc01a4910 con 0x7f3f8c008cc0 2026-03-09T00:29:55.605 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.606+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f3fbc020070 con 0x7f3f8c008cc0 2026-03-09T00:29:55.605 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.606+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc01c890 con 0x7f3f8c008cc0 2026-03-09T00:29:55.606 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.607+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7f3fbc025610 con 0x7f3f8c008cc0 2026-03-09T00:29:55.606 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.607+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f90005180 con 0x7f3f8c008cc0 2026-03-09T00:29:55.606 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.607+0000 7f3faf7fe640 1 --2- 192.168.123.111:0/4008040904 >> v2:192.168.123.109:6800/82853931 conn(0x7f3f9803ddb0 0x7f3f98040270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:55.606 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.607+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f3fbc054500 con 0x7f3f8c008cc0 2026-03-09T00:29:55.606 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.608+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> v2:192.168.123.109:6800/82853931 conn(0x7f3f9803ddb0 0x7f3f98040270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:55.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.608+0000 7f3fc60e8640 1 --2- 192.168.123.111:0/4008040904 >> v2:192.168.123.109:6800/82853931 conn(0x7f3f9803ddb0 0x7f3f98040270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4005ec0 tx=0x7f3fb4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:55.610 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.610+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3fbc025bc0 con 0x7f3f8c008cc0 2026-03-09T00:29:55.744 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.745+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3f90005470 con 0x7f3f8c008cc0 2026-03-09T00:29:55.744 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.746+0000 7f3faf7fe640 1 -- 192.168.123.111:0/4008040904 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1309 (secure 0 0 0) 0x7f3fbc02ecc0 con 0x7f3f8c008cc0 2026-03-09T00:29:55.745 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:29:55.745 INFO:teuthology.orchestra.run.vm11.stdout:{"epoch":3,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","modified":"2026-03-09T00:29:49.395442Z","created":"2026-03-09T00:29:06.502670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:3300","nonce":0},{"type":"v1","addr":"192.168.123.109:6789","nonce":0}]},"addr":"192.168.123.109:6789/0","public_addr":"192.168.123.109:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:3300","nonce":0},{"type":"v1","addr":"192.168.123.111:6789","nonce":0}]},"addr":"192.168.123.111:6789/0","public_addr":"192.168.123.111:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:3301","nonce":0},{"type":"v1","addr":"192.168.123.109:6790","nonce":0}]},"addr":"192.168.123.109:6790/0","public_addr":"192.168.123.109:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2026-03-09T00:29:55.745 INFO:teuthology.orchestra.run.vm11.stderr:dumped monmap epoch 3 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.748+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 >> v2:192.168.123.109:6800/82853931 conn(0x7f3f9803ddb0 msgr2=0x7f3f98040270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.748+0000 7f3fc8373640 1 --2- 192.168.123.111:0/4008040904 >> v2:192.168.123.109:6800/82853931 conn(0x7f3f9803ddb0 0x7f3f98040270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4005ec0 tx=0x7f3fb4005c50 comp rx=0 tx=0).stop 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.748+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 msgr2=0x7f3f8c00b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.748+0000 7f3fc8373640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fc01a5060 tx=0x7f3fbc00b820 comp rx=0 tx=0).stop 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 shutdown_connections 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 --2- 192.168.123.111:0/4008040904 >> v2:192.168.123.109:6800/82853931 conn(0x7f3f9803ddb0 0x7f3f98040270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3f8c008cc0 0x7f3f8c00b0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3f8c0037b0 0x7f3f8c005be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 --2- 192.168.123.111:0/4008040904 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3f8c006200 0x7f3f8c008610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:55.747 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 >> 192.168.123.111:0/4008040904 conn(0x7f3fc01006d0 msgr2=0x7f3fc01073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:55.748 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 shutdown_connections 2026-03-09T00:29:55.748 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:55.749+0000 7f3fc8373640 1 -- 192.168.123.111:0/4008040904 wait complete. 2026-03-09T00:29:55.794 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-03-09T00:29:55.794 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph config generate-minimal-conf 2026-03-09T00:29:56.015 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Reconfiguring mon.b (monmap changed)... 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Reconfiguring daemon mon.b on vm11 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:56.047 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Reconfiguring mon.a (monmap changed)... 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Reconfiguring daemon mon.a on vm09 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Reconfiguring mon.c (monmap changed)... 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: Reconfiguring daemon mon.c on vm09 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/4008040904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Reconfiguring mon.b (monmap changed)... 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Reconfiguring daemon mon.b on vm11 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Reconfiguring mon.a (monmap changed)... 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Reconfiguring daemon mon.a on vm09 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Reconfiguring mon.c (monmap changed)... 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: Reconfiguring daemon mon.c on vm09 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/4008040904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.048 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.049 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:29:55 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:29:55.963+0000 7fcaed701640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.156+0000 7f2b1538b640 1 -- 192.168.123.109:0/2986560663 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 msgr2=0x7f2b1010f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.156+0000 7f2b1538b640 1 --2- 192.168.123.109:0/2986560663 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b1010f920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000b0d0 tx=0x7f2b0002f470 comp rx=0 tx=0).stop 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 -- 192.168.123.109:0/2986560663 shutdown_connections 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 --2- 192.168.123.109:0/2986560663 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b1010f920 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 --2- 192.168.123.109:0/2986560663 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10102a50 0x7f2b10102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 --2- 192.168.123.109:0/2986560663 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10108a50 0x7f2b10108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 -- 192.168.123.109:0/2986560663 >> 192.168.123.109:0/2986560663 conn(0x7f2b100fe770 msgr2=0x7f2b10100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 -- 192.168.123.109:0/2986560663 shutdown_connections 2026-03-09T00:29:56.157 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.158+0000 7f2b1538b640 1 -- 192.168.123.109:0/2986560663 wait complete. 2026-03-09T00:29:56.158 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 Processor -- start 2026-03-09T00:29:56.158 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 -- start start 2026-03-09T00:29:56.158 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 0x7f2b10075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b100758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10108a50 0x7f2b10075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10112300 con 0x7f2b101033f0 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10112180 con 0x7f2b10102a50 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.159+0000 7f2b1538b640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f2b10112480 con 0x7f2b10108a50 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0effd640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 0x7f2b10075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b100758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b100758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:50136/0 (socket says 192.168.123.109:50136) 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 -- 192.168.123.109:0/3863018048 learned_addr learned my addr 192.168.123.109:0/3863018048 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:29:56.159 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0effd640 1 -- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 msgr2=0x7f2b10075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-03-09T00:29:56.160 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0effd640 1 -- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 msgr2=0x7f2b10075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:56.160 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0effd640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 0x7f2b10075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:56.160 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0effd640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 0x7f2b10075370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:56.160 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 -- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10108a50 msgr2=0x7f2b10075df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0f7fe640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10108a50 0x7f2b10075df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10108a50 0x7f2b10075df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 -- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 msgr2=0x7f2b10075370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 0x7f2b10075370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.160+0000 7f2b0e7fc640 1 -- 192.168.123.109:0/3863018048 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b101a8e70 con 0x7f2b101033f0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2b0f7fe640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10108a50 0x7f2b10075df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2b0e7fc640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b100758b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400cab0 tx=0x7f2b0400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04013070 con 0x7f2b101033f0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f2b04007da0 con 0x7f2b101033f0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1019a6c0 con 0x7f2b101033f0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1019ac50 con 0x7f2b101033f0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.161+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400f450 con 0x7f2b101033f0 2026-03-09T00:29:56.161 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.162+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7f2b0400f5f0 con 0x7f2b101033f0 2026-03-09T00:29:56.162 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.163+0000 7f2aeffff640 1 --2- 192.168.123.109:0/3863018048 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ae40467c0 0x7f2ae4048c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.162 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.163+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f2b04053320 con 0x7f2b101033f0 2026-03-09T00:29:56.162 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.163+0000 7f2b0effd640 1 --2- 192.168.123.109:0/3863018048 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ae40467c0 0x7f2ae4048c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.165 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.163+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad4005180 con 0x7f2b101033f0 2026-03-09T00:29:56.165 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.163+0000 7f2b0effd640 1 --2- 192.168.123.109:0/3863018048 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ae40467c0 0x7f2ae4048c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2af8006f70 tx=0x7f2af8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:56.165 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.166+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2b0401c170 con 0x7f2b101033f0 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Reconfiguring mon.b (monmap changed)... 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Reconfiguring daemon mon.b on vm11 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Reconfiguring mon.a (monmap changed)... 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Reconfiguring daemon mon.a on vm09 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Reconfiguring mon.c (monmap changed)... 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: Reconfiguring daemon mon.c on vm09 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/4008040904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:56.265 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.265+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2ad4005470 con 0x7f2b101033f0 2026-03-09T00:29:56.265 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.266+0000 7f2aeffff640 1 -- 192.168.123.109:0/3863018048 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+289 (secure 0 0 0) 0x7f2b04012dd0 con 0x7f2b101033f0 2026-03-09T00:29:56.265 INFO:teuthology.orchestra.run.vm09.stdout:# minimal ceph.conf for c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:56.265 INFO:teuthology.orchestra.run.vm09.stdout:[global] 2026-03-09T00:29:56.265 INFO:teuthology.orchestra.run.vm09.stdout: fsid = c172d940-1b4e-11f1-be3e-fb1b568ebce1 2026-03-09T00:29:56.265 INFO:teuthology.orchestra.run.vm09.stdout: mon_host = [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.268+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ae40467c0 msgr2=0x7f2ae4048c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.268+0000 7f2b1538b640 1 --2- 192.168.123.109:0/3863018048 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ae40467c0 0x7f2ae4048c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2af8006f70 tx=0x7f2af8008040 comp rx=0 tx=0).stop 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 msgr2=0x7f2b100758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b100758b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400cab0 tx=0x7f2b0400cf80 comp rx=0 tx=0).stop 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 shutdown_connections 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 --2- 192.168.123.109:0/3863018048 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ae40467c0 0x7f2ae4048c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2b10108a50 0x7f2b10075df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2b101033f0 0x7f2b100758b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 --2- 192.168.123.109:0/3863018048 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2b10102a50 0x7f2b10075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 >> 192.168.123.109:0/3863018048 conn(0x7f2b100fe770 msgr2=0x7f2b100feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 shutdown_connections 2026-03-09T00:29:56.268 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:29:56.269+0000 7f2b1538b640 1 -- 192.168.123.109:0/3863018048 wait complete. 2026-03-09T00:29:56.324 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-03-09T00:29:56.324 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:56.325 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T00:29:56.356 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:56.356 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:56.427 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:29:56.427 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T00:29:56.457 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:29:56.457 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:56.525 INFO:tasks.cephadm:Adding mgr.y on vm09 2026-03-09T00:29:56.525 INFO:tasks.cephadm:Adding mgr.x on vm11 2026-03-09T00:29:56.525 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply mgr '2;vm09=y;vm11=x' 2026-03-09T00:29:56.740 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.874+0000 7f198f50f640 1 -- 192.168.123.111:0/77531044 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988077aa0 msgr2=0x7f1988077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.874+0000 7f198f50f640 1 --2- 192.168.123.111:0/77531044 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988077aa0 0x7f1988077ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f197c009960 tx=0x7f197c02f140 comp rx=0 tx=0).stop 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 -- 192.168.123.111:0/77531044 shutdown_connections 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 --2- 192.168.123.111:0/77531044 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1988079690 0x7f1988079f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 --2- 192.168.123.111:0/77531044 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988078cf0 0x7f1988079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 --2- 192.168.123.111:0/77531044 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988077aa0 0x7f1988077ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.873 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 -- 192.168.123.111:0/77531044 >> 192.168.123.111:0/77531044 conn(0x7f19881004f0 msgr2=0x7f1988102910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:56.874 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 -- 192.168.123.111:0/77531044 shutdown_connections 2026-03-09T00:29:56.874 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 -- 192.168.123.111:0/77531044 wait complete. 2026-03-09T00:29:56.874 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.875+0000 7f198f50f640 1 Processor -- start 2026-03-09T00:29:56.874 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 -- start start 2026-03-09T00:29:56.874 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1988077aa0 0x7f19881a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 0x7f19881a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 0x7f19881a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1988114320 con 0x7f1988078cf0 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f19881141a0 con 0x7f1988079690 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198f50f640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f19881144a0 con 0x7f1988077aa0 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198da85640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 0x7f19881a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198ca83640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 0x7f19881a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198ca83640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 0x7f19881a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:34258/0 (socket says 192.168.123.111:34258) 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198ca83640 1 -- 192.168.123.111:0/4087225719 learned_addr learned my addr 192.168.123.111:0/4087225719 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198da85640 1 -- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 msgr2=0x7f19881a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198da85640 1 -- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 msgr2=0x7f19881a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198da85640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 0x7f19881a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198da85640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 0x7f19881a8000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198ca83640 1 -- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1988077aa0 msgr2=0x7f19881a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.876+0000 7f198ca83640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1988077aa0 0x7f19881a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f198ca83640 1 -- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 msgr2=0x7f19881a8000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f198ca83640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 0x7f19881a8000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f198ca83640 1 -- 192.168.123.111:0/4087225719 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19881a8700 con 0x7f1988078cf0 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f198ca83640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 0x7f19881a0f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1978004750 tx=0x7f197800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:56.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978014070 con 0x7f1988078cf0 2026-03-09T00:29:56.876 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19881a89f0 con 0x7f1988078cf0 2026-03-09T00:29:56.876 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f1978009e00 con 0x7f1988078cf0 2026-03-09T00:29:56.876 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197800f3c0 con 0x7f1988078cf0 2026-03-09T00:29:56.876 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.877+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19881a8f80 con 0x7f1988078cf0 2026-03-09T00:29:56.876 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.878+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1950005180 con 0x7f1988078cf0 2026-03-09T00:29:56.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.878+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7f1978021020 con 0x7f1988078cf0 2026-03-09T00:29:56.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.879+0000 7f19767fc640 1 --2- 192.168.123.111:0/4087225719 >> v2:192.168.123.109:6800/82853931 conn(0x7f196403dde0 0x7f19640402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:29:56.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.879+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f1978052690 con 0x7f1988078cf0 2026-03-09T00:29:56.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.879+0000 7f198d284640 1 --2- 192.168.123.111:0/4087225719 >> v2:192.168.123.109:6800/82853931 conn(0x7f196403dde0 0x7f19640402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:29:56.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.879+0000 7f198d284640 1 --2- 192.168.123.111:0/4087225719 >> v2:192.168.123.109:6800/82853931 conn(0x7f196403dde0 0x7f19640402a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f197c009880 tx=0x7f197c0029a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:29:56.880 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.881+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f197801f250 con 0x7f1988078cf0 2026-03-09T00:29:56.989 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.990+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm09=y;vm11=x", "target": ["mon-mgr", ""]}) -- 0x7f1950002bf0 con 0x7f196403dde0 2026-03-09T00:29:56.995 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled mgr update... 2026-03-09T00:29:56.995 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.995+0000 7f19767fc640 1 -- 192.168.123.111:0/4087225719 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1950002bf0 con 0x7f196403dde0 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.998+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 >> v2:192.168.123.109:6800/82853931 conn(0x7f196403dde0 msgr2=0x7f19640402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.998+0000 7f198f50f640 1 --2- 192.168.123.111:0/4087225719 >> v2:192.168.123.109:6800/82853931 conn(0x7f196403dde0 0x7f19640402a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f197c009880 tx=0x7f197c0029a0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.998+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 msgr2=0x7f19881a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.998+0000 7f198f50f640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 0x7f19881a0f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1978004750 tx=0x7f197800da80 comp rx=0 tx=0).stop 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 shutdown_connections 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 --2- 192.168.123.111:0/4087225719 >> v2:192.168.123.109:6800/82853931 conn(0x7f196403dde0 0x7f19640402a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1988079690 0x7f19881a8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1988078cf0 0x7f19881a0f80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 --2- 192.168.123.111:0/4087225719 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1988077aa0 0x7f19881a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 >> 192.168.123.111:0/4087225719 conn(0x7f19881004f0 msgr2=0x7f1988101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:29:56.997 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 shutdown_connections 2026-03-09T00:29:56.998 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:29:56.999+0000 7f198f50f640 1 -- 192.168.123.111:0/4087225719 wait complete. 2026-03-09T00:29:57.020 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:56 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/3863018048' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:57.059 DEBUG:teuthology.orchestra.run.vm11:mgr.x> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@mgr.x.service 2026-03-09T00:29:57.060 INFO:tasks.cephadm:Deploying OSDs... 2026-03-09T00:29:57.060 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:29:57.060 DEBUG:teuthology.orchestra.run.vm09:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T00:29:57.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:29:57.078 DEBUG:teuthology.orchestra.run.vm09:> ls /dev/[sv]d? 2026-03-09T00:29:57.135 INFO:teuthology.orchestra.run.vm09.stdout:/dev/vda 2026-03-09T00:29:57.135 INFO:teuthology.orchestra.run.vm09.stdout:/dev/vdb 2026-03-09T00:29:57.135 INFO:teuthology.orchestra.run.vm09.stdout:/dev/vdc 2026-03-09T00:29:57.135 INFO:teuthology.orchestra.run.vm09.stdout:/dev/vdd 2026-03-09T00:29:57.135 INFO:teuthology.orchestra.run.vm09.stdout:/dev/vde 2026-03-09T00:29:57.135 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T00:29:57.135 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T00:29:57.135 DEBUG:teuthology.orchestra.run.vm09:> stat /dev/vdb 2026-03-09T00:29:57.179 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:56 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3863018048' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:57.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:56 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/3863018048' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout: File: /dev/vdb 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout:Device: 6h/6d Inode: 254 Links: 1 Device type: fc,10 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout:Access: 2026-03-09 00:29:34.614462251 +0000 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout:Modify: 2026-03-09 00:26:22.038428158 +0000 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout:Change: 2026-03-09 00:26:22.038428158 +0000 2026-03-09T00:29:57.193 INFO:teuthology.orchestra.run.vm09.stdout: Birth: 2026-03-09 00:23:06.263000000 +0000 2026-03-09T00:29:57.193 DEBUG:teuthology.orchestra.run.vm09:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T00:29:57.261 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records in 2026-03-09T00:29:57.262 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records out 2026-03-09T00:29:57.262 INFO:teuthology.orchestra.run.vm09.stderr:512 bytes copied, 0.000197019 s, 2.6 MB/s 2026-03-09T00:29:57.263 DEBUG:teuthology.orchestra.run.vm09:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T00:29:57.321 DEBUG:teuthology.orchestra.run.vm09:> stat /dev/vdc 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout: File: /dev/vdc 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout:Device: 6h/6d Inode: 255 Links: 1 Device type: fc,20 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout:Access: 2026-03-09 00:29:34.677462301 +0000 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout:Modify: 2026-03-09 00:26:22.005428131 +0000 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout:Change: 2026-03-09 00:26:22.005428131 +0000 2026-03-09T00:29:57.381 INFO:teuthology.orchestra.run.vm09.stdout: Birth: 2026-03-09 00:23:06.269000000 +0000 2026-03-09T00:29:57.381 DEBUG:teuthology.orchestra.run.vm09:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T00:29:57.448 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records in 2026-03-09T00:29:57.448 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records out 2026-03-09T00:29:57.448 INFO:teuthology.orchestra.run.vm09.stderr:512 bytes copied, 0.000261729 s, 2.0 MB/s 2026-03-09T00:29:57.449 DEBUG:teuthology.orchestra.run.vm09:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T00:29:57.505 DEBUG:teuthology.orchestra.run.vm09:> stat /dev/vdd 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout: File: /dev/vdd 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout:Device: 6h/6d Inode: 256 Links: 1 Device type: fc,30 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout:Access: 2026-03-09 00:29:34.721462336 +0000 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout:Modify: 2026-03-09 00:26:22.017428140 +0000 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout:Change: 2026-03-09 00:26:22.017428140 +0000 2026-03-09T00:29:57.567 INFO:teuthology.orchestra.run.vm09.stdout: Birth: 2026-03-09 00:23:06.285000000 +0000 2026-03-09T00:29:57.567 DEBUG:teuthology.orchestra.run.vm09:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T00:29:57.632 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records in 2026-03-09T00:29:57.633 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records out 2026-03-09T00:29:57.633 INFO:teuthology.orchestra.run.vm09.stderr:512 bytes copied, 0.000345327 s, 1.5 MB/s 2026-03-09T00:29:57.634 DEBUG:teuthology.orchestra.run.vm09:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T00:29:57.693 DEBUG:teuthology.orchestra.run.vm09:> stat /dev/vde 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout: File: /dev/vde 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout:Device: 6h/6d Inode: 257 Links: 1 Device type: fc,40 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout:Access: 2026-03-09 00:29:34.755462362 +0000 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout:Modify: 2026-03-09 00:26:22.032428153 +0000 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout:Change: 2026-03-09 00:26:22.032428153 +0000 2026-03-09T00:29:57.752 INFO:teuthology.orchestra.run.vm09.stdout: Birth: 2026-03-09 00:23:06.358000000 +0000 2026-03-09T00:29:57.753 DEBUG:teuthology.orchestra.run.vm09:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T00:29:57.824 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records in 2026-03-09T00:29:57.825 INFO:teuthology.orchestra.run.vm09.stderr:1+0 records out 2026-03-09T00:29:57.825 INFO:teuthology.orchestra.run.vm09.stderr:512 bytes copied, 0.000203891 s, 2.5 MB/s 2026-03-09T00:29:57.826 DEBUG:teuthology.orchestra.run.vm09:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T00:29:57.893 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:29:57.893 DEBUG:teuthology.orchestra.run.vm11:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T00:29:57.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:29:57.922 DEBUG:teuthology.orchestra.run.vm11:> ls /dev/[sv]d? 2026-03-09T00:29:57.927 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:57 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:57.926+0000 7f2145d24140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:29:57.945 INFO:teuthology.orchestra.run.vm11.stdout:/dev/vda 2026-03-09T00:29:57.945 INFO:teuthology.orchestra.run.vm11.stdout:/dev/vdb 2026-03-09T00:29:57.945 INFO:teuthology.orchestra.run.vm11.stdout:/dev/vdc 2026-03-09T00:29:57.945 INFO:teuthology.orchestra.run.vm11.stdout:/dev/vdd 2026-03-09T00:29:57.946 INFO:teuthology.orchestra.run.vm11.stdout:/dev/vde 2026-03-09T00:29:57.946 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T00:29:57.946 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T00:29:57.946 DEBUG:teuthology.orchestra.run.vm11:> stat /dev/vdb 2026-03-09T00:29:58.063 INFO:teuthology.orchestra.run.vm11.stdout: File: /dev/vdb 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout:Device: 6h/6d Inode: 221 Links: 1 Device type: fc,10 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout:Access: 2026-03-09 00:29:39.727762531 +0000 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout:Modify: 2026-03-09 00:26:22.736074288 +0000 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout:Change: 2026-03-09 00:26:22.736074288 +0000 2026-03-09T00:29:58.064 INFO:teuthology.orchestra.run.vm11.stdout: Birth: 2026-03-09 00:24:01.245000000 +0000 2026-03-09T00:29:58.064 DEBUG:teuthology.orchestra.run.vm11:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:57 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:57.981+0000 7f2145d24140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:57 vm11 ceph-mon[53379]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:57 vm11 ceph-mon[53379]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm09=y;vm11=x", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: Saving service mgr spec with placement vm09=y;vm11=x;count:2 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:29:58.191 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: Deploying daemon mgr.x on vm11 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.192 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:58.199 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records in 2026-03-09T00:29:58.199 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records out 2026-03-09T00:29:58.199 INFO:teuthology.orchestra.run.vm11.stderr:512 bytes copied, 0.000196247 s, 2.6 MB/s 2026-03-09T00:29:58.200 DEBUG:teuthology.orchestra.run.vm11:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T00:29:58.254 DEBUG:teuthology.orchestra.run.vm11:> stat /dev/vdc 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout: File: /dev/vdc 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout:Device: 6h/6d Inode: 222 Links: 1 Device type: fc,20 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout:Access: 2026-03-09 00:29:39.781762543 +0000 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout:Modify: 2026-03-09 00:26:22.746074299 +0000 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout:Change: 2026-03-09 00:26:22.746074299 +0000 2026-03-09T00:29:58.292 INFO:teuthology.orchestra.run.vm11.stdout: Birth: 2026-03-09 00:24:01.249000000 +0000 2026-03-09T00:29:58.292 DEBUG:teuthology.orchestra.run.vm11:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T00:29:58.367 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records in 2026-03-09T00:29:58.367 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records out 2026-03-09T00:29:58.367 INFO:teuthology.orchestra.run.vm11.stderr:512 bytes copied, 0.000190817 s, 2.7 MB/s 2026-03-09T00:29:58.368 DEBUG:teuthology.orchestra.run.vm11:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm09=y;vm11=x", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: Saving service mgr spec with placement vm09=y;vm11=x;count:2 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: Deploying daemon mgr.x on vm11 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:58.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm09=y;vm11=x", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: Saving service mgr spec with placement vm09=y;vm11=x;count:2 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: Deploying daemon mgr.x on vm11 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:58.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:57 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:58.484 DEBUG:teuthology.orchestra.run.vm11:> stat /dev/vdd 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout: File: /dev/vdd 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout:Device: 6h/6d Inode: 223 Links: 1 Device type: fc,30 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout:Access: 2026-03-09 00:29:39.837762563 +0000 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout:Modify: 2026-03-09 00:26:22.739074291 +0000 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout:Change: 2026-03-09 00:26:22.739074291 +0000 2026-03-09T00:29:58.552 INFO:teuthology.orchestra.run.vm11.stdout: Birth: 2026-03-09 00:24:01.254000000 +0000 2026-03-09T00:29:58.553 DEBUG:teuthology.orchestra.run.vm11:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T00:29:58.582 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records in 2026-03-09T00:29:58.582 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records out 2026-03-09T00:29:58.582 INFO:teuthology.orchestra.run.vm11.stderr:512 bytes copied, 0.000158937 s, 3.2 MB/s 2026-03-09T00:29:58.583 DEBUG:teuthology.orchestra.run.vm11:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T00:29:58.653 DEBUG:teuthology.orchestra.run.vm11:> stat /dev/vde 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout: File: /dev/vde 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout:Device: 6h/6d Inode: 231 Links: 1 Device type: fc,40 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout:Access: 2026-03-09 00:29:39.868762574 +0000 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout:Modify: 2026-03-09 00:26:22.747074300 +0000 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout:Change: 2026-03-09 00:26:22.747074300 +0000 2026-03-09T00:29:58.715 INFO:teuthology.orchestra.run.vm11.stdout: Birth: 2026-03-09 00:24:01.263000000 +0000 2026-03-09T00:29:58.715 DEBUG:teuthology.orchestra.run.vm11:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T00:29:58.779 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records in 2026-03-09T00:29:58.779 INFO:teuthology.orchestra.run.vm11.stderr:1+0 records out 2026-03-09T00:29:58.779 INFO:teuthology.orchestra.run.vm11.stderr:512 bytes copied, 0.000130054 s, 3.9 MB/s 2026-03-09T00:29:58.780 DEBUG:teuthology.orchestra.run.vm11:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T00:29:58.851 INFO:tasks.cephadm:Deploying osd.0 on vm09 with /dev/vde... 2026-03-09T00:29:58.851 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vde 2026-03-09T00:29:58.903 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:58 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:58.536+0000 7f2145d24140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:29:59.077 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:58 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:58.904+0000 7f2145d24140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:58 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:58 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:58 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: from numpy import show_config as show_numpy_config 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:58 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:58.997+0000 7f2145d24140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.041+0000 7f2145d24140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:29:59.200 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.122+0000 7f2145d24140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: Reconfiguring mgr.y (unknown last config time)... 2026-03-09T00:29:59.776 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: Reconfiguring daemon mgr.y on vm09 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: Reconfiguring mgr.y (unknown last config time)... 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: Reconfiguring daemon mgr.y on vm09 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:59.777 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:29:59 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: Reconfiguring mgr.y (unknown last config time)... 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: Reconfiguring daemon mgr.y on vm09 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:29:59.794 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:29:59.795 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:29:59.795 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:29:59 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:29:59.795 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.664+0000 7f2145d24140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:29:59.864 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:29:59.882 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm09:/dev/vde 2026-03-09T00:30:00.064 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:00.131 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.795+0000 7f2145d24140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:00.131 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.837+0000 7f2145d24140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:30:00.131 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.874+0000 7f2145d24140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:00.131 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.917+0000 7f2145d24140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:30:00.131 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:29:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:29:59.955+0000 7f2145d24140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.191+0000 7ff669575640 1 -- 192.168.123.109:0/3832190037 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 msgr2=0x7ff66410cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.191+0000 7ff669575640 1 --2- 192.168.123.109:0/3832190037 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff66410cfd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff65800b0a0 tx=0x7ff65802f450 comp rx=0 tx=0).stop 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 -- 192.168.123.109:0/3832190037 shutdown_connections 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 --2- 192.168.123.109:0/3832190037 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff66410cfd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 --2- 192.168.123.109:0/3832190037 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ff664105d80 0x7ff664106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 --2- 192.168.123.109:0/3832190037 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7ff664104b80 0x7ff664104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 -- 192.168.123.109:0/3832190037 >> 192.168.123.109:0/3832190037 conn(0x7ff664100330 msgr2=0x7ff664102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 -- 192.168.123.109:0/3832190037 shutdown_connections 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 -- 192.168.123.109:0/3832190037 wait complete. 2026-03-09T00:30:00.191 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 Processor -- start 2026-03-09T00:30:00.192 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.192+0000 7ff669575640 1 -- start start 2026-03-09T00:30:00.192 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff669575640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ff664104b80 0x7ff66419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff669575640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7ff664105d80 0x7ff66419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff669575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff6641a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff669575640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff66410fd00 con 0x7ff664106740 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff669575640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff66410fb80 con 0x7ff664104b80 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff669575640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7ff66410fe80 con 0x7ff664105d80 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff6641a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff6641a3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:51342/0 (socket says 192.168.123.109:51342) 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 -- 192.168.123.109:0/3382584660 learned_addr learned my addr 192.168.123.109:0/3382584660 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff6637fe640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7ff664105d80 0x7ff66419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff663fff640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ff664104b80 0x7ff66419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 -- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7ff664105d80 msgr2=0x7ff66419c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7ff664105d80 0x7ff66419c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 -- 192.168.123.109:0/3382584660 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ff664104b80 msgr2=0x7ff66419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ff664104b80 0x7ff66419c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 -- 192.168.123.109:0/3382584660 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641a4020 con 0x7ff664106740 2026-03-09T00:30:00.193 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff668d74640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff6641a3920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c090 tx=0x7ff6580046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:00.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6580040d0 con 0x7ff664106740 2026-03-09T00:30:00.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7ff658007a30 con 0x7ff664106740 2026-03-09T00:30:00.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.193+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658038900 con 0x7ff664106740 2026-03-09T00:30:00.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.194+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6641a42b0 con 0x7ff664106740 2026-03-09T00:30:00.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.194+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a4820 con 0x7ff664106740 2026-03-09T00:30:00.194 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.194+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff628005180 con 0x7ff664106740 2026-03-09T00:30:00.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.198+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 13) ==== 50271+0+0 (secure 0 0 0) 0x7ff658041030 con 0x7ff664106740 2026-03-09T00:30:00.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.198+0000 7ff6617fa640 1 --2- 192.168.123.109:0/3382584660 >> v2:192.168.123.109:6800/82853931 conn(0x7ff64403de30 0x7ff6440402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:00.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.198+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7ff658076b50 con 0x7ff664106740 2026-03-09T00:30:00.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.198+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff65804c460 con 0x7ff664106740 2026-03-09T00:30:00.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.198+0000 7ff663fff640 1 --2- 192.168.123.109:0/3382584660 >> v2:192.168.123.109:6800/82853931 conn(0x7ff64403de30 0x7ff6440402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:00.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.198+0000 7ff663fff640 1 --2- 192.168.123.109:0/3382584660 >> v2:192.168.123.109:6800/82853931 conn(0x7ff64403de30 0x7ff6440402f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff664105be0 tx=0x7ff650008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:00.300 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:00.301+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vde", "target": ["mon-mgr", ""]}) -- 0x7ff628002bf0 con 0x7ff64403de30 2026-03-09T00:30:00.419 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.132+0000 7f2145d24140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:30:00.419 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.184+0000 7f2145d24140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:00.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:00 vm11 ceph-mon[53379]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:00.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:00 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:00.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:00 vm11 ceph-mon[53379]: overall HEALTH_OK 2026-03-09T00:30:00.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:00 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:00.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:00 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:00.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:00 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:00.700 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.420+0000 7f2145d24140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[56118]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[56118]: overall HEALTH_OK 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[49458]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[49458]: overall HEALTH_OK 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:00.886 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:00 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:00.991 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.707+0000 7f2145d24140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:30:00.992 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.744+0000 7f2145d24140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:30:00.992 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.790+0000 7f2145d24140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:30:00.992 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.874+0000 7f2145d24140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:30:00.992 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.912+0000 7f2145d24140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:30:01.251 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:00 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:00.992+0000 7f2145d24140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:30:01.251 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:01 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:01.110+0000 7f2145d24140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:01.559 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:01 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:01.252+0000 7f2145d24140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:30:01.559 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:30:01 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:30:01.291+0000 7f2145d24140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2111843220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]': finished 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: Standby manager daemon x started 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2631887598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2111843220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]': finished 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: Standby manager daemon x started 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T00:30:01.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:01 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2631887598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2111843220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]: dispatch 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]: dispatch 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "358ee389-cb78-4018-b8af-afdaff60ba71"}]': finished 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:01.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: Standby manager daemon x started 2026-03-09T00:30:01.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T00:30:01.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T00:30:01.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T00:30:01.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/897890673' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T00:30:01.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:01 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2631887598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:02.081 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:02.081+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mgrmap(e 14) ==== 99944+0+0 (secure 0 0 0) 0x7ff65804a360 con 0x7ff664106740 2026-03-09T00:30:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:02 vm09 ceph-mon[56118]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:02 vm09 ceph-mon[56118]: mgrmap e14: y(active, since 31s), standbys: x 2026-03-09T00:30:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:02 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T00:30:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:02 vm09 ceph-mon[49458]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:02 vm09 ceph-mon[49458]: mgrmap e14: y(active, since 31s), standbys: x 2026-03-09T00:30:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:02 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T00:30:03.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:02 vm11 ceph-mon[53379]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:03.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:02 vm11 ceph-mon[53379]: mgrmap e14: y(active, since 31s), standbys: x 2026-03-09T00:30:03.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:02 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T00:30:03.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:03 vm09 ceph-mon[56118]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:03.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:03 vm09 ceph-mon[49458]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:03.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:03 vm11 ceph-mon[53379]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:06.287 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:06 vm09 ceph-mon[49458]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:06.287 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:06 vm09 ceph-mon[56118]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:06.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:06 vm11 ceph-mon[53379]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:07.518 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:07 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T00:30:07.518 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:07 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:07.518 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:07 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T00:30:07.518 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:07 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:07.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:07 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T00:30:07.951 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:07 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:08.605 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:08 vm09 ceph-mon[56118]: Deploying daemon osd.0 on vm09 2026-03-09T00:30:08.605 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:08 vm09 ceph-mon[56118]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:08.605 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:08 vm09 ceph-mon[49458]: Deploying daemon osd.0 on vm09 2026-03-09T00:30:08.605 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:08 vm09 ceph-mon[49458]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:08.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:08 vm11 ceph-mon[53379]: Deploying daemon osd.0 on vm09 2026-03-09T00:30:08.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:08 vm11 ceph-mon[53379]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[56118]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:10.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[49458]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:10.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:10.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:10.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:10 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:10.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:10 vm11 ceph-mon[53379]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:10.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:10 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:10.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:10 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:10.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:10 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stdout:Created osd(s) 0 on host 'vm09' 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.199+0000 7ff6617fa640 1 -- 192.168.123.109:0/3382584660 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7ff628002bf0 con 0x7ff64403de30 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 >> v2:192.168.123.109:6800/82853931 conn(0x7ff64403de30 msgr2=0x7ff6440402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 --2- 192.168.123.109:0/3382584660 >> v2:192.168.123.109:6800/82853931 conn(0x7ff64403de30 0x7ff6440402f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff664105be0 tx=0x7ff650008040 comp rx=0 tx=0).stop 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 msgr2=0x7ff6641a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff6641a3920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c090 tx=0x7ff6580046e0 comp rx=0 tx=0).stop 2026-03-09T00:30:11.201 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 shutdown_connections 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 --2- 192.168.123.109:0/3382584660 >> v2:192.168.123.109:6800/82853931 conn(0x7ff64403de30 0x7ff6440402f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7ff664106740 0x7ff6641a3920 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7ff664105d80 0x7ff66419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 --2- 192.168.123.109:0/3382584660 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7ff664104b80 0x7ff66419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 >> 192.168.123.109:0/3382584660 conn(0x7ff664100330 msgr2=0x7ff664101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 shutdown_connections 2026-03-09T00:30:11.202 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:11.202+0000 7ff669575640 1 -- 192.168.123.109:0/3382584660 wait complete. 2026-03-09T00:30:11.268 DEBUG:teuthology.orchestra.run.vm09:osd.0> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.0.service 2026-03-09T00:30:11.270 INFO:tasks.cephadm:Deploying osd.1 on vm09 with /dev/vdd... 2026-03-09T00:30:11.270 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vdd 2026-03-09T00:30:11.572 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.020 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.021 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:11 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:11 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.365 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-0[60022]: 2026-03-09T00:30:12.020+0000 7f681cc5d740 -1 osd.0 0 log_to_monitors true 2026-03-09T00:30:12.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='osd.0 v2:192.168.123.109:6801/3241136735' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: Detected new or changed devices on vm09 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='osd.0 v2:192.168.123.109:6801/3241136735' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: Detected new or changed devices on vm09 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:12.932 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:13.131 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:30:13.150 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm09:/dev/vdd 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='osd.0 v2:192.168.123.109:6801/3241136735' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: Detected new or changed devices on vm09 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:13.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:13.328 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:13.462 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.462+0000 7fe7cdd10640 1 -- 192.168.123.109:0/2873586745 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 msgr2=0x7fe7c810ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.462+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/2873586745 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c810ce60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00b0a0 tx=0x7fe7bc02f450 comp rx=0 tx=0).stop 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 -- 192.168.123.109:0/2873586745 shutdown_connections 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/2873586745 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c810ce60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/2873586745 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7c8075a40 0x7fe7c8075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/2873586745 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7c80770a0 0x7fe7c8075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 -- 192.168.123.109:0/2873586745 >> 192.168.123.109:0/2873586745 conn(0x7fe7c80fe260 msgr2=0x7fe7c8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 -- 192.168.123.109:0/2873586745 shutdown_connections 2026-03-09T00:30:13.463 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.464+0000 7fe7cdd10640 1 -- 192.168.123.109:0/2873586745 wait complete. 2026-03-09T00:30:13.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 Processor -- start 2026-03-09T00:30:13.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 -- start start 2026-03-09T00:30:13.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7c8075a40 0x7fe7c8105de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:13.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7c80770a0 0x7fe7c8106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:13.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c8102840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:13.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c810fe30 con 0x7fe7c810a9a0 2026-03-09T00:30:13.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c810fcb0 con 0x7fe7c80770a0 2026-03-09T00:30:13.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7cdd10640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c810ffb0 con 0x7fe7c8075a40 2026-03-09T00:30:13.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c8102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:13.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c8102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:46556/0 (socket says 192.168.123.109:46556) 2026-03-09T00:30:13.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 -- 192.168.123.109:0/95103080 learned_addr learned my addr 192.168.123.109:0/95103080 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:30:13.465 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 -- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7c8075a40 msgr2=0x7fe7c8105de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:13.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7c8075a40 0x7fe7c8105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:13.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 -- 192.168.123.109:0/95103080 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7c80770a0 msgr2=0x7fe7c8106320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-03-09T00:30:13.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7c80770a0 0x7fe7c8106320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:13.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.465+0000 7fe7c7fff640 1 -- 192.168.123.109:0/95103080 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c8103100 con 0x7fe7c810a9a0 2026-03-09T00:30:13.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.466+0000 7fe7c7fff640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c8102840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0046e0 tx=0x7fe7bc004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:13.466 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.466+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc0075c0 con 0x7fe7c810a9a0 2026-03-09T00:30:13.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.466+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c8103390 con 0x7fe7c810a9a0 2026-03-09T00:30:13.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.466+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c81a8e50 con 0x7fe7c810a9a0 2026-03-09T00:30:13.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.466+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fe7bc007bd0 con 0x7fe7c810a9a0 2026-03-09T00:30:13.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.466+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc038990 con 0x7fe7c810a9a0 2026-03-09T00:30:13.467 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.468+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 14) ==== 99944+0+0 (secure 0 0 0) 0x7fe7bc007760 con 0x7fe7c810a9a0 2026-03-09T00:30:13.468 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.469+0000 7fe7c4ff9640 1 --2- 192.168.123.109:0/95103080 >> v2:192.168.123.109:6800/82853931 conn(0x7fe798077610 0x7fe798079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:13.468 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.469+0000 7fe7c77fe640 1 --2- 192.168.123.109:0/95103080 >> v2:192.168.123.109:6800/82853931 conn(0x7fe798077610 0x7fe798079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:13.468 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.469+0000 7fe7c77fe640 1 --2- 192.168.123.109:0/95103080 >> v2:192.168.123.109:6800/82853931 conn(0x7fe798077610 0x7fe798079ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac005e00 tx=0x7fe7ac005d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:13.468 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.469+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1275+0+0 (secure 0 0 0) 0x7fe7bc0bd290 con 0x7fe7c810a9a0 2026-03-09T00:30:13.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.470+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78c005180 con 0x7fe7c810a9a0 2026-03-09T00:30:13.473 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.474+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe7bc03d070 con 0x7fe7c810a9a0 2026-03-09T00:30:13.573 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:13.573+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdd", "target": ["mon-mgr", ""]}) -- 0x7fe78c002bf0 con 0x7fe798077610 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='osd.0 v2:192.168.123.109:6801/3241136735' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='client.14235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[49458]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='osd.0 v2:192.168.123.109:6801/3241136735' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='client.14235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:14.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:13 vm09 ceph-mon[56118]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:14.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='osd.0 v2:192.168.123.109:6801/3241136735' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='client.14235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:14.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/765676747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]': finished 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: osdmap e8: 2 total, 0 up, 2 in 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/765676747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]': finished 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: osdmap e8: 2 total, 0 up, 2 in 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:14.994 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:14 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/765676747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]: dispatch 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]: dispatch 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "504373ca-3989-4555-acb0-64b55de70bd7"}]': finished 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: osdmap e8: 2 total, 0 up, 2 in 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:15.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:14 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:15.430 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:15 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-0[60022]: 2026-03-09T00:30:15.054+0000 7f68193f1640 -1 osd.0 0 waiting for initial osdmap 2026-03-09T00:30:15.430 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:15 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-0[60022]: 2026-03-09T00:30:15.072+0000 7f6814207640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[56118]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[56118]: from='osd.0 ' entity='osd.0' 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/805043690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[49458]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[49458]: from='osd.0 ' entity='osd.0' 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/805043690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:16.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:15 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:30:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:15 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:30:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:15 vm11 ceph-mon[53379]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:15 vm11 ceph-mon[53379]: from='osd.0 ' entity='osd.0' 2026-03-09T00:30:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:15 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/805043690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[56118]: osd.0 v2:192.168.123.109:6801/3241136735 boot 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[56118]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[49458]: osd.0 v2:192.168.123.109:6801/3241136735 boot 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[49458]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:17.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:17 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:17.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:17 vm11 ceph-mon[53379]: osd.0 v2:192.168.123.109:6801/3241136735 boot 2026-03-09T00:30:17.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:17 vm11 ceph-mon[53379]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T00:30:17.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:17 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:17.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:17 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:18.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:18 vm09 ceph-mon[56118]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:18.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:18 vm09 ceph-mon[56118]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T00:30:18.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:18 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:18.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:18 vm09 ceph-mon[49458]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:18.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:18 vm09 ceph-mon[49458]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T00:30:18.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:18 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:18.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:18 vm11 ceph-mon[53379]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:18.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:18 vm11 ceph-mon[53379]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T00:30:18.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:18 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:19.086 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:19 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T00:30:19.086 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:19 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:19.086 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:19 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T00:30:19.086 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:19 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:19.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:19 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T00:30:19.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:19 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:20 vm09 ceph-mon[49458]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:20 vm09 ceph-mon[49458]: Deploying daemon osd.1 on vm09 2026-03-09T00:30:20.431 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:20 vm09 ceph-mon[56118]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:20.431 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:20 vm09 ceph-mon[56118]: Deploying daemon osd.1 on vm09 2026-03-09T00:30:20.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:20 vm11 ceph-mon[53379]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:20.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:20 vm11 ceph-mon[53379]: Deploying daemon osd.1 on vm09 2026-03-09T00:30:22.277 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:22.278 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.373 INFO:teuthology.orchestra.run.vm09.stdout:Created osd(s) 1 on host 'vm09' 2026-03-09T00:30:22.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.372+0000 7fe7c4ff9640 1 -- 192.168.123.109:0/95103080 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fe78c002bf0 con 0x7fe798077610 2026-03-09T00:30:22.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.376+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 >> v2:192.168.123.109:6800/82853931 conn(0x7fe798077610 msgr2=0x7fe798079ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:22.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.376+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/95103080 >> v2:192.168.123.109:6800/82853931 conn(0x7fe798077610 0x7fe798079ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac005e00 tx=0x7fe7ac005d70 comp rx=0 tx=0).stop 2026-03-09T00:30:22.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.376+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 msgr2=0x7fe7c8102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:22.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.376+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c8102840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0046e0 tx=0x7fe7bc004710 comp rx=0 tx=0).stop 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.377+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 shutdown_connections 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.377+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/95103080 >> v2:192.168.123.109:6800/82853931 conn(0x7fe798077610 0x7fe798079ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.377+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7c810a9a0 0x7fe7c8102840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.377+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7c80770a0 0x7fe7c8106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.377+0000 7fe7cdd10640 1 --2- 192.168.123.109:0/95103080 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7c8075a40 0x7fe7c8105de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.377+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 >> 192.168.123.109:0/95103080 conn(0x7fe7c80fe260 msgr2=0x7fe7c8100650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:22.377 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.378+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 shutdown_connections 2026-03-09T00:30:22.379 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:22.379+0000 7fe7cdd10640 1 -- 192.168.123.109:0/95103080 wait complete. 2026-03-09T00:30:22.436 DEBUG:teuthology.orchestra.run.vm09:osd.1> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.1.service 2026-03-09T00:30:22.437 INFO:tasks.cephadm:Deploying osd.2 on vm09 with /dev/vdc... 2026-03-09T00:30:22.437 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vdc 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:22.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:22.749 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:22.930 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:22 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-1[64893]: 2026-03-09T00:30:22.876+0000 7f4b0eb38740 -1 osd.1 0 log_to_monitors true 2026-03-09T00:30:23.344 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:23.344 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:23.344 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:23.344 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[56118]: from='osd.1 v2:192.168.123.109:6805/64355271' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:23.344 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[56118]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:23.346 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:23.346 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:23.346 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:23.346 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[49458]: from='osd.1 v2:192.168.123.109:6805/64355271' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:23.346 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:23 vm09 ceph-mon[49458]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:23.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:23.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:23.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:23.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:23 vm11 ceph-mon[53379]: from='osd.1 v2:192.168.123.109:6805/64355271' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:23.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:23 vm11 ceph-mon[53379]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:24.157 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:30:24.181 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm09:/dev/vdc 2026-03-09T00:30:24.355 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:24.756 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:24.756 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='osd.1 v2:192.168.123.109:6805/64355271' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: Detected new or changed devices on vm09 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='osd.1 v2:192.168.123.109:6805/64355271' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: Detected new or changed devices on vm09 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:24.757 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.757 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:24 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-1[64893]: 2026-03-09T00:30:24.657+0000 7f4b0aab9640 -1 osd.1 0 waiting for initial osdmap 2026-03-09T00:30:24.757 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:24 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-1[64893]: 2026-03-09T00:30:24.667+0000 7f4b068e3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.755+0000 7fd968e14640 1 -- 192.168.123.109:0/1138750308 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964106910 msgr2=0x7fd96410d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.755+0000 7fd968e14640 1 --2- 192.168.123.109:0/1138750308 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964106910 0x7fd96410d1a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd95400b0a0 tx=0x7fd95402f410 comp rx=0 tx=0).stop 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.757+0000 7fd968e14640 1 -- 192.168.123.109:0/1138750308 shutdown_connections 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.757+0000 7fd968e14640 1 --2- 192.168.123.109:0/1138750308 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964106910 0x7fd96410d1a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.757+0000 7fd968e14640 1 --2- 192.168.123.109:0/1138750308 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964105f50 0x7fd9641063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.757+0000 7fd968e14640 1 --2- 192.168.123.109:0/1138750308 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd964104d50 0x7fd964105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.758+0000 7fd968e14640 1 -- 192.168.123.109:0/1138750308 >> 192.168.123.109:0/1138750308 conn(0x7fd9641004e0 msgr2=0x7fd964102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.758+0000 7fd968e14640 1 -- 192.168.123.109:0/1138750308 shutdown_connections 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.758+0000 7fd968e14640 1 -- 192.168.123.109:0/1138750308 wait complete. 2026-03-09T00:30:24.757 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.758+0000 7fd968e14640 1 Processor -- start 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.758+0000 7fd968e14640 1 -- start start 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd968e14640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd964104d50 0x7fd96419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd968e14640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964105f50 0x7fd96419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd968e14640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 0x7fd9641a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd968e14640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fd96410fdf0 con 0x7fd964106910 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd968e14640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd96410fc70 con 0x7fd964104d50 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd968e14640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fd96410ff70 con 0x7fd964105f50 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 0x7fd9641a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 0x7fd9641a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:47364/0 (socket says 192.168.123.109:47364) 2026-03-09T00:30:24.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 -- 192.168.123.109:0/3799849344 learned_addr learned my addr 192.168.123.109:0/3799849344 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 -- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964105f50 msgr2=0x7fd96419c9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964105f50 0x7fd96419c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 -- 192.168.123.109:0/3799849344 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd964104d50 msgr2=0x7fd96419c490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd964104d50 0x7fd96419c490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.759+0000 7fd962d76640 1 -- 192.168.123.109:0/3799849344 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9641a40c0 con 0x7fd964106910 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.760+0000 7fd962d76640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 0x7fd9641a3a50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd954006130 tx=0x7fd9540047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.760+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954047070 con 0x7fd964106910 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.760+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fd954002c60 con 0x7fd964106910 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.760+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954042760 con 0x7fd964106910 2026-03-09T00:30:24.759 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.760+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9641a4350 con 0x7fd964106910 2026-03-09T00:30:24.760 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.760+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd964077700 con 0x7fd964106910 2026-03-09T00:30:24.760 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.761+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 14) ==== 99944+0+0 (secure 0 0 0) 0x7fd954007660 con 0x7fd964106910 2026-03-09T00:30:24.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.762+0000 7fd94b7fe640 1 --2- 192.168.123.109:0/3799849344 >> v2:192.168.123.109:6800/82853931 conn(0x7fd93c077640 0x7fd93c079b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:24.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.762+0000 7fd962575640 1 --2- 192.168.123.109:0/3799849344 >> v2:192.168.123.109:6800/82853931 conn(0x7fd93c077640 0x7fd93c079b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:24.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.762+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1683+0+0 (secure 0 0 0) 0x7fd9540bd410 con 0x7fd964106910 2026-03-09T00:30:24.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.762+0000 7fd962575640 1 --2- 192.168.123.109:0/3799849344 >> v2:192.168.123.109:6800/82853931 conn(0x7fd93c077640 0x7fd93c079b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd958005fd0 tx=0x7fd958005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:24.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.762+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd928005180 con 0x7fd964106910 2026-03-09T00:30:24.765 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.765+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd95403d070 con 0x7fd964106910 2026-03-09T00:30:24.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:24.862+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdc", "target": ["mon-mgr", ""]}) -- 0x7fd928002bf0 con 0x7fd93c077640 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='osd.1 v2:192.168.123.109:6805/64355271' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: Detected new or changed devices on vm09 2026-03-09T00:30:24.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:24.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:24.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:24.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:24.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: osdmap e12: 2 total, 1 up, 2 in 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1735470744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]': finished 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: osd.1 v2:192.168.123.109:6805/64355271 boot 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: osdmap e12: 2 total, 1 up, 2 in 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:25.695 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1735470744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]: dispatch 2026-03-09T00:30:25.696 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]: dispatch 2026-03-09T00:30:25.696 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]': finished 2026-03-09T00:30:25.696 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: osd.1 v2:192.168.123.109:6805/64355271 boot 2026-03-09T00:30:25.696 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T00:30:25.696 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:25.696 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: osdmap e12: 2 total, 1 up, 2 in 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1735470744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1e4aed4-61e3-4b5c-90eb-fd9480495a28"}]': finished 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: osd.1 v2:192.168.123.109:6805/64355271 boot 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:25.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:26.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:26 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:30:26.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:26 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:30:26.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:26 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/3924686722' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:26.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:26 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:30:26.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:26 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:30:26.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:26 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3924686722' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:26.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:26 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:30:26.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:26 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:30:26.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:26 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/3924686722' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:27.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:27 vm11 ceph-mon[53379]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T00:30:27.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:27 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:27.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:27 vm11 ceph-mon[53379]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:28.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:27 vm09 ceph-mon[56118]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T00:30:28.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:27 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:28.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:27 vm09 ceph-mon[56118]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:28.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:27 vm09 ceph-mon[49458]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T00:30:28.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:27 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:28.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:27 vm09 ceph-mon[49458]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:30.015 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[49458]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[49458]: Deploying daemon osd.2 on vm09 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[56118]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:30.016 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:29 vm09 ceph-mon[56118]: Deploying daemon osd.2 on vm09 2026-03-09T00:30:30.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:29 vm11 ceph-mon[53379]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:30.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T00:30:30.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:30.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:29 vm11 ceph-mon[53379]: Deploying daemon osd.2 on vm09 2026-03-09T00:30:31.827 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[49458]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:31.828 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:31.828 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:31.828 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:32.103 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[56118]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:32.103 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:32.103 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:32.103 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:31 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:32.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:31 vm11 ceph-mon[53379]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:32.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:31 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:32.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:31 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:32.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:31 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stdout:Created osd(s) 2 on host 'vm09' 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.898+0000 7fd94b7fe640 1 -- 192.168.123.109:0/3799849344 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fd928002bf0 con 0x7fd93c077640 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 >> v2:192.168.123.109:6800/82853931 conn(0x7fd93c077640 msgr2=0x7fd93c079b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 --2- 192.168.123.109:0/3799849344 >> v2:192.168.123.109:6800/82853931 conn(0x7fd93c077640 0x7fd93c079b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd958005fd0 tx=0x7fd958005950 comp rx=0 tx=0).stop 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 msgr2=0x7fd9641a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 0x7fd9641a3a50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd954006130 tx=0x7fd9540047a0 comp rx=0 tx=0).stop 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 shutdown_connections 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 --2- 192.168.123.109:0/3799849344 >> v2:192.168.123.109:6800/82853931 conn(0x7fd93c077640 0x7fd93c079b00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd964106910 0x7fd9641a3a50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd964105f50 0x7fd96419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 --2- 192.168.123.109:0/3799849344 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd964104d50 0x7fd96419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 >> 192.168.123.109:0/3799849344 conn(0x7fd9641004e0 msgr2=0x7fd964101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 shutdown_connections 2026-03-09T00:30:32.900 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:32.900+0000 7fd968e14640 1 -- 192.168.123.109:0/3799849344 wait complete. 2026-03-09T00:30:32.954 DEBUG:teuthology.orchestra.run.vm09:osd.2> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.2.service 2026-03-09T00:30:32.957 INFO:tasks.cephadm:Deploying osd.3 on vm09 with /dev/vdb... 2026-03-09T00:30:32.957 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vdb 2026-03-09T00:30:33.241 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:33 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.852 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:33 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-2[69905]: 2026-03-09T00:30:33.613+0000 7f851ba0d740 -1 osd.2 0 log_to_monitors true 2026-03-09T00:30:33.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:33 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:33 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:33 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:33.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:33 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.676 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:30:34.701 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm09:/dev/vdb 2026-03-09T00:30:34.872 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:30:34.894 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='osd.2 v2:192.168.123.109:6809/1100722638' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='osd.2 v2:192.168.123.109:6809/1100722638' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:34.895 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='osd.2 v2:192.168.123.109:6809/1100722638' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:34.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.994+0000 7f7b10833640 1 -- 192.168.123.109:0/3987204210 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c106740 msgr2=0x7f7b0c10cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.994+0000 7f7b10833640 1 --2- 192.168.123.109:0/3987204210 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c106740 0x7f7b0c10cfd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000b3e0 tx=0x7f7b0002f690 comp rx=0 tx=0).stop 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.995+0000 7f7b10833640 1 -- 192.168.123.109:0/3987204210 shutdown_connections 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.995+0000 7f7b10833640 1 --2- 192.168.123.109:0/3987204210 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c106740 0x7f7b0c10cfd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.995+0000 7f7b10833640 1 --2- 192.168.123.109:0/3987204210 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c105d80 0x7f7b0c106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.995+0000 7f7b10833640 1 --2- 192.168.123.109:0/3987204210 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c104b80 0x7f7b0c104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.995+0000 7f7b10833640 1 -- 192.168.123.109:0/3987204210 >> 192.168.123.109:0/3987204210 conn(0x7f7b0c100330 msgr2=0x7f7b0c102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.996+0000 7f7b10833640 1 -- 192.168.123.109:0/3987204210 shutdown_connections 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.996+0000 7f7b10833640 1 -- 192.168.123.109:0/3987204210 wait complete. 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.996+0000 7f7b10833640 1 Processor -- start 2026-03-09T00:30:34.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.996+0000 7f7b10833640 1 -- start start 2026-03-09T00:30:34.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.996+0000 7f7b10833640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 0x7f7b0c19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:34.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b10833640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c105d80 0x7f7b0c19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:34.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b10833640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c106740 0x7f7b0c1a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b10833640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c10fc40 con 0x7f7b0c104b80 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b10833640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c10fac0 con 0x7f7b0c106740 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b10833640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c10fdc0 con 0x7f7b0c105d80 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 0x7f7b0c19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 0x7f7b0c19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:44492/0 (socket says 192.168.123.109:44492) 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 -- 192.168.123.109:0/935432772 learned_addr learned my addr 192.168.123.109:0/935432772 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 -- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c105d80 msgr2=0x7f7b0c19c7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0bfff640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c106740 0x7f7b0c1a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0affd640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c105d80 0x7f7b0c19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c105d80 0x7f7b0c19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 -- 192.168.123.109:0/935432772 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c106740 msgr2=0x7f7b0c1a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c106740 0x7f7b0c1a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.997+0000 7f7b0b7fe640 1 -- 192.168.123.109:0/935432772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c1a3ec0 con 0x7f7b0c104b80 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b0bfff640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c106740 0x7f7b0c1a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b0affd640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c105d80 0x7f7b0c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b0b7fe640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 0x7f7b0c19c290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009860 tx=0x7f7af0009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0007e30 con 0x7f7b0c104b80 2026-03-09T00:30:34.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f7af00026e0 con 0x7f7b0c104b80 2026-03-09T00:30:34.999 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0c077590 con 0x7f7b0c104b80 2026-03-09T00:30:34.999 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af00159d0 con 0x7f7b0c104b80 2026-03-09T00:30:34.999 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:34.998+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0c077ad0 con 0x7f7b0c104b80 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.000+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 14) ==== 99944+0+0 (secure 0 0 0) 0x7f7af001b070 con 0x7f7b0c104b80 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.000+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad0005180 con 0x7f7b0c104b80 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.001+0000 7f7b08ff9640 1 --2- 192.168.123.109:0/935432772 >> v2:192.168.123.109:6800/82853931 conn(0x7f7ae4077570 0x7f7ae4079a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.001+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 1959+0+0 (secure 0 0 0) 0x7f7af00042e0 con 0x7f7b0c104b80 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.002+0000 7f7b0affd640 1 --2- 192.168.123.109:0/935432772 >> v2:192.168.123.109:6800/82853931 conn(0x7f7ae4077570 0x7f7ae4079a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.004+0000 7f7b0affd640 1 --2- 192.168.123.109:0/935432772 >> v2:192.168.123.109:6800/82853931 conn(0x7f7ae4077570 0x7f7ae4079a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c19d7b0 tx=0x7f7af8005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:35.003 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.004+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7af006bba0 con 0x7f7b0c104b80 2026-03-09T00:30:35.104 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:35.104+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdb", "target": ["mon-mgr", ""]}) -- 0x7f7ad0002bf0 con 0x7f7ae4077570 2026-03-09T00:30:35.930 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:35 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-2[69905]: 2026-03-09T00:30:35.589+0000 7f851798e640 -1 osd.2 0 waiting for initial osdmap 2026-03-09T00:30:35.930 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:35 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-2[69905]: 2026-03-09T00:30:35.600+0000 7f85137b8640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: Detected new or changed devices on vm09 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='osd.2 v2:192.168.123.109:6809/1100722638' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[56118]: osdmap e16: 3 total, 2 up, 3 in 2026-03-09T00:30:35.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: Detected new or changed devices on vm09 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='osd.2 v2:192.168.123.109:6809/1100722638' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:35.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:35 vm09 ceph-mon[49458]: osdmap e16: 3 total, 2 up, 3 in 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: Detected new or changed devices on vm09 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='osd.2 v2:192.168.123.109:6809/1100722638' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:35.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:35 vm11 ceph-mon[53379]: osdmap e16: 3 total, 2 up, 3 in 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2121711240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f49ec9f2-9291-4311-ba8a-82828daa1996"}]: dispatch 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2121711240' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f49ec9f2-9291-4311-ba8a-82828daa1996"}]': finished 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: osd.2 v2:192.168.123.109:6809/1100722638 boot 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: osdmap e17: 4 total, 3 up, 4 in 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/740355044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:36.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2121711240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f49ec9f2-9291-4311-ba8a-82828daa1996"}]: dispatch 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2121711240' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f49ec9f2-9291-4311-ba8a-82828daa1996"}]': finished 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: osd.2 v2:192.168.123.109:6809/1100722638 boot 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: osdmap e17: 4 total, 3 up, 4 in 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:36.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/740355044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm09:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2121711240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f49ec9f2-9291-4311-ba8a-82828daa1996"}]: dispatch 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2121711240' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f49ec9f2-9291-4311-ba8a-82828daa1996"}]': finished 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: osd.2 v2:192.168.123.109:6809/1100722638 boot 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: osdmap e17: 4 total, 3 up, 4 in 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:36.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/740355044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: osdmap e18: 4 total, 3 up, 4 in 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: osdmap e18: 4 total, 3 up, 4 in 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:37.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:37 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:30:37.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:30:37.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:30:37.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:30:37.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T00:30:37.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: osdmap e18: 4 total, 3 up, 4 in 2026-03-09T00:30:37.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:37.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:37 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74398]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74398]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74398]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74390]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vdc 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74390]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.2.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74390]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74199]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vdd 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.1.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74199]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74394]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74394]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:30:38.606 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74394]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:30:38.606 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74195]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vde 2026-03-09T00:30:38.607 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74195]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:30:38.607 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:30:38.607 INFO:journalctl@ceph.osd.0.vm09.stdout:Mar 09 00:30:38 vm09 sudo[74195]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:30:38.607 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 sudo[55647]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T00:30:38.607 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 sudo[55647]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:30:38.607 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 sudo[55647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:30:38.607 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 sudo[55647]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: pgmap v40: 0 pgs: ; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: osdmap e19: 4 total, 3 up, 4 in 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[56118]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: pgmap v40: 0 pgs: ; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: osdmap e19: 4 total, 3 up, 4 in 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.931 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:38 vm09 ceph-mon[49458]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: pgmap v40: 0 pgs: ; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: osdmap e19: 4 total, 3 up, 4 in 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:30:38.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:38 vm11 ceph-mon[53379]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:30:39.628 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:39.628+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f7af0066bc0 con 0x7f7b0c104b80 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[49458]: pgmap v43: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[49458]: osdmap e20: 4 total, 3 up, 4 in 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[49458]: mgrmap e15: y(active, since 68s), standbys: x 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[56118]: pgmap v43: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[56118]: osdmap e20: 4 total, 3 up, 4 in 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[56118]: mgrmap e15: y(active, since 68s), standbys: x 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-09T00:30:40.036 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:40.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:39 vm11 ceph-mon[53379]: pgmap v43: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:40.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:39 vm11 ceph-mon[53379]: osdmap e20: 4 total, 3 up, 4 in 2026-03-09T00:30:40.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:40.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:39 vm11 ceph-mon[53379]: mgrmap e15: y(active, since 68s), standbys: x 2026-03-09T00:30:40.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-09T00:30:40.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:41.169 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:40 vm09 ceph-mon[56118]: Deploying daemon osd.3 on vm09 2026-03-09T00:30:41.169 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:40 vm09 ceph-mon[49458]: Deploying daemon osd.3 on vm09 2026-03-09T00:30:41.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:40 vm11 ceph-mon[53379]: Deploying daemon osd.3 on vm09 2026-03-09T00:30:42.096 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:41 vm09 ceph-mon[56118]: pgmap v45: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:42.096 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:41 vm09 ceph-mon[49458]: pgmap v45: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:42.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:41 vm11 ceph-mon[53379]: pgmap v45: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:42.926 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:42 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:42.926 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:42 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:42.926 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:42 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:43.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:42 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:43.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:42 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:43.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:42 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:43.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:42 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:43.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:42 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:43.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:42 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:43.489 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.489+0000 7f7b08ff9640 1 -- 192.168.123.109:0/935432772 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f7ad0002bf0 con 0x7f7ae4077570 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stdout:Created osd(s) 3 on host 'vm09' 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 >> v2:192.168.123.109:6800/82853931 conn(0x7f7ae4077570 msgr2=0x7f7ae4079a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 --2- 192.168.123.109:0/935432772 >> v2:192.168.123.109:6800/82853931 conn(0x7f7ae4077570 0x7f7ae4079a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c19d7b0 tx=0x7f7af8005e90 comp rx=0 tx=0).stop 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 msgr2=0x7f7b0c19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 0x7f7b0c19c290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009860 tx=0x7f7af0009d30 comp rx=0 tx=0).stop 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 shutdown_connections 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 --2- 192.168.123.109:0/935432772 >> v2:192.168.123.109:6800/82853931 conn(0x7f7ae4077570 0x7f7ae4079a30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7b0c106740 0x7f7b0c1a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7b0c105d80 0x7f7b0c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 --2- 192.168.123.109:0/935432772 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7b0c104b80 0x7f7b0c19c290 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 >> 192.168.123.109:0/935432772 conn(0x7f7b0c100330 msgr2=0x7f7b0c101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 shutdown_connections 2026-03-09T00:30:43.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:30:43.492+0000 7f7b10833640 1 -- 192.168.123.109:0/935432772 wait complete. 2026-03-09T00:30:43.539 DEBUG:teuthology.orchestra.run.vm09:osd.3> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.3.service 2026-03-09T00:30:43.540 INFO:tasks.cephadm:Deploying osd.4 on vm11 with /dev/vde... 2026-03-09T00:30:43.540 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vde 2026-03-09T00:30:43.706 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: pgmap v46: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.172 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.173 INFO:journalctl@ceph.osd.3.vm09.stdout:Mar 09 00:30:43 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-3[75167]: 2026-03-09T00:30:43.941+0000 7fa170f5d740 -1 osd.3 0 log_to_monitors true 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: pgmap v46: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.399 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:44 vm11 ceph-mon[53379]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: pgmap v46: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[56118]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-09T00:30:44.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:44 vm09 ceph-mon[49458]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-09T00:30:44.494 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:30:44.514 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm11:/dev/vde 2026-03-09T00:30:44.677 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:30:44.803 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.804+0000 7fba73c65640 1 -- 192.168.123.111:0/1585718894 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c104d60 msgr2=0x7fba6c105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.804+0000 7fba73c65640 1 --2- 192.168.123.111:0/1585718894 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c104d60 0x7fba6c105160 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009a30 tx=0x7fba5c02f240 comp rx=0 tx=0).stop 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 -- 192.168.123.111:0/1585718894 shutdown_connections 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 --2- 192.168.123.111:0/1585718894 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c106920 0x7fba6c10d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 --2- 192.168.123.111:0/1585718894 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c105f60 0x7fba6c1063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 --2- 192.168.123.111:0/1585718894 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c104d60 0x7fba6c105160 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 -- 192.168.123.111:0/1585718894 >> 192.168.123.111:0/1585718894 conn(0x7fba6c100510 msgr2=0x7fba6c102930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 -- 192.168.123.111:0/1585718894 shutdown_connections 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.805+0000 7fba73c65640 1 -- 192.168.123.111:0/1585718894 wait complete. 2026-03-09T00:30:44.804 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 Processor -- start 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 -- start start 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 0x7fba6c074910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c105f60 0x7fba6c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c106920 0x7fba6c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c10ff30 con 0x7fba6c104d60 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c10fdb0 con 0x7fba6c106920 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba73c65640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c1100b0 con 0x7fba6c105f60 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba719da640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 0x7fba6c074910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba719da640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 0x7fba6c074910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:60544/0 (socket says 192.168.123.111:60544) 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.806+0000 7fba719da640 1 -- 192.168.123.111:0/1121812147 learned_addr learned my addr 192.168.123.111:0/1121812147 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba719da640 1 -- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c105f60 msgr2=0x7fba6c071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba711d9640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c105f60 0x7fba6c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:44.805 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba721db640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c106920 0x7fba6c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba719da640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c105f60 0x7fba6c071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba719da640 1 -- 192.168.123.111:0/1121812147 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c106920 msgr2=0x7fba6c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba719da640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c106920 0x7fba6c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba719da640 1 -- 192.168.123.111:0/1121812147 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c071ef0 con 0x7fba6c104d60 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba711d9640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c105f60 0x7fba6c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba719da640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 0x7fba6c074910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009950 tx=0x7fba5c002ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.807+0000 7fba721db640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c106920 0x7fba6c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.808+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c004280 con 0x7fba6c104d60 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.808+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fba5c004420 con 0x7fba6c104d60 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.808+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c07b5b0 con 0x7fba6c104d60 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.808+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c038d60 con 0x7fba6c104d60 2026-03-09T00:30:44.806 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.808+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c1a8fd0 con 0x7fba6c104d60 2026-03-09T00:30:44.808 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.809+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fba5c04b020 con 0x7fba6c104d60 2026-03-09T00:30:44.808 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.809+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c105160 con 0x7fba6c104d60 2026-03-09T00:30:44.808 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.810+0000 7fba62ffd640 1 --2- 192.168.123.111:0/1121812147 >> v2:192.168.123.109:6800/82853931 conn(0x7fba480776a0 0x7fba48079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:44.809 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.810+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2637+0+0 (secure 0 0 0) 0x7fba5c0bd120 con 0x7fba6c104d60 2026-03-09T00:30:44.809 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.810+0000 7fba711d9640 1 --2- 192.168.123.111:0/1121812147 >> v2:192.168.123.109:6800/82853931 conn(0x7fba480776a0 0x7fba48079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:44.809 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.811+0000 7fba711d9640 1 --2- 192.168.123.111:0/1121812147 >> v2:192.168.123.109:6800/82853931 conn(0x7fba480776a0 0x7fba48079b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba6c072890 tx=0x7fba54005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:44.811 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.813+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fba5c0870b0 con 0x7fba6c104d60 2026-03-09T00:30:44.910 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:44.911+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vde", "target": ["mon-mgr", ""]}) -- 0x7fba6c0630c0 con 0x7fba480776a0 2026-03-09T00:30:45.409 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: Detected new or changed devices on vm09 2026-03-09T00:30:45.409 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.409 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.409 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:45.409 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: osdmap e21: 4 total, 3 up, 4 in 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:45.410 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: Detected new or changed devices on vm09 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: osdmap e21: 4 total, 3 up, 4 in 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: Detected new or changed devices on vm09 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: osdmap e21: 4 total, 3 up, 4 in 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm09", "root=default"]}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:45.680 INFO:journalctl@ceph.osd.3.vm09.stdout:Mar 09 00:30:45 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-3[75167]: 2026-03-09T00:30:45.501+0000 7fa16cede640 -1 osd.3 0 waiting for initial osdmap 2026-03-09T00:30:45.680 INFO:journalctl@ceph.osd.3.vm09.stdout:Mar 09 00:30:45 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-3[75167]: 2026-03-09T00:30:45.505+0000 7fa168d08640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: pgmap v48: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: osdmap e22: 4 total, 3 up, 4 in 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/3965815136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]': finished 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: osd.3 v2:192.168.123.109:6813/3343463680 boot 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: osdmap e23: 5 total, 4 up, 5 in 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/3708726032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: pgmap v48: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: osdmap e22: 4 total, 3 up, 4 in 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/3965815136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]': finished 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: osd.3 v2:192.168.123.109:6813/3343463680 boot 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: osdmap e23: 5 total, 4 up, 5 in 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:46 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/3708726032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:46.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: pgmap v48: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:30:46.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:46.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='osd.3 v2:192.168.123.109:6813/3343463680' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm09", "root=default"]}]': finished 2026-03-09T00:30:46.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: osdmap e22: 4 total, 3 up, 4 in 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/3965815136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]: dispatch 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]: dispatch 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "074c1bd5-fecc-49fc-9e3b-607b8dab9818"}]': finished 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: osd.3 v2:192.168.123.109:6813/3343463680 boot 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: osdmap e23: 5 total, 4 up, 5 in 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:46.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:46 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/3708726032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[56118]: osdmap e24: 5 total, 4 up, 5 in 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[56118]: pgmap v52: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[49458]: osdmap e24: 5 total, 4 up, 5 in 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:47.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:47 vm09 ceph-mon[49458]: pgmap v52: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:47.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:47 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:30:47.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:47 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:30:47.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:47 vm11 ceph-mon[53379]: osdmap e24: 5 total, 4 up, 5 in 2026-03-09T00:30:47.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:47 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:47.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:47 vm11 ceph-mon[53379]: pgmap v52: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:49.913 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:49 vm11 ceph-mon[53379]: pgmap v53: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:49.913 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:49 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-03-09T00:30:49.913 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:49 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:49.913 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:49 vm11 ceph-mon[53379]: Deploying daemon osd.4 on vm11 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[56118]: pgmap v53: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[56118]: Deploying daemon osd.4 on vm11 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[49458]: pgmap v53: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:50.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:49 vm09 ceph-mon[49458]: Deploying daemon osd.4 on vm11 2026-03-09T00:30:52.022 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:51 vm11 ceph-mon[53379]: pgmap v54: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:52.023 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:51 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:52.023 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:51 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:52.023 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:51 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[56118]: pgmap v54: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[49458]: pgmap v54: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:51 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:52.485 INFO:teuthology.orchestra.run.vm11.stdout:Created osd(s) 4 on host 'vm11' 2026-03-09T00:30:52.485 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.484+0000 7fba62ffd640 1 -- 192.168.123.111:0/1121812147 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fba6c0630c0 con 0x7fba480776a0 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.487+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 >> v2:192.168.123.109:6800/82853931 conn(0x7fba480776a0 msgr2=0x7fba48079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.487+0000 7fba73c65640 1 --2- 192.168.123.111:0/1121812147 >> v2:192.168.123.109:6800/82853931 conn(0x7fba480776a0 0x7fba48079b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba6c072890 tx=0x7fba54005e30 comp rx=0 tx=0).stop 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.487+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 msgr2=0x7fba6c074910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.487+0000 7fba73c65640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 0x7fba6c074910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009950 tx=0x7fba5c002ea0 comp rx=0 tx=0).stop 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.488+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 shutdown_connections 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.488+0000 7fba73c65640 1 --2- 192.168.123.111:0/1121812147 >> v2:192.168.123.109:6800/82853931 conn(0x7fba480776a0 0x7fba48079b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.488+0000 7fba73c65640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fba6c106920 0x7fba6c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.488+0000 7fba73c65640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fba6c105f60 0x7fba6c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.488+0000 7fba73c65640 1 --2- 192.168.123.111:0/1121812147 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fba6c104d60 0x7fba6c074910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:52.486 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.488+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 >> 192.168.123.111:0/1121812147 conn(0x7fba6c100510 msgr2=0x7fba6c101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:52.488 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.489+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 shutdown_connections 2026-03-09T00:30:52.488 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:52.489+0000 7fba73c65640 1 -- 192.168.123.111:0/1121812147 wait complete. 2026-03-09T00:30:52.536 DEBUG:teuthology.orchestra.run.vm11:osd.4> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.4.service 2026-03-09T00:30:52.538 INFO:tasks.cephadm:Deploying osd.5 on vm11 with /dev/vdd... 2026-03-09T00:30:52.538 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vdd 2026-03-09T00:30:52.849 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='osd.4 v2:192.168.123.111:6800/3070266009' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T00:30:53.099 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:53 vm11 ceph-mon[53379]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T00:30:53.099 INFO:journalctl@ceph.osd.4.vm11.stdout:Mar 09 00:30:52 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-4[57788]: 2026-03-09T00:30:52.869+0000 7f816c4b0740 -1 osd.4 0 log_to_monitors true 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='osd.4 v2:192.168.123.111:6800/3070266009' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[56118]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='osd.4 v2:192.168.123.111:6800/3070266009' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T00:30:53.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:53 vm09 ceph-mon[49458]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T00:30:54.284 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:30:54.299 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm11:/dev/vdd 2026-03-09T00:30:54.472 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:30:54.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.601+0000 7efe87e34640 1 -- 192.168.123.111:0/3691094377 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80079690 msgr2=0x7efe80079f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:54.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.601+0000 7efe87e34640 1 --2- 192.168.123.111:0/3691094377 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80079690 0x7efe80079f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00b0a0 tx=0x7efe7c02f470 comp rx=0 tx=0).stop 2026-03-09T00:30:54.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 -- 192.168.123.111:0/3691094377 shutdown_connections 2026-03-09T00:30:54.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 --2- 192.168.123.111:0/3691094377 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80079690 0x7efe80079f30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:54.601 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 --2- 192.168.123.111:0/3691094377 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80078cf0 0x7efe80079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 --2- 192.168.123.111:0/3691094377 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80077aa0 0x7efe80077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 -- 192.168.123.111:0/3691094377 >> 192.168.123.111:0/3691094377 conn(0x7efe801004e0 msgr2=0x7efe80102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 -- 192.168.123.111:0/3691094377 shutdown_connections 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 -- 192.168.123.111:0/3691094377 wait complete. 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 Processor -- start 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.603+0000 7efe87e34640 1 -- start start 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe87e34640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 0x7efe801a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe87e34640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 0x7efe801a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe87e34640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80079690 0x7efe801a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe853a8640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 0x7efe801a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:54.602 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe853a8640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 0x7efe801a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.111:48850/0 (socket says 192.168.123.111:48850) 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe85ba9640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 0x7efe801a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe85ba9640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 0x7efe801a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.111:52514/0 (socket says 192.168.123.111:52514) 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe87e34640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7efe80114330 con 0x7efe80079690 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe87e34640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7efe801141b0 con 0x7efe80077aa0 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe87e34640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7efe801144b0 con 0x7efe80078cf0 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe853a8640 1 -- 192.168.123.111:0/4070931686 learned_addr learned my addr 192.168.123.111:0/4070931686 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.604+0000 7efe863aa640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80079690 0x7efe801a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe85ba9640 1 -- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 msgr2=0x7efe801a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:54.603 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe85ba9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 0x7efe801a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe85ba9640 1 -- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80079690 msgr2=0x7efe801a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe85ba9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80079690 0x7efe801a7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe85ba9640 1 -- 192.168.123.111:0/4070931686 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe801a8650 con 0x7efe80077aa0 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe863aa640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80079690 0x7efe801a7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe853a8640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 0x7efe801a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.605+0000 7efe85ba9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 0x7efe801a0990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efe7400cce0 tx=0x7efe74007590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.606+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74007cb0 con 0x7efe80077aa0 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.606+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7efe74007e50 con 0x7efe80077aa0 2026-03-09T00:30:54.604 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.606+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7400f450 con 0x7efe80077aa0 2026-03-09T00:30:54.605 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.606+0000 7efe87e34640 1 -- 192.168.123.111:0/4070931686 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe801a8940 con 0x7efe80077aa0 2026-03-09T00:30:54.605 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.606+0000 7efe87e34640 1 -- 192.168.123.111:0/4070931686 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe801a8e00 con 0x7efe80077aa0 2026-03-09T00:30:54.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.608+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7efe74004780 con 0x7efe80077aa0 2026-03-09T00:30:54.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.608+0000 7efe6effd640 1 --2- 192.168.123.111:0/4070931686 >> v2:192.168.123.109:6800/82853931 conn(0x7efe5c077540 0x7efe5c079a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:30:54.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.608+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3045+0+0 (secure 0 0 0) 0x7efe740987b0 con 0x7efe80077aa0 2026-03-09T00:30:54.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.608+0000 7efe853a8640 1 --2- 192.168.123.111:0/4070931686 >> v2:192.168.123.109:6800/82853931 conn(0x7efe5c077540 0x7efe5c079a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:30:54.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.608+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe80114ab0 con 0x7efe80077aa0 2026-03-09T00:30:54.607 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.609+0000 7efe853a8640 1 --2- 192.168.123.111:0/4070931686 >> v2:192.168.123.109:6800/82853931 conn(0x7efe5c077540 0x7efe5c079a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe801a1eb0 tx=0x7efe70007540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:30:54.610 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.611+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efe74014030 con 0x7efe80077aa0 2026-03-09T00:30:54.711 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:30:54.712+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdd", "target": ["mon-mgr", ""]}) -- 0x7efe80079150 con 0x7efe5c077540 2026-03-09T00:30:54.905 INFO:journalctl@ceph.osd.4.vm11.stdout:Mar 09 00:30:54 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-4[57788]: 2026-03-09T00:30:54.504+0000 7f8168431640 -1 osd.4 0 waiting for initial osdmap 2026-03-09T00:30:54.905 INFO:journalctl@ceph.osd.4.vm11.stdout:Mar 09 00:30:54 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-4[57788]: 2026-03-09T00:30:54.510+0000 7f816425b640 -1 osd.4 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: pgmap v55: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]': finished 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: osdmap e25: 5 total, 4 up, 5 in 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='osd.4 v2:192.168.123.111:6800/3070266009' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: Detected new or changed devices on vm11 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:54.906 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:54 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: pgmap v55: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]': finished 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: osdmap e25: 5 total, 4 up, 5 in 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='osd.4 v2:192.168.123.111:6800/3070266009' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: Detected new or changed devices on vm11 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: pgmap v55: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]': finished 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: osdmap e25: 5 total, 4 up, 5 in 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='osd.4 v2:192.168.123.111:6800/3070266009' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: Detected new or changed devices on vm11 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:54.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:54 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: Adjusting osd_memory_target on vm11 to 257.0M 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: Unable to set osd_memory_target on vm11 to 269533593: error parsing value: Value '269533593' is below minimum 939524096 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: osdmap e26: 5 total, 4 up, 5 in 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/1035979733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]': finished 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: osd.4 v2:192.168.123.111:6800/3070266009 boot 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: osdmap e27: 6 total, 5 up, 6 in 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.509 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:55 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: Adjusting osd_memory_target on vm11 to 257.0M 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: Unable to set osd_memory_target on vm11 to 269533593: error parsing value: Value '269533593' is below minimum 939524096 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: osdmap e26: 5 total, 4 up, 5 in 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/1035979733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]': finished 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: osd.4 v2:192.168.123.111:6800/3070266009 boot 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: osdmap e27: 6 total, 5 up, 6 in 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: Adjusting osd_memory_target on vm11 to 257.0M 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: Unable to set osd_memory_target on vm11 to 269533593: error parsing value: Value '269533593' is below minimum 939524096 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: osdmap e26: 5 total, 4 up, 5 in 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/1035979733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b4995fe-c439-4efc-a4cb-c80f3db969f0"}]': finished 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: osd.4 v2:192.168.123.111:6800/3070266009 boot 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: osdmap e27: 6 total, 5 up, 6 in 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:30:55.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:55 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: pgmap v58: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/579570733' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: osdmap e28: 6 total, 5 up, 6 in 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: pgmap v58: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/579570733' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: osdmap e28: 6 total, 5 up, 6 in 2026-03-09T00:30:56.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:56 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: pgmap v58: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/579570733' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: osdmap e28: 6 total, 5 up, 6 in 2026-03-09T00:30:56.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:56 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:58.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:58 vm11 ceph-mon[53379]: pgmap v61: 1 pgs: 1 remapped+peering; 449 KiB data, 133 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:30:58.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:58 vm11 ceph-mon[53379]: osdmap e29: 6 total, 5 up, 6 in 2026-03-09T00:30:58.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:30:58 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:58.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:58 vm09 ceph-mon[56118]: pgmap v61: 1 pgs: 1 remapped+peering; 449 KiB data, 133 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:30:58.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:58 vm09 ceph-mon[56118]: osdmap e29: 6 total, 5 up, 6 in 2026-03-09T00:30:58.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:30:58 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:30:58.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:58 vm09 ceph-mon[49458]: pgmap v61: 1 pgs: 1 remapped+peering; 449 KiB data, 133 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:30:58.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:58 vm09 ceph-mon[49458]: osdmap e29: 6 total, 5 up, 6 in 2026-03-09T00:30:58.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:30:58 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:00.455 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:00 vm11 ceph-mon[53379]: pgmap v63: 1 pgs: 1 remapped+peering; 449 KiB data, 133 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:31:00.455 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:00 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-03-09T00:31:00.455 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:00 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:00.455 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:00 vm11 ceph-mon[53379]: Deploying daemon osd.5 on vm11 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[56118]: pgmap v63: 1 pgs: 1 remapped+peering; 449 KiB data, 133 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[56118]: Deploying daemon osd.5 on vm11 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[49458]: pgmap v63: 1 pgs: 1 remapped+peering; 449 KiB data, 133 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:00.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:00 vm09 ceph-mon[49458]: Deploying daemon osd.5 on vm11 2026-03-09T00:31:02.715 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:02 vm11 ceph-mon[53379]: pgmap v64: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:02.715 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:02 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:02.715 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:02 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:02.715 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:02 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[49458]: pgmap v64: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[56118]: pgmap v64: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:02.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:02 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:03.358 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.359+0000 7efe6effd640 1 -- 192.168.123.111:0/4070931686 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7efe80079150 con 0x7efe5c077540 2026-03-09T00:31:03.360 INFO:teuthology.orchestra.run.vm11.stdout:Created osd(s) 5 on host 'vm11' 2026-03-09T00:31:03.361 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.362+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 >> v2:192.168.123.109:6800/82853931 conn(0x7efe5c077540 msgr2=0x7efe5c079a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:03.361 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.362+0000 7efe6cff9640 1 --2- 192.168.123.111:0/4070931686 >> v2:192.168.123.109:6800/82853931 conn(0x7efe5c077540 0x7efe5c079a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe801a1eb0 tx=0x7efe70007540 comp rx=0 tx=0).stop 2026-03-09T00:31:03.361 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.362+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 msgr2=0x7efe801a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:03.361 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.362+0000 7efe6cff9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 0x7efe801a0990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efe7400cce0 tx=0x7efe74007590 comp rx=0 tx=0).stop 2026-03-09T00:31:03.362 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.363+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 shutdown_connections 2026-03-09T00:31:03.362 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.363+0000 7efe6cff9640 1 --2- 192.168.123.111:0/4070931686 >> v2:192.168.123.109:6800/82853931 conn(0x7efe5c077540 0x7efe5c079a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:03.362 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.363+0000 7efe6cff9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efe80079690 0x7efe801a7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:03.363 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.363+0000 7efe6cff9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efe80078cf0 0x7efe801a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:03.363 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.364+0000 7efe6cff9640 1 --2- 192.168.123.111:0/4070931686 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efe80077aa0 0x7efe801a0990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:03.363 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.364+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 >> 192.168.123.111:0/4070931686 conn(0x7efe801004e0 msgr2=0x7efe80101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:03.364 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.365+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 shutdown_connections 2026-03-09T00:31:03.364 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:03.365+0000 7efe6cff9640 1 -- 192.168.123.111:0/4070931686 wait complete. 2026-03-09T00:31:03.413 DEBUG:teuthology.orchestra.run.vm11:osd.5> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.5.service 2026-03-09T00:31:03.415 INFO:tasks.cephadm:Deploying osd.6 on vm11 with /dev/vdc... 2026-03-09T00:31:03.415 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vdc 2026-03-09T00:31:03.705 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:03.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: pgmap v65: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 61 KiB/s, 0 objects/s recovering 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:03.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:03 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: pgmap v65: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 61 KiB/s, 0 objects/s recovering 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: pgmap v65: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 61 KiB/s, 0 objects/s recovering 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:03 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:04.409 INFO:journalctl@ceph.osd.5.vm11.stdout:Mar 09 00:31:04 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-5[62993]: 2026-03-09T00:31:04.158+0000 7f1e9dad6740 -1 osd.5 0 log_to_monitors true 2026-03-09T00:31:04.988 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:31:05.009 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm11:/dev/vdc 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='osd.5 v2:192.168.123.111:6804/833555371' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: Detected new or changed devices on vm11 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: Adjusting osd_memory_target on vm11 to 128.5M 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: Unable to set osd_memory_target on vm11 to 134766796: error parsing value: Value '134766796' is below minimum 939524096 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='osd.5 v2:192.168.123.111:6804/833555371' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: Detected new or changed devices on vm11 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: Adjusting osd_memory_target on vm11 to 128.5M 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: Unable to set osd_memory_target on vm11 to 134766796: error parsing value: Value '134766796' is below minimum 939524096 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:05.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:04 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.180 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='osd.5 v2:192.168.123.111:6804/833555371' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: Detected new or changed devices on vm11 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: Adjusting osd_memory_target on vm11 to 128.5M 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: Unable to set osd_memory_target on vm11 to 134766796: error parsing value: Value '134766796' is below minimum 939524096 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:05.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:04 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:05.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.309+0000 7f2eeba7f640 1 -- 192.168.123.111:0/2605438967 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 msgr2=0x7f2ee41063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:05.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.309+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/2605438967 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41063d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009a30 tx=0x7f2ed402f220 comp rx=0 tx=0).stop 2026-03-09T00:31:05.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.310+0000 7f2eeba7f640 1 -- 192.168.123.111:0/2605438967 shutdown_connections 2026-03-09T00:31:05.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.310+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/2605438967 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 0x7f2ee410d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:05.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.310+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/2605438967 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41063d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:05.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.310+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/2605438967 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2ee4104d50 0x7f2ee4105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:05.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.310+0000 7f2eeba7f640 1 -- 192.168.123.111:0/2605438967 >> 192.168.123.111:0/2605438967 conn(0x7f2ee41004e0 msgr2=0x7f2ee4102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:05.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.311+0000 7f2eeba7f640 1 -- 192.168.123.111:0/2605438967 shutdown_connections 2026-03-09T00:31:05.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.311+0000 7f2eeba7f640 1 -- 192.168.123.111:0/2605438967 wait complete. 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.313+0000 7f2eeba7f640 1 Processor -- start 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.313+0000 7f2eeba7f640 1 -- start start 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2eeba7f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2ee4104d50 0x7f2ee41a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2eeba7f640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2eeba7f640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 0x7f2ee41a8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2eeba7f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee410ffa0 con 0x7f2ee4104d50 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2eeba7f640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee410fe20 con 0x7f2ee4105f50 2026-03-09T00:31:05.312 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2eeba7f640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee4110120 con 0x7f2ee4106910 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2ee9ff5640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 0x7f2ee41a8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2ee9ff5640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 0x7f2ee41a8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.111:49614/0 (socket says 192.168.123.111:49614) 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2ee9ff5640 1 -- 192.168.123.111:0/1258205549 learned_addr learned my addr 192.168.123.111:0/1258205549 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2ee97f4640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2ee4104d50 0x7f2ee41a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.314+0000 7f2ee8ff3640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2ee8ff3640 1 -- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 msgr2=0x7f2ee41a8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2ee8ff3640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 0x7f2ee41a8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:05.313 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2ee8ff3640 1 -- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2ee4104d50 msgr2=0x7f2ee41a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:05.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2ee8ff3640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2ee4104d50 0x7f2ee41a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:05.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2ee8ff3640 1 -- 192.168.123.111:0/1258205549 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee41a8910 con 0x7f2ee4105f50 2026-03-09T00:31:05.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2ee8ff3640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41a11a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009a00 tx=0x7f2ed4004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:05.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.315+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4004380 con 0x7f2ee4105f50 2026-03-09T00:31:05.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.316+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f2ed4004520 con 0x7f2ee4105f50 2026-03-09T00:31:05.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.316+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee41a8ba0 con 0x7f2ee4105f50 2026-03-09T00:31:05.315 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.316+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee41a90a0 con 0x7f2ee4105f50 2026-03-09T00:31:05.316 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.317+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4038d00 con 0x7f2ee4105f50 2026-03-09T00:31:05.319 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.317+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee41051d0 con 0x7f2ee4105f50 2026-03-09T00:31:05.319 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.320+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f2ed404a020 con 0x7f2ee4105f50 2026-03-09T00:31:05.319 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.320+0000 7f2eda7fc640 1 --2- 192.168.123.111:0/1258205549 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ebc0775c0 0x7f2ebc079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:05.319 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.321+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3321+0+0 (secure 0 0 0) 0x7f2ed40be0b0 con 0x7f2ee4105f50 2026-03-09T00:31:05.319 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.321+0000 7f2ee97f4640 1 --2- 192.168.123.111:0/1258205549 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ebc0775c0 0x7f2ebc079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:05.319 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.321+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2ed40029f0 con 0x7f2ee4105f50 2026-03-09T00:31:05.320 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.321+0000 7f2ee97f4640 1 --2- 192.168.123.111:0/1258205549 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ebc0775c0 0x7f2ebc079a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ee41a1b40 tx=0x7f2ecc009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:05.414 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:05.415+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdc", "target": ["mon-mgr", ""]}) -- 0x7f2ee407a780 con 0x7f2ebc0775c0 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: pgmap v66: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 54 KiB/s, 0 objects/s recovering 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]': finished 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: osdmap e30: 6 total, 5 up, 6 in 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='osd.5 v2:192.168.123.111:6804/833555371' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:06.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: pgmap v66: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 54 KiB/s, 0 objects/s recovering 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]': finished 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: osdmap e30: 6 total, 5 up, 6 in 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='osd.5 v2:192.168.123.111:6804/833555371' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:31:06.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:05 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: pgmap v66: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 54 KiB/s, 0 objects/s recovering 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]': finished 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: osdmap e30: 6 total, 5 up, 6 in 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='osd.5 v2:192.168.123.111:6804/833555371' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:05 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:06.200 INFO:journalctl@ceph.osd.5.vm11.stdout:Mar 09 00:31:05 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-5[62993]: 2026-03-09T00:31:05.872+0000 7f1e99a57640 -1 osd.5 0 waiting for initial osdmap 2026-03-09T00:31:06.200 INFO:journalctl@ceph.osd.5.vm11.stdout:Mar 09 00:31:05 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-5[62993]: 2026-03-09T00:31:05.880+0000 7f1e95881640 -1 osd.5 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:31:06.877 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:06.877 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: osdmap e31: 6 total, 5 up, 6 in 2026-03-09T00:31:06.877 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:06.877 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/2966974108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6529eea0-0bdd-40e2-b756-3a71b118612f"}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: osdmap e31: 6 total, 5 up, 6 in 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/2966974108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6529eea0-0bdd-40e2-b756-3a71b118612f"}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/2966974108' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6529eea0-0bdd-40e2-b756-3a71b118612f"}]': finished 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: osd.5 v2:192.168.123.111:6804/833555371 boot 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: osdmap e32: 7 total, 6 up, 7 in 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/3601560628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: osdmap e31: 6 total, 5 up, 6 in 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/2966974108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6529eea0-0bdd-40e2-b756-3a71b118612f"}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/2966974108' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6529eea0-0bdd-40e2-b756-3a71b118612f"}]': finished 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: osd.5 v2:192.168.123.111:6804/833555371 boot 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: osdmap e32: 7 total, 6 up, 7 in 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:07.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:06 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/3601560628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:31:07.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/2966974108' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6529eea0-0bdd-40e2-b756-3a71b118612f"}]': finished 2026-03-09T00:31:07.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: osd.5 v2:192.168.123.111:6804/833555371 boot 2026-03-09T00:31:07.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: osdmap e32: 7 total, 6 up, 7 in 2026-03-09T00:31:07.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:07.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:07.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:06 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/3601560628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[56118]: pgmap v70: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[56118]: osdmap e33: 7 total, 6 up, 7 in 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[49458]: pgmap v70: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[49458]: osdmap e33: 7 total, 6 up, 7 in 2026-03-09T00:31:08.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:07 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:08.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:07 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:31:08.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:07 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:31:08.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:07 vm11 ceph-mon[53379]: pgmap v70: 1 pgs: 1 active+clean; 449 KiB data, 134 MiB used, 100 GiB / 100 GiB avail 2026-03-09T00:31:08.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:07 vm11 ceph-mon[53379]: osdmap e33: 7 total, 6 up, 7 in 2026-03-09T00:31:08.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:07 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:09.390 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:09 vm11 ceph-mon[53379]: osdmap e34: 7 total, 6 up, 7 in 2026-03-09T00:31:09.390 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:09 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:09.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:09 vm09 ceph-mon[56118]: osdmap e34: 7 total, 6 up, 7 in 2026-03-09T00:31:09.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:09 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:09.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:09 vm09 ceph-mon[49458]: osdmap e34: 7 total, 6 up, 7 in 2026-03-09T00:31:09.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:09 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:10.233 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:10 vm11 ceph-mon[53379]: pgmap v73: 1 pgs: 1 remapped; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:10.507 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:10 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-03-09T00:31:10.507 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:10 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:10 vm09 ceph-mon[56118]: pgmap v73: 1 pgs: 1 remapped; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:10 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-03-09T00:31:10.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:10 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:10.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:10 vm09 ceph-mon[49458]: pgmap v73: 1 pgs: 1 remapped; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:10.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:10 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-03-09T00:31:10.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:10 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:11.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:11 vm11 ceph-mon[53379]: Deploying daemon osd.6 on vm11 2026-03-09T00:31:11.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:11 vm09 ceph-mon[56118]: Deploying daemon osd.6 on vm11 2026-03-09T00:31:11.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:11 vm09 ceph-mon[49458]: Deploying daemon osd.6 on vm11 2026-03-09T00:31:12.238 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:12 vm11 ceph-mon[53379]: pgmap v74: 1 pgs: 1 remapped; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:12.238 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:12.238 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:12.491 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:12 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[56118]: pgmap v74: 1 pgs: 1 remapped; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[49458]: pgmap v74: 1 pgs: 1 remapped; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:12.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:12 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:13.221 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.220+0000 7f2eda7fc640 1 -- 192.168.123.111:0/1258205549 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f2ee407a780 con 0x7f2ebc0775c0 2026-03-09T00:31:13.221 INFO:teuthology.orchestra.run.vm11.stdout:Created osd(s) 6 on host 'vm11' 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ebc0775c0 msgr2=0x7f2ebc079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/1258205549 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ebc0775c0 0x7f2ebc079a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ee41a1b40 tx=0x7f2ecc009210 comp rx=0 tx=0).stop 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 msgr2=0x7f2ee41a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41a11a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009a00 tx=0x7f2ed4004290 comp rx=0 tx=0).stop 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 shutdown_connections 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/1258205549 >> v2:192.168.123.109:6800/82853931 conn(0x7f2ebc0775c0 0x7f2ebc079a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2ee4106910 0x7f2ee41a8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2ee4105f50 0x7f2ee41a11a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 --2- 192.168.123.111:0/1258205549 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2ee4104d50 0x7f2ee41a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 >> 192.168.123.111:0/1258205549 conn(0x7f2ee41004e0 msgr2=0x7f2ee4101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 shutdown_connections 2026-03-09T00:31:13.222 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:13.223+0000 7f2eeba7f640 1 -- 192.168.123.111:0/1258205549 wait complete. 2026-03-09T00:31:13.313 DEBUG:teuthology.orchestra.run.vm11:osd.6> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.6.service 2026-03-09T00:31:13.315 INFO:tasks.cephadm:Deploying osd.7 on vm11 with /dev/vdb... 2026-03-09T00:31:13.315 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- lvm zap /dev/vdb 2026-03-09T00:31:13.559 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:13.881 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: pgmap v75: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:13.882 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:13.882 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:13.882 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:13.882 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:14.133 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.133 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:14.133 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.133 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.133 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='osd.6 v2:192.168.123.111:6808/11447683' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T00:31:14.133 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:13 vm11 ceph-mon[53379]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: pgmap v75: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='osd.6 v2:192.168.123.111:6808/11447683' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[56118]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: pgmap v75: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='osd.6 v2:192.168.123.111:6808/11447683' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T00:31:14.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:13 vm09 ceph-mon[49458]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T00:31:14.866 INFO:teuthology.orchestra.run.vm11.stdout: 2026-03-09T00:31:14.880 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch daemon add osd vm11:/dev/vdb 2026-03-09T00:31:15.043 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.165+0000 7f1c4292a640 1 -- 192.168.123.111:0/2111186034 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c079690 msgr2=0x7f1c3c079f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.165+0000 7f1c4292a640 1 --2- 192.168.123.111:0/2111186034 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c079690 0x7f1c3c079f30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000b0a0 tx=0x7f1c3002f470 comp rx=0 tx=0).stop 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.166+0000 7f1c4292a640 1 -- 192.168.123.111:0/2111186034 shutdown_connections 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.166+0000 7f1c4292a640 1 --2- 192.168.123.111:0/2111186034 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c079690 0x7f1c3c079f30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.166+0000 7f1c4292a640 1 --2- 192.168.123.111:0/2111186034 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1c3c078cf0 0x7f1c3c079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.166+0000 7f1c4292a640 1 --2- 192.168.123.111:0/2111186034 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 0x7f1c3c077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.166+0000 7f1c4292a640 1 -- 192.168.123.111:0/2111186034 >> 192.168.123.111:0/2111186034 conn(0x7f1c3c1004e0 msgr2=0x7f1c3c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.166+0000 7f1c4292a640 1 -- 192.168.123.111:0/2111186034 shutdown_connections 2026-03-09T00:31:15.165 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 -- 192.168.123.111:0/2111186034 wait complete. 2026-03-09T00:31:15.166 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 Processor -- start 2026-03-09T00:31:15.166 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 -- start start 2026-03-09T00:31:15.166 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 0x7f1c3c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:15.167 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 0x7f1c3c1a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:15.167 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1c3c079690 0x7f1c3c1a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:15.168 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c1143a0 con 0x7f1c3c077aa0 2026-03-09T00:31:15.168 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c114220 con 0x7f1c3c078cf0 2026-03-09T00:31:15.168 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.167+0000 7f1c4292a640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c114520 con 0x7f1c3c079690 2026-03-09T00:31:15.168 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 0x7f1c3c1a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:15.168 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 0x7f1c3c1a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.111:59640/0 (socket says 192.168.123.111:59640) 2026-03-09T00:31:15.169 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 -- 192.168.123.111:0/311357479 learned_addr learned my addr 192.168.123.111:0/311357479 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 -- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1c3c079690 msgr2=0x7f1c3c1a8000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1c3c079690 0x7f1c3c1a8000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 -- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 msgr2=0x7f1c3c1a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3bfff640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 0x7f1c3c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 0x7f1c3c1a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 -- 192.168.123.111:0/311357479 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c1a8700 con 0x7f1c3c078cf0 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3bfff640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 0x7f1c3c1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c3b7fe640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 0x7f1c3c1a0f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b570 tx=0x7f1c2800ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:15.171 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28013020 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f1c28004480 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2800fa90 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3c1a89f0 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.168+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3c06cac0 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.173+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f1c28020020 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.173+0000 7f1c397fa640 1 --2- 192.168.123.111:0/311357479 >> v2:192.168.123.109:6800/82853931 conn(0x7f1c10077650 0x7f1c10079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.173+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 3613+0+0 (secure 0 0 0) 0x7f1c2805ebf0 con 0x7f1c3c078cf0 2026-03-09T00:31:15.172 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.173+0000 7f1c3bfff640 1 --2- 192.168.123.111:0/311357479 >> v2:192.168.123.109:6800/82853931 conn(0x7f1c10077650 0x7f1c10079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:15.173 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.174+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c00005180 con 0x7f1c3c078cf0 2026-03-09T00:31:15.173 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.174+0000 7f1c3bfff640 1 --2- 192.168.123.111:0/311357479 >> v2:192.168.123.109:6800/82853931 conn(0x7f1c10077650 0x7f1c10079b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c005e00 tx=0x7f1c2c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:15.175 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.177+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1c28062f50 con 0x7f1c3c078cf0 2026-03-09T00:31:15.280 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:15.281+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdb", "target": ["mon-mgr", ""]}) -- 0x7f1c00002bf0 con 0x7f1c10077650 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: Detected new or changed devices on vm11 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: Adjusting osd_memory_target on vm11 to 87738k 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: Unable to set osd_memory_target on vm11 to 89844531: error parsing value: Value '89844531' is below minimum 939524096 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]': finished 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: osdmap e35: 7 total, 6 up, 7 in 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='osd.6 v2:192.168.123.111:6808/11447683' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[56118]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: Detected new or changed devices on vm11 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: Adjusting osd_memory_target on vm11 to 87738k 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: Unable to set osd_memory_target on vm11 to 89844531: error parsing value: Value '89844531' is below minimum 939524096 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]': finished 2026-03-09T00:31:15.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: osdmap e35: 7 total, 6 up, 7 in 2026-03-09T00:31:15.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:15.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='osd.6 v2:192.168.123.111:6808/11447683' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:15.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:15 vm09 ceph-mon[49458]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: Detected new or changed devices on vm11 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: Adjusting osd_memory_target on vm11 to 87738k 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: Unable to set osd_memory_target on vm11 to 89844531: error parsing value: Value '89844531' is below minimum 939524096 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]': finished 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: osdmap e35: 7 total, 6 up, 7 in 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='osd.6 v2:192.168.123.111:6808/11447683' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:15.452 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:15 vm11 ceph-mon[53379]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:16.160 INFO:journalctl@ceph.osd.6.vm11.stdout:Mar 09 00:31:16 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-6[67847]: 2026-03-09T00:31:16.141+0000 7f9d12077640 -1 osd.6 0 waiting for initial osdmap 2026-03-09T00:31:16.160 INFO:journalctl@ceph.osd.6.vm11.stdout:Mar 09 00:31:16 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-6[67847]: 2026-03-09T00:31:16.154+0000 7f9d0d6a0640 -1 osd.6 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:31:16.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: pgmap v77: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail; 59 KiB/s, 0 objects/s recovering 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: osdmap e36: 7 total, 6 up, 7 in 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/1092394823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]': finished 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: osdmap e37: 8 total, 6 up, 8 in 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:16.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:16 vm11 ceph-mon[53379]: from='osd.6 ' entity='osd.6' 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: pgmap v77: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail; 59 KiB/s, 0 objects/s recovering 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: osdmap e36: 7 total, 6 up, 7 in 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/1092394823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]': finished 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: osdmap e37: 8 total, 6 up, 8 in 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[56118]: from='osd.6 ' entity='osd.6' 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: pgmap v77: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail; 59 KiB/s, 0 objects/s recovering 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: osdmap e36: 7 total, 6 up, 7 in 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm11:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/1092394823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]: dispatch 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf0064f2-9c2f-412d-8e15-98b229eaeb31"}]': finished 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: osdmap e37: 8 total, 6 up, 8 in 2026-03-09T00:31:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:16.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:16.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:16 vm09 ceph-mon[49458]: from='osd.6 ' entity='osd.6' 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/373264788' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: osd.6 v2:192.168.123.111:6808/11447683 boot 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: osdmap e38: 8 total, 7 up, 8 in 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/373264788' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: osd.6 v2:192.168.123.111:6808/11447683 boot 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: osdmap e38: 8 total, 7 up, 8 in 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:17.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:17 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/373264788' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: osd.6 v2:192.168.123.111:6808/11447683 boot 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: osdmap e38: 8 total, 7 up, 8 in 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:17.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:17 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:18.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:18 vm09 ceph-mon[56118]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:18.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:18 vm09 ceph-mon[56118]: osdmap e39: 8 total, 7 up, 8 in 2026-03-09T00:31:18.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:18 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:18.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:18 vm09 ceph-mon[49458]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:18.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:18 vm09 ceph-mon[49458]: osdmap e39: 8 total, 7 up, 8 in 2026-03-09T00:31:18.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:18 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:18.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:18 vm11 ceph-mon[53379]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 160 MiB used, 120 GiB / 120 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:18.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:18 vm11 ceph-mon[53379]: osdmap e39: 8 total, 7 up, 8 in 2026-03-09T00:31:18.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:18 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:20.327 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:20 vm11 ceph-mon[53379]: pgmap v83: 1 pgs: 1 remapped+peering; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:20.327 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:20 vm11 ceph-mon[53379]: osdmap e40: 8 total, 7 up, 8 in 2026-03-09T00:31:20.327 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:20 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:20.327 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:20 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-03-09T00:31:20.327 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:20 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[56118]: pgmap v83: 1 pgs: 1 remapped+peering; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[56118]: osdmap e40: 8 total, 7 up, 8 in 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[49458]: pgmap v83: 1 pgs: 1 remapped+peering; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[49458]: osdmap e40: 8 total, 7 up, 8 in 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-03-09T00:31:20.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:20 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:21.415 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:21 vm11 ceph-mon[53379]: Deploying daemon osd.7 on vm11 2026-03-09T00:31:21.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:21 vm09 ceph-mon[56118]: Deploying daemon osd.7 on vm11 2026-03-09T00:31:21.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:21 vm09 ceph-mon[49458]: Deploying daemon osd.7 on vm11 2026-03-09T00:31:22.373 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:22 vm11 ceph-mon[53379]: pgmap v85: 1 pgs: 1 remapped+peering; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:22.373 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:22.373 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:22.373 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:22 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[56118]: pgmap v85: 1 pgs: 1 remapped+peering; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[49458]: pgmap v85: 1 pgs: 1 remapped+peering; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:22.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:22 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.033 INFO:teuthology.orchestra.run.vm11.stdout:Created osd(s) 7 on host 'vm11' 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.032+0000 7f1c397fa640 1 -- 192.168.123.111:0/311357479 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f1c00002bf0 con 0x7f1c10077650 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 >> v2:192.168.123.109:6800/82853931 conn(0x7f1c10077650 msgr2=0x7f1c10079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 --2- 192.168.123.111:0/311357479 >> v2:192.168.123.109:6800/82853931 conn(0x7f1c10077650 0x7f1c10079b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c005e00 tx=0x7f1c2c00a250 comp rx=0 tx=0).stop 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 msgr2=0x7f1c3c1a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 0x7f1c3c1a0f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b570 tx=0x7f1c2800ba40 comp rx=0 tx=0).stop 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 shutdown_connections 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 --2- 192.168.123.111:0/311357479 >> v2:192.168.123.109:6800/82853931 conn(0x7f1c10077650 0x7f1c10079b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f1c3c079690 0x7f1c3c1a8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f1c3c078cf0 0x7f1c3c1a0f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 --2- 192.168.123.111:0/311357479 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f1c3c077aa0 0x7f1c3c1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.034 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 >> 192.168.123.111:0/311357479 conn(0x7f1c3c1004e0 msgr2=0x7f1c3c102030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:23.035 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.035+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 shutdown_connections 2026-03-09T00:31:23.035 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:23.036+0000 7f1c4292a640 1 -- 192.168.123.111:0/311357479 wait complete. 2026-03-09T00:31:23.088 DEBUG:teuthology.orchestra.run.vm11:osd.7> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@osd.7.service 2026-03-09T00:31:23.090 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-03-09T00:31:23.090 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd stat -f json 2026-03-09T00:31:23.287 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.411+0000 7efde6e2e640 1 -- 192.168.123.109:0/88460601 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde0075a40 msgr2=0x7efde0075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.411+0000 7efde6e2e640 1 --2- 192.168.123.109:0/88460601 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde0075a40 0x7efde0075ea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009a30 tx=0x7efdd002f260 comp rx=0 tx=0).stop 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 -- 192.168.123.109:0/88460601 shutdown_connections 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 --2- 192.168.123.109:0/88460601 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efde01062f0 0x7efde0111200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 --2- 192.168.123.109:0/88460601 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde0075a40 0x7efde0075ea0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 --2- 192.168.123.109:0/88460601 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde00770a0 0x7efde0075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 -- 192.168.123.109:0/88460601 >> 192.168.123.109:0/88460601 conn(0x7efde00fe0a0 msgr2=0x7efde01004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 -- 192.168.123.109:0/88460601 shutdown_connections 2026-03-09T00:31:23.411 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 -- 192.168.123.109:0/88460601 wait complete. 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.412+0000 7efde6e2e640 1 Processor -- start 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 -- start start 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efde0075a40 0x7efde00748b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde00770a0 0x7efde0071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 0x7efde0071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7efde0114230 con 0x7efde00770a0 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7efde01140b0 con 0x7efde0075a40 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde6e2e640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7efde01143b0 con 0x7efde01062f0 2026-03-09T00:31:23.412 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde662d640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 0x7efde0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde662d640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 0x7efde0071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:32842/0 (socket says 192.168.123.109:32842) 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.413+0000 7efde662d640 1 -- 192.168.123.109:0/2356438296 learned_addr learned my addr 192.168.123.109:0/2356438296 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.414+0000 7efde662d640 1 -- 192.168.123.109:0/2356438296 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efde0075a40 msgr2=0x7efde00748b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.414+0000 7efde662d640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efde0075a40 0x7efde00748b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.414+0000 7efde662d640 1 -- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde00770a0 msgr2=0x7efde0071310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.414+0000 7efde662d640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde00770a0 0x7efde0071310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.413 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.414+0000 7efde662d640 1 -- 192.168.123.109:0/2356438296 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde0074f10 con 0x7efde01062f0 2026-03-09T00:31:23.414 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.414+0000 7efde662d640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 0x7efde0071850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e3f0 tx=0x7efddc00e8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:23.414 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.415+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc002c60 con 0x7efde01062f0 2026-03-09T00:31:23.414 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.415+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7efddc018070 con 0x7efde01062f0 2026-03-09T00:31:23.414 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.415+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0136d0 con 0x7efde01062f0 2026-03-09T00:31:23.414 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.415+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde01067e0 con 0x7efde01062f0 2026-03-09T00:31:23.415 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.416+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7efddc0040d0 con 0x7efde01062f0 2026-03-09T00:31:23.415 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.416+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efde0106cd0 con 0x7efde01062f0 2026-03-09T00:31:23.416 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.417+0000 7efdd6ffd640 1 --2- 192.168.123.109:0/2356438296 >> v2:192.168.123.109:6800/82853931 conn(0x7efdbc077620 0x7efdbc079ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:23.416 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.417+0000 7efde5e2c640 1 --2- 192.168.123.109:0/2356438296 >> v2:192.168.123.109:6800/82853931 conn(0x7efdbc077620 0x7efdbc079ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:23.417 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.417+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 3884+0+0 (secure 0 0 0) 0x7efddc09ac00 con 0x7efde01062f0 2026-03-09T00:31:23.417 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.418+0000 7efde5e2c640 1 --2- 192.168.123.109:0/2356438296 >> v2:192.168.123.109:6800/82853931 conn(0x7efdbc077620 0x7efdbc079ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efdc8005fd0 tx=0x7efdc8005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:23.417 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.418+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde01149b0 con 0x7efde01062f0 2026-03-09T00:31:23.420 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.421+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efddc010040 con 0x7efde01062f0 2026-03-09T00:31:23.517 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.517+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7efde01042e0 con 0x7efde01062f0 2026-03-09T00:31:23.517 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.518+0000 7efdd6ffd640 1 -- 192.168.123.109:0/2356438296 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) ==== 74+0+130 (secure 0 0 0) 0x7efddc0626d0 con 0x7efde01062f0 2026-03-09T00:31:23.518 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 >> v2:192.168.123.109:6800/82853931 conn(0x7efdbc077620 msgr2=0x7efdbc079ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 --2- 192.168.123.109:0/2356438296 >> v2:192.168.123.109:6800/82853931 conn(0x7efdbc077620 0x7efdbc079ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efdc8005fd0 tx=0x7efdc8005d00 comp rx=0 tx=0).stop 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 msgr2=0x7efde0071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 0x7efde0071850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e3f0 tx=0x7efddc00e8c0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 shutdown_connections 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 --2- 192.168.123.109:0/2356438296 >> v2:192.168.123.109:6800/82853931 conn(0x7efdbc077620 0x7efdbc079ae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7efde01062f0 0x7efde0071850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.520 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7efde00770a0 0x7efde0071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.521 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.521+0000 7efde6e2e640 1 --2- 192.168.123.109:0/2356438296 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7efde0075a40 0x7efde00748b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:23.521 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.522+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 >> 192.168.123.109:0/2356438296 conn(0x7efde00fe0a0 msgr2=0x7efde0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:23.521 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.522+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 shutdown_connections 2026-03-09T00:31:23.521 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:23.522+0000 7efde6e2e640 1 -- 192.168.123.109:0/2356438296 wait complete. 2026-03-09T00:31:23.584 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":40,"num_osds":8,"num_up_osds":7,"osd_up_since":1773016277,"num_in_osds":8,"osd_in_since":1773016276,"num_remapped_pgs":0} 2026-03-09T00:31:23.672 INFO:journalctl@ceph.osd.7.vm11.stdout:Mar 09 00:31:23 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-7[73084]: 2026-03-09T00:31:23.545+0000 7f0b34ef9740 -1 osd.7 0 log_to_monitors true 2026-03-09T00:31:23.672 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.672 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.672 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2356438296' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='osd.7 v2:192.168.123.111:6812/1070708555' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:23 vm11 ceph-mon[53379]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2356438296' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:23.673 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='osd.7 v2:192.168.123.111:6812/1070708555' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T00:31:23.674 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[56118]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2356438296' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='osd.7 v2:192.168.123.111:6812/1070708555' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T00:31:23.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:23 vm09 ceph-mon[49458]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T00:31:24.585 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd stat -f json 2026-03-09T00:31:24.771 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.907+0000 7fe73dd8d640 1 -- 192.168.123.109:0/3636733195 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738104d50 msgr2=0x7fe738105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.907+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/3636733195 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738104d50 0x7fe738105150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009a30 tx=0x7fe71c02f260 comp rx=0 tx=0).stop 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 -- 192.168.123.109:0/3636733195 shutdown_connections 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/3636733195 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe738106910 0x7fe73810d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/3636733195 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738105f50 0x7fe7381063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/3636733195 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738104d50 0x7fe738105150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 -- 192.168.123.109:0/3636733195 >> 192.168.123.109:0/3636733195 conn(0x7fe7381004e0 msgr2=0x7fe738102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 -- 192.168.123.109:0/3636733195 shutdown_connections 2026-03-09T00:31:24.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.909+0000 7fe73dd8d640 1 -- 192.168.123.109:0/3636733195 wait complete. 2026-03-09T00:31:24.909 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.910+0000 7fe73dd8d640 1 Processor -- start 2026-03-09T00:31:24.909 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.910+0000 7fe73dd8d640 1 -- start start 2026-03-09T00:31:24.909 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.910+0000 7fe73dd8d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 0x7fe73819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:24.909 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.910+0000 7fe7377fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 0x7fe73819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.910+0000 7fe7377fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 0x7fe73819c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:50798/0 (socket says 192.168.123.109:50798) 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe73dd8d640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738105f50 0x7fe73819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe73dd8d640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe738106910 0x7fe7381a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe73dd8d640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe73810ff10 con 0x7fe738104d50 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe73dd8d640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe73810fd90 con 0x7fe738106910 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe73dd8d640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fe738110090 con 0x7fe738105f50 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe7377fe640 1 -- 192.168.123.109:0/1384787858 learned_addr learned my addr 192.168.123.109:0/1384787858 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:24.910 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738105f50 0x7fe73819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:24.911 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 -- 192.168.123.109:0/1384787858 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe738106910 msgr2=0x7fe7381a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:24.911 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe738106910 0x7fe7381a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:24.911 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 -- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 msgr2=0x7fe73819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:24.911 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 0x7fe73819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:24.911 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 -- 192.168.123.109:0/1384787858 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381a4220 con 0x7fe738105f50 2026-03-09T00:31:24.912 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.911+0000 7fe736ffd640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738105f50 0x7fe73819cb30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe72400cce0 tx=0x7fe724007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:24.912 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.912+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724013070 con 0x7fe738105f50 2026-03-09T00:31:24.912 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.912+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fe7240044e0 con 0x7fe738105f50 2026-03-09T00:31:24.912 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.912+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72400f450 con 0x7fe738105f50 2026-03-09T00:31:24.912 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.913+0000 7fe7377fe640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 0x7fe73819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:24.912 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.913+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7381a4510 con 0x7fe738105f50 2026-03-09T00:31:24.914 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.913+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7381a4a50 con 0x7fe738105f50 2026-03-09T00:31:24.917 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.915+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc005180 con 0x7fe738105f50 2026-03-09T00:31:24.917 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.918+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fe7240040a0 con 0x7fe738105f50 2026-03-09T00:31:24.917 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.918+0000 7fe734ff9640 1 --2- 192.168.123.109:0/1384787858 >> v2:192.168.123.109:6800/82853931 conn(0x7fe710077610 0x7fe710079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:24.918 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.918+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 3905+0+0 (secure 0 0 0) 0x7fe7240995c0 con 0x7fe738105f50 2026-03-09T00:31:24.918 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.918+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe7240999e0 con 0x7fe738105f50 2026-03-09T00:31:24.918 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.919+0000 7fe7377fe640 1 --2- 192.168.123.109:0/1384787858 >> v2:192.168.123.109:6800/82853931 conn(0x7fe710077610 0x7fe710079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:24.919 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:24.919+0000 7fe7377fe640 1 --2- 192.168.123.109:0/1384787858 >> v2:192.168.123.109:6800/82853931 conn(0x7fe710077610 0x7fe710079ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009740 tx=0x7fe71c0023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:25.020 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.020+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe6fc005740 con 0x7fe738105f50 2026-03-09T00:31:25.020 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.021+0000 7fe734ff9640 1 -- 192.168.123.109:0/1384787858 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) ==== 74+0+130 (secure 0 0 0) 0x7fe724063050 con 0x7fe738105f50 2026-03-09T00:31:25.021 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:25.023 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.024+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 >> v2:192.168.123.109:6800/82853931 conn(0x7fe710077610 msgr2=0x7fe710079ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:25.023 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.024+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/1384787858 >> v2:192.168.123.109:6800/82853931 conn(0x7fe710077610 0x7fe710079ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009740 tx=0x7fe71c0023d0 comp rx=0 tx=0).stop 2026-03-09T00:31:25.023 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.024+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738105f50 msgr2=0x7fe73819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:25.023 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.024+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738105f50 0x7fe73819cb30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe72400cce0 tx=0x7fe724007590 comp rx=0 tx=0).stop 2026-03-09T00:31:25.023 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.024+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 shutdown_connections 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.024+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/1384787858 >> v2:192.168.123.109:6800/82853931 conn(0x7fe710077610 0x7fe710079ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.025+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe738106910 0x7fe7381a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.025+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe738105f50 0x7fe73819cb30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.025+0000 7fe73dd8d640 1 --2- 192.168.123.109:0/1384787858 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe738104d50 0x7fe73819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.025+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 >> 192.168.123.109:0/1384787858 conn(0x7fe7381004e0 msgr2=0x7fe738101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.025+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 shutdown_connections 2026-03-09T00:31:25.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:25.025+0000 7fe73dd8d640 1 -- 192.168.123.109:0/1384787858 wait complete. 2026-03-09T00:31:25.098 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":41,"num_osds":8,"num_up_osds":7,"osd_up_since":1773016277,"num_in_osds":8,"osd_in_since":1773016276,"num_remapped_pgs":0} 2026-03-09T00:31:25.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: Detected new or changed devices on vm11 2026-03-09T00:31:25.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: Adjusting osd_memory_target on vm11 to 65804k 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: Unable to set osd_memory_target on vm11 to 67383398: error parsing value: Value '67383398' is below minimum 939524096 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]': finished 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: osdmap e41: 8 total, 7 up, 8 in 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[49458]: from='osd.7 v2:192.168.123.111:6812/1070708555' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: Detected new or changed devices on vm11 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: Adjusting osd_memory_target on vm11 to 65804k 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: Unable to set osd_memory_target on vm11 to 67383398: error parsing value: Value '67383398' is below minimum 939524096 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]': finished 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: osdmap e41: 8 total, 7 up, 8 in 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:25.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:24 vm09 ceph-mon[56118]: from='osd.7 v2:192.168.123.111:6812/1070708555' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: Detected new or changed devices on vm11 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: Adjusting osd_memory_target on vm11 to 65804k 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: Unable to set osd_memory_target on vm11 to 67383398: error parsing value: Value '67383398' is below minimum 939524096 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]': finished 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: osdmap e41: 8 total, 7 up, 8 in 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:24 vm11 ceph-mon[53379]: from='osd.7 v2:192.168.123.111:6812/1070708555' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]: dispatch 2026-03-09T00:31:25.450 INFO:journalctl@ceph.osd.7.vm11.stdout:Mar 09 00:31:25 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-7[73084]: 2026-03-09T00:31:25.045+0000 7f0b30e7a640 -1 osd.7 0 waiting for initial osdmap 2026-03-09T00:31:25.450 INFO:journalctl@ceph.osd.7.vm11.stdout:Mar 09 00:31:25 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-osd-7[73084]: 2026-03-09T00:31:25.052+0000 7f0b2cca4640 -1 osd.7 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:31:26.099 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd stat -f json 2026-03-09T00:31:26.269 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[49458]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail; 67 KiB/s, 0 objects/s recovering 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1384787858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[49458]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[49458]: osdmap e42: 8 total, 7 up, 8 in 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[56118]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail; 67 KiB/s, 0 objects/s recovering 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1384787858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[56118]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[56118]: osdmap e42: 8 total, 7 up, 8 in 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:26.292 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:25 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:26.386 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/4032814588 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 msgr2=0x7f8d98079f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.386 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/4032814588 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 0x7f8d98079f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b0a0 tx=0x7f8d9402f450 comp rx=0 tx=0).stop 2026-03-09T00:31:26.386 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/4032814588 shutdown_connections 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/4032814588 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 0x7f8d98079f30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/4032814588 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d98078cf0 0x7f8d98079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/4032814588 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d98077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/4032814588 >> 192.168.123.109:0/4032814588 conn(0x7f8d981004e0 msgr2=0x7f8d98102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.387+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/4032814588 shutdown_connections 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/4032814588 wait complete. 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 Processor -- start 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 -- start start 2026-03-09T00:31:26.387 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d981a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.388 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d98078cf0 0x7f8d981a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.388 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 0x7f8d981a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.388 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98114420 con 0x7f8d98079690 2026-03-09T00:31:26.388 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8d981142a0 con 0x7f8d98078cf0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9fe1e640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f8d981145a0 con 0x7f8d98077aa0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9db93640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d981a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.388+0000 7f8d9db93640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d981a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:32882/0 (socket says 192.168.123.109:32882) 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 -- 192.168.123.109:0/62030119 learned_addr learned my addr 192.168.123.109:0/62030119 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 -- 192.168.123.109:0/62030119 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d98078cf0 msgr2=0x7f8d981a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d98078cf0 0x7f8d981a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 -- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 msgr2=0x7f8d981a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 0x7f8d981a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 -- 192.168.123.109:0/62030119 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d981a86b0 con 0x7f8d98077aa0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9db93640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d981a09f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c002a10 tx=0x7f8d8c002ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00ecc0 con 0x7f8d98077aa0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f8d8c00ee60 con 0x7f8d98077aa0 2026-03-09T00:31:26.389 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c018810 con 0x7f8d98077aa0 2026-03-09T00:31:26.390 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d981047f0 con 0x7f8d98077aa0 2026-03-09T00:31:26.390 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.389+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d98104ce0 con 0x7f8d98077aa0 2026-03-09T00:31:26.390 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.391+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f8d8c0189b0 con 0x7f8d98077aa0 2026-03-09T00:31:26.390 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.391+0000 7f8d86ffd640 1 --2- 192.168.123.109:0/62030119 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d68077600 0x7f8d68079ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.390 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.391+0000 7f8d9d392640 1 --2- 192.168.123.109:0/62030119 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d68077600 0x7f8d68079ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:26.393 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.392+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 4094+0+0 (secure 0 0 0) 0x7f8d8c09a890 con 0x7f8d98077aa0 2026-03-09T00:31:26.393 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.392+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d64005180 con 0x7f8d98077aa0 2026-03-09T00:31:26.394 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.395+0000 7f8d9d392640 1 --2- 192.168.123.109:0/62030119 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d68077600 0x7f8d68079ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8d981a1f10 tx=0x7f8d88005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:26.394 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.395+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8d8c014030 con 0x7f8d98077aa0 2026-03-09T00:31:26.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:25 vm11 ceph-mon[53379]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail; 67 KiB/s, 0 objects/s recovering 2026-03-09T00:31:26.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:25 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1384787858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:26.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:25 vm11 ceph-mon[53379]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm11", "root=default"]}]': finished 2026-03-09T00:31:26.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:25 vm11 ceph-mon[53379]: osdmap e42: 8 total, 7 up, 8 in 2026-03-09T00:31:26.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:26.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:25 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:26.487 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.487+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8d64005470 con 0x7f8d98077aa0 2026-03-09T00:31:26.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.489+0000 7f8d86ffd640 1 -- 192.168.123.109:0/62030119 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v43) ==== 74+0+130 (secure 0 0 0) 0x7f8d8c064e20 con 0x7f8d98077aa0 2026-03-09T00:31:26.488 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d68077600 msgr2=0x7f8d68079ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/62030119 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d68077600 0x7f8d68079ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8d981a1f10 tx=0x7f8d88005de0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 msgr2=0x7f8d981a09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d981a09f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c002a10 tx=0x7f8d8c002ee0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 shutdown_connections 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/62030119 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d68077600 0x7f8d68079ac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d98079690 0x7f8d981a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d98078cf0 0x7f8d981a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 --2- 192.168.123.109:0/62030119 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d98077aa0 0x7f8d981a09f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.490 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 >> 192.168.123.109:0/62030119 conn(0x7f8d981004e0 msgr2=0x7f8d98101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:26.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.491+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 shutdown_connections 2026-03-09T00:31:26.491 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.492+0000 7f8d9fe1e640 1 -- 192.168.123.109:0/62030119 wait complete. 2026-03-09T00:31:26.554 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":43,"num_osds":8,"num_up_osds":8,"osd_up_since":1773016286,"num_in_osds":8,"osd_in_since":1773016276,"num_remapped_pgs":1} 2026-03-09T00:31:26.555 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd dump --format=json 2026-03-09T00:31:26.735 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:26.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.863+0000 7f55606f7640 1 -- 192.168.123.109:0/325079835 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 msgr2=0x7f5558111780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.863+0000 7f55606f7640 1 --2- 192.168.123.109:0/325079835 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f5558111780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f555400b0a0 tx=0x7f555402f4c0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 -- 192.168.123.109:0/325079835 shutdown_connections 2026-03-09T00:31:26.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 --2- 192.168.123.109:0/325079835 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f5558111780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 --2- 192.168.123.109:0/325079835 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f5558075d30 0x7f555810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 --2- 192.168.123.109:0/325079835 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075410 0x7f55580757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.864 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 -- 192.168.123.109:0/325079835 >> 192.168.123.109:0/325079835 conn(0x7f55580fe770 msgr2=0x7f5558100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:26.864 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 -- 192.168.123.109:0/325079835 shutdown_connections 2026-03-09T00:31:26.864 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.864+0000 7f55606f7640 1 -- 192.168.123.109:0/325079835 wait complete. 2026-03-09T00:31:26.864 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 Processor -- start 2026-03-09T00:31:26.864 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 -- start start 2026-03-09T00:31:26.864 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f5558075410 0x7f55581a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075d30 0x7f55581a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f555819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f55581145a0 con 0x7f555810f390 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5558114420 con 0x7f5558075410 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f55606f7640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f5558114720 con 0x7f5558075d30 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.865+0000 7f555dc6b640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075d30 0x7f55581a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555ec6d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f555819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555ec6d640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f555819c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:50840/0 (socket says 192.168.123.109:50840) 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555ec6d640 1 -- 192.168.123.109:0/1998558475 learned_addr learned my addr 192.168.123.109:0/1998558475 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555e46c640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f5558075410 0x7f55581a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555dc6b640 1 -- 192.168.123.109:0/1998558475 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f5558075410 msgr2=0x7f55581a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555dc6b640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f5558075410 0x7f55581a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555dc6b640 1 -- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 msgr2=0x7f555819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.865 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555dc6b640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f555819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.866 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555dc6b640 1 -- 192.168.123.109:0/1998558475 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555819d0a0 con 0x7f5558075d30 2026-03-09T00:31:26.866 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.866+0000 7f555ec6d640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f555819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:26.866 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.867+0000 7f555dc6b640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075d30 0x7f55581a2c50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f554800d730 tx=0x7f554800dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:26.866 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.867+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548014070 con 0x7f5558075d30 2026-03-09T00:31:26.867 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.867+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f55480044e0 con 0x7f5558075d30 2026-03-09T00:31:26.867 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.867+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554800be30 con 0x7f5558075d30 2026-03-09T00:31:26.867 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.868+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555819d390 con 0x7f5558075d30 2026-03-09T00:31:26.868 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.868+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55581a95e0 con 0x7f5558075d30 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.869+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5520005180 con 0x7f5558075d30 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.869+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f55480047c0 con 0x7f5558075d30 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.872+0000 7f553f7fe640 1 --2- 192.168.123.109:0/1998558475 >> v2:192.168.123.109:6800/82853931 conn(0x7f5534077620 0x7f5534079ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.872+0000 7f555e46c640 1 --2- 192.168.123.109:0/1998558475 >> v2:192.168.123.109:6800/82853931 conn(0x7f5534077620 0x7f5534079ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.873+0000 7f555e46c640 1 --2- 192.168.123.109:0/1998558475 >> v2:192.168.123.109:6800/82853931 conn(0x7f5534077620 0x7f5534079ae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f554c005e00 tx=0x7f554c005d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.873+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 4094+0+0 (secure 0 0 0) 0x7f554805d850 con 0x7f5558075d30 2026-03-09T00:31:26.872 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.873+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5548061bb0 con 0x7f5558075d30 2026-03-09T00:31:26.966 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.967+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5520005740 con 0x7f5558075d30 2026-03-09T00:31:26.967 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.968+0000 7f553f7fe640 1 -- 192.168.123.109:0/1998558475 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+11684 (secure 0 0 0) 0x7f5548065860 con 0x7f5558075d30 2026-03-09T00:31:26.967 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:26.967 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":43,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","created":"2026-03-09T00:29:07.790682+0000","modified":"2026-03-09T00:31:26.043166+0000","last_up_change":"2026-03-09T00:31:26.043166+0000","last_in_change":"2026-03-09T00:31:16.093998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T00:30:36.800055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"358ee389-cb78-4018-b8af-afdaff60ba71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6801","nonce":3241136735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6802","nonce":3241136735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6804","nonce":3241136735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6803","nonce":3241136735}]},"public_addr":"192.168.123.109:6801/3241136735","cluster_addr":"192.168.123.109:6802/3241136735","heartbeat_back_addr":"192.168.123.109:6804/3241136735","heartbeat_front_addr":"192.168.123.109:6803/3241136735","state":["exists","up"]},{"osd":1,"uuid":"504373ca-3989-4555-acb0-64b55de70bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6805","nonce":64355271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6806","nonce":64355271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6808","nonce":64355271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6807","nonce":64355271}]},"public_addr":"192.168.123.109:6805/64355271","cluster_addr":"192.168.123.109:6806/64355271","heartbeat_back_addr":"192.168.123.109:6808/64355271","heartbeat_front_addr":"192.168.123.109:6807/64355271","state":["exists","up"]},{"osd":2,"uuid":"d1e4aed4-61e3-4b5c-90eb-fd9480495a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6809","nonce":1100722638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6810","nonce":1100722638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6812","nonce":1100722638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6811","nonce":1100722638}]},"public_addr":"192.168.123.109:6809/1100722638","cluster_addr":"192.168.123.109:6810/1100722638","heartbeat_back_addr":"192.168.123.109:6812/1100722638","heartbeat_front_addr":"192.168.123.109:6811/1100722638","state":["exists","up"]},{"osd":3,"uuid":"f49ec9f2-9291-4311-ba8a-82828daa1996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6813","nonce":3343463680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6814","nonce":3343463680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6816","nonce":3343463680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6815","nonce":3343463680}]},"public_addr":"192.168.123.109:6813/3343463680","cluster_addr":"192.168.123.109:6814/3343463680","heartbeat_back_addr":"192.168.123.109:6816/3343463680","heartbeat_front_addr":"192.168.123.109:6815/3343463680","state":["exists","up"]},{"osd":4,"uuid":"074c1bd5-fecc-49fc-9e3b-607b8dab9818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6800","nonce":3070266009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6801","nonce":3070266009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6803","nonce":3070266009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6802","nonce":3070266009}]},"public_addr":"192.168.123.111:6800/3070266009","cluster_addr":"192.168.123.111:6801/3070266009","heartbeat_back_addr":"192.168.123.111:6803/3070266009","heartbeat_front_addr":"192.168.123.111:6802/3070266009","state":["exists","up"]},{"osd":5,"uuid":"8b4995fe-c439-4efc-a4cb-c80f3db969f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6804","nonce":833555371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6805","nonce":833555371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6807","nonce":833555371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6806","nonce":833555371}]},"public_addr":"192.168.123.111:6804/833555371","cluster_addr":"192.168.123.111:6805/833555371","heartbeat_back_addr":"192.168.123.111:6807/833555371","heartbeat_front_addr":"192.168.123.111:6806/833555371","state":["exists","up"]},{"osd":6,"uuid":"6529eea0-0bdd-40e2-b756-3a71b118612f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6808","nonce":11447683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6809","nonce":11447683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6811","nonce":11447683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6810","nonce":11447683}]},"public_addr":"192.168.123.111:6808/11447683","cluster_addr":"192.168.123.111:6809/11447683","heartbeat_back_addr":"192.168.123.111:6811/11447683","heartbeat_front_addr":"192.168.123.111:6810/11447683","state":["exists","up"]},{"osd":7,"uuid":"bf0064f2-9c2f-412d-8e15-98b229eaeb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6812","nonce":1070708555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6813","nonce":1070708555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6815","nonce":1070708555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6814","nonce":1070708555}]},"public_addr":"192.168.123.111:6812/1070708555","cluster_addr":"192.168.123.111:6813/1070708555","heartbeat_back_addr":"192.168.123.111:6815/1070708555","heartbeat_front_addr":"192.168.123.111:6814/1070708555","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:13.064912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:23.835218+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:34.626774+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:44.929867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:53.921929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:05.125931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:14.307281+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,6,1]}],"primary_temp":[],"blocklist":{"192.168.123.109:6800/3433497319":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/461406719":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/1425409227":"2026-03-10T00:29:30.753036+0000","192.168.123.109:6800/770453877":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/3155151110":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/3016244507":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/252573567":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/3848899338":"2026-03-10T00:29:20.267467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T00:31:26.969 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 >> v2:192.168.123.109:6800/82853931 conn(0x7f5534077620 msgr2=0x7f5534079ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.969 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 --2- 192.168.123.109:0/1998558475 >> v2:192.168.123.109:6800/82853931 conn(0x7f5534077620 0x7f5534079ae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f554c005e00 tx=0x7f554c005d70 comp rx=0 tx=0).stop 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075d30 msgr2=0x7f55581a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075d30 0x7f55581a2c50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f554800d730 tx=0x7f554800dc00 comp rx=0 tx=0).stop 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 shutdown_connections 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 --2- 192.168.123.109:0/1998558475 >> v2:192.168.123.109:6800/82853931 conn(0x7f5534077620 0x7f5534079ae0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f555810f390 0x7f555819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f5558075d30 0x7f55581a2c50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 --2- 192.168.123.109:0/1998558475 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f5558075410 0x7f55581a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.970+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 >> 192.168.123.109:0/1998558475 conn(0x7f55580fe770 msgr2=0x7f55580ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.971+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 shutdown_connections 2026-03-09T00:31:26.970 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:26.971+0000 7f55606f7640 1 -- 192.168.123.109:0/1998558475 wait complete. 2026-03-09T00:31:27.050 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-03-09T00:30:36.800055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-03-09T00:31:27.050 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd pool get .mgr pg_num 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: purged_snaps scrub starts 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: purged_snaps scrub ok 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: osd.7 v2:192.168.123.111:6812/1070708555 boot 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: osdmap e43: 8 total, 8 up, 8 in 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/62030119' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1998558475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: purged_snaps scrub starts 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: purged_snaps scrub ok 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: osd.7 v2:192.168.123.111:6812/1070708555 boot 2026-03-09T00:31:27.081 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: osdmap e43: 8 total, 8 up, 8 in 2026-03-09T00:31:27.082 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:27.082 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/62030119' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:27.082 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:26 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1998558475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:27.241 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.370+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/2169309989 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd8104f40 msgr2=0x7f8bd8105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.370+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/2169309989 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd8104f40 0x7f8bd8105320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009a30 tx=0x7f8bcc02f260 comp rx=0 tx=0).stop 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/2169309989 shutdown_connections 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/2169309989 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8bd810a070 0x7f8bd8111bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/2169309989 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd8109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/2169309989 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd8104f40 0x7f8bd8105320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/2169309989 >> 192.168.123.109:0/2169309989 conn(0x7f8bd81009e0 msgr2=0x7f8bd8102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/2169309989 shutdown_connections 2026-03-09T00:31:27.370 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.371+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/2169309989 wait complete. 2026-03-09T00:31:27.371 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bdcbbe640 1 Processor -- start 2026-03-09T00:31:27.371 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bdcbbe640 1 -- start start 2026-03-09T00:31:27.371 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bdcbbe640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8bd8104f40 0x7f8bd81a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.371 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bdcbbe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd81a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.371 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bdcbbe640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd810a070 0x7f8bd819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.371 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bd5d74640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd81a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bd5d74640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd81a2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:50844/0 (socket says 192.168.123.109:50844) 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bd5d74640 1 -- 192.168.123.109:0/4010619944 learned_addr learned my addr 192.168.123.109:0/4010619944 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.372+0000 7f8bd6d76640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd810a070 0x7f8bd819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81145b0 con 0x7f8bd81058f0 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8114430 con 0x7f8bd8104f40 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd8114730 con 0x7f8bd810a070 2026-03-09T00:31:27.372 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd6575640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8bd8104f40 0x7f8bd81a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd6d76640 1 -- 192.168.123.109:0/4010619944 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8bd8104f40 msgr2=0x7f8bd81a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd6d76640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8bd8104f40 0x7f8bd81a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd6d76640 1 -- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 msgr2=0x7f8bd81a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd6d76640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd81a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd6d76640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd819d0d0 con 0x7f8bd810a070 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.373+0000 7f8bd5d74640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd81a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.374+0000 7f8bd6d76640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd810a070 0x7f8bd819c9a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800be20 tx=0x7f8bc800bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.374+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8006e60 con 0x7f8bd810a070 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.374+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd819d3c0 con 0x7f8bd810a070 2026-03-09T00:31:27.373 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.374+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd81a96b0 con 0x7f8bd810a070 2026-03-09T00:31:27.375 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.374+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f8bc8010070 con 0x7f8bd810a070 2026-03-09T00:31:27.375 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.374+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8015470 con 0x7f8bd810a070 2026-03-09T00:31:27.375 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.376+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f8bc800ca80 con 0x7f8bd810a070 2026-03-09T00:31:27.375 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.376+0000 7f8bc37fe640 1 --2- 192.168.123.109:0/4010619944 >> v2:192.168.123.109:6800/82853931 conn(0x7f8ba00776a0 0x7f8ba0079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.377+0000 7f8bd6575640 1 --2- 192.168.123.109:0/4010619944 >> v2:192.168.123.109:6800/82853931 conn(0x7f8ba00776a0 0x7f8ba0079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.377+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(44..44 src has 1..44) ==== 4061+0+0 (secure 0 0 0) 0x7f8bc8098d40 con 0x7f8bd810a070 2026-03-09T00:31:27.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.377+0000 7f8bd6575640 1 --2- 192.168.123.109:0/4010619944 >> v2:192.168.123.109:6800/82853931 conn(0x7f8ba00776a0 0x7f8ba0079b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc002410 tx=0x7f8bcc03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:27.376 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.377+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4005180 con 0x7f8bd810a070 2026-03-09T00:31:27.379 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.380+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8bc8062740 con 0x7f8bd810a070 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: purged_snaps scrub starts 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: purged_snaps scrub ok 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: osd.7 v2:192.168.123.111:6812/1070708555 boot 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: osdmap e43: 8 total, 8 up, 8 in 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/62030119' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:27.451 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:26 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1998558475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:27.474 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.474+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ba4005c80 con 0x7f8bd810a070 2026-03-09T00:31:27.474 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.475+0000 7f8bc37fe640 1 -- 192.168.123.109:0/4010619944 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) ==== 93+0+10 (secure 0 0 0) 0x7f8bc80663f0 con 0x7f8bd810a070 2026-03-09T00:31:27.474 INFO:teuthology.orchestra.run.vm09.stdout:pg_num: 1 2026-03-09T00:31:27.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 >> v2:192.168.123.109:6800/82853931 conn(0x7f8ba00776a0 msgr2=0x7f8ba0079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/4010619944 >> v2:192.168.123.109:6800/82853931 conn(0x7f8ba00776a0 0x7f8ba0079b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc002410 tx=0x7f8bcc03a040 comp rx=0 tx=0).stop 2026-03-09T00:31:27.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd810a070 msgr2=0x7f8bd819c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd810a070 0x7f8bd819c9a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800be20 tx=0x7f8bc800bf20 comp rx=0 tx=0).stop 2026-03-09T00:31:27.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 shutdown_connections 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/4010619944 >> v2:192.168.123.109:6800/82853931 conn(0x7f8ba00776a0 0x7f8ba0079b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8bd810a070 0x7f8bd819c9a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.477+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8bd81058f0 0x7f8bd81a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.478+0000 7f8bdcbbe640 1 --2- 192.168.123.109:0/4010619944 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8bd8104f40 0x7f8bd81a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.478+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 >> 192.168.123.109:0/4010619944 conn(0x7f8bd81009e0 msgr2=0x7f8bd81010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.478+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 shutdown_connections 2026-03-09T00:31:27.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:27.478+0000 7f8bdcbbe640 1 -- 192.168.123.109:0/4010619944 wait complete. 2026-03-09T00:31:27.522 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on vm09 2026-03-09T00:31:27.522 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply rgw foo.a --placement '1;vm09=foo.a' 2026-03-09T00:31:27.692 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.822+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/2329319152 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a41035c0 msgr2=0x7fe2a41059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.822+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/2329319152 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a41035c0 0x7fe2a41059b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe298009a30 tx=0x7fe29802f260 comp rx=0 tx=0).stop 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/2329319152 shutdown_connections 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/2329319152 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a4108820 0x7fe2a410ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/2329319152 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe2a4105ef0 0x7fe2a41082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/2329319152 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a41035c0 0x7fe2a41059b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/2329319152 >> 192.168.123.111:0/2329319152 conn(0x7fe2a40fd140 msgr2=0x7fe2a40ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/2329319152 shutdown_connections 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.823+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/2329319152 wait complete. 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 Processor -- start 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 -- start start 2026-03-09T00:31:27.822 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 0x7fe2a419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe2a4105ef0 0x7fe2a419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a4108820 0x7fe2a41a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a410dcc0 con 0x7fe2a41035c0 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a410db40 con 0x7fe2a4108820 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2ab4dc640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a410de40 con 0x7fe2a4105ef0 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2a9251640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 0x7fe2a419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2a9251640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 0x7fe2a419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:38000/0 (socket says 192.168.123.111:38000) 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2a9251640 1 -- 192.168.123.111:0/164166786 learned_addr learned my addr 192.168.123.111:0/164166786 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2a9251640 1 -- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe2a4105ef0 msgr2=0x7fe2a419ce90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-03-09T00:31:27.823 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.824+0000 7fe2a9251640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe2a4105ef0 0x7fe2a419ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.825+0000 7fe2a9251640 1 -- 192.168.123.111:0/164166786 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a4108820 msgr2=0x7fe2a41a3f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:27.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.825+0000 7fe2a9a52640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a4108820 0x7fe2a41a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.825+0000 7fe2a9251640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a4108820 0x7fe2a41a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.825+0000 7fe2a9251640 1 -- 192.168.123.111:0/164166786 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a41a4610 con 0x7fe2a41035c0 2026-03-09T00:31:27.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.825+0000 7fe2a9a52640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a4108820 0x7fe2a41a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:27.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.825+0000 7fe2a9251640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 0x7fe2a419c950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe298002b30 tx=0x7fe29802fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:27.825 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.826+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298004030 con 0x7fe2a41035c0 2026-03-09T00:31:27.825 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.826+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fe298038770 con 0x7fe2a41035c0 2026-03-09T00:31:27.825 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.826+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298042790 con 0x7fe2a41035c0 2026-03-09T00:31:27.825 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.826+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a41a48a0 con 0x7fe2a41035c0 2026-03-09T00:31:27.825 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.826+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a41a4db0 con 0x7fe2a41035c0 2026-03-09T00:31:27.826 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.827+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fe2980041d0 con 0x7fe2a41035c0 2026-03-09T00:31:27.826 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.827+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26c005180 con 0x7fe2a41035c0 2026-03-09T00:31:27.826 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.827+0000 7fe2927fc640 1 --2- 192.168.123.111:0/164166786 >> v2:192.168.123.109:6800/82853931 conn(0x7fe280077600 0x7fe280079ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:27.826 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.828+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4061+0+0 (secure 0 0 0) 0x7fe2980bda70 con 0x7fe2a41035c0 2026-03-09T00:31:27.826 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.828+0000 7fe2a8a50640 1 --2- 192.168.123.111:0/164166786 >> v2:192.168.123.109:6800/82853931 conn(0x7fe280077600 0x7fe280079ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:27.827 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.828+0000 7fe2a8a50640 1 --2- 192.168.123.111:0/164166786 >> v2:192.168.123.109:6800/82853931 conn(0x7fe280077600 0x7fe280079ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe2a419de70 tx=0x7fe294006d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:27.829 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.831+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe2980873f0 con 0x7fe2a41035c0 2026-03-09T00:31:27.927 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.928+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm09=foo.a", "target": ["mon-mgr", ""]}) -- 0x7fe26c002bf0 con 0x7fe280077600 2026-03-09T00:31:27.934 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.935+0000 7fe2927fc640 1 -- 192.168.123.111:0/164166786 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7fe26c002bf0 con 0x7fe280077600 2026-03-09T00:31:27.935 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled rgw.foo.a update... 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.938+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 >> v2:192.168.123.109:6800/82853931 conn(0x7fe280077600 msgr2=0x7fe280079ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.938+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/164166786 >> v2:192.168.123.109:6800/82853931 conn(0x7fe280077600 0x7fe280079ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe2a419de70 tx=0x7fe294006d20 comp rx=0 tx=0).stop 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.938+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 msgr2=0x7fe2a419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.938+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 0x7fe2a419c950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe298002b30 tx=0x7fe29802fc90 comp rx=0 tx=0).stop 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.938+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 shutdown_connections 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.938+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/164166786 >> v2:192.168.123.109:6800/82853931 conn(0x7fe280077600 0x7fe280079ac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.939+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe2a4108820 0x7fe2a41a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.939+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe2a4105ef0 0x7fe2a419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.939+0000 7fe2ab4dc640 1 --2- 192.168.123.111:0/164166786 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe2a41035c0 0x7fe2a419c950 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:27.937 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.939+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 >> 192.168.123.111:0/164166786 conn(0x7fe2a40fd140 msgr2=0x7fe2a4101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:27.938 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.939+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 shutdown_connections 2026-03-09T00:31:27.938 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:27.939+0000 7fe2ab4dc640 1 -- 192.168.123.111:0/164166786 wait complete. 2026-03-09T00:31:28.000 DEBUG:teuthology.orchestra.run.vm09:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@rgw.foo.a.service 2026-03-09T00:31:28.003 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on vm11 2026-03-09T00:31:28.003 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd pool create datapool 3 3 replicated 2026-03-09T00:31:28.187 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:28.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: pgmap v91: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: osdmap e44: 8 total, 8 up, 8 in 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/4010619944' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:28 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 -- 192.168.123.111:0/2518606011 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4406b4b0 msgr2=0x7f9f4406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 --2- 192.168.123.111:0/2518606011 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4406b4b0 0x7f9f4406b8b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009960 tx=0x7f9f3802f140 comp rx=0 tx=0).stop 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 -- 192.168.123.111:0/2518606011 shutdown_connections 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 --2- 192.168.123.111:0/2518606011 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f4410ae10 0x7f9f4410f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 --2- 192.168.123.111:0/2518606011 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4410a470 0x7f9f4410a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 --2- 192.168.123.111:0/2518606011 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4406b4b0 0x7f9f4406b8b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.309+0000 7f9f493a6640 1 -- 192.168.123.111:0/2518606011 >> 192.168.123.111:0/2518606011 conn(0x7f9f44070950 msgr2=0x7f9f44072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.310+0000 7f9f493a6640 1 -- 192.168.123.111:0/2518606011 shutdown_connections 2026-03-09T00:31:28.308 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.310+0000 7f9f493a6640 1 -- 192.168.123.111:0/2518606011 wait complete. 2026-03-09T00:31:28.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.310+0000 7f9f493a6640 1 Processor -- start 2026-03-09T00:31:28.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.310+0000 7f9f493a6640 1 -- start start 2026-03-09T00:31:28.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.310+0000 7f9f493a6640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 0x7f9f441a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:28.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f493a6640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f4410a470 0x7f9f441a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:28.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f493a6640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4410ae10 0x7f9f441b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:28.309 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 0x7f9f441a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:28.310 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 0x7f9f441a9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.111:52794/0 (socket says 192.168.123.111:52794) 2026-03-09T00:31:28.310 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f493a6640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4411cd80 con 0x7f9f4410a470 2026-03-09T00:31:28.310 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f493a6640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4411cc00 con 0x7f9f4406b4b0 2026-03-09T00:31:28.310 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f493a6640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4411cf00 con 0x7f9f4410ae10 2026-03-09T00:31:28.310 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 -- 192.168.123.111:0/3317044073 learned_addr learned my addr 192.168.123.111:0/3317044073 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 -- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4410ae10 msgr2=0x7f9f441b0a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4410ae10 0x7f9f441b0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 -- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f4410a470 msgr2=0x7f9f441a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f427fc640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f4410a470 0x7f9f441a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f4410a470 0x7f9f441a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 -- 192.168.123.111:0/3317044073 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f441b1120 con 0x7f9f4406b4b0 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.311+0000 7f9f42ffd640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 0x7f9f441a9460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009930 tx=0x7f9f3802ff40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.312+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38004280 con 0x7f9f4406b4b0 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.312+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f9f38004420 con 0x7f9f4406b4b0 2026-03-09T00:31:28.311 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.312+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f441b13b0 con 0x7f9f4406b4b0 2026-03-09T00:31:28.315 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.312+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f441b1890 con 0x7f9f4406b4b0 2026-03-09T00:31:28.315 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.313+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38005620 con 0x7f9f4406b4b0 2026-03-09T00:31:28.315 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.314+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f9f38038510 con 0x7f9f4406b4b0 2026-03-09T00:31:28.315 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.314+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4406b8b0 con 0x7f9f4406b4b0 2026-03-09T00:31:28.316 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.317+0000 7f9f27fff640 1 --2- 192.168.123.111:0/3317044073 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f1c0776d0 0x7f9f1c079b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:28.316 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.317+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4061+0+0 (secure 0 0 0) 0x7f9f380be420 con 0x7f9f4406b4b0 2026-03-09T00:31:28.316 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.317+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9f38004d30 con 0x7f9f4406b4b0 2026-03-09T00:31:28.316 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.317+0000 7f9f427fc640 1 --2- 192.168.123.111:0/3317044073 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f1c0776d0 0x7f9f1c079b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:28.318 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.318+0000 7f9f427fc640 1 --2- 192.168.123.111:0/3317044073 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f1c0776d0 0x7f9f1c079b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9f441aa980 tx=0x7f9f30009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: pgmap v91: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: osdmap e44: 8 total, 8 up, 8 in 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/4010619944' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: pgmap v91: 1 pgs: 1 active+clean; 449 KiB data, 187 MiB used, 140 GiB / 140 GiB avail; 75 KiB/s, 0 objects/s recovering 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: osdmap e44: 8 total, 8 up, 8 in 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/4010619944' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:28.321 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:28 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:28.414 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:28.415+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7f9f44063880 con 0x7f9f4406b4b0 2026-03-09T00:31:28.595 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 systemd[1]: Starting Ceph rgw.foo.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm09=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: Saving service rgw.foo.a spec with placement vm09=foo.a;count:1 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: Deploying daemon rgw.foo.a on vm09 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: osdmap e45: 8 total, 8 up, 8 in 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/3317044073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm09=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: Saving service rgw.foo.a spec with placement vm09=foo.a;count:1 2026-03-09T00:31:29.070 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: Deploying daemon rgw.foo.a on vm09 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: osdmap e45: 8 total, 8 up, 8 in 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/3317044073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.071 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:29 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:29.071 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 podman[79368]: 2026-03-09 00:31:28.698355129 +0000 UTC m=+0.017531494 container create 347ee5709c922d2c6953acc8c63fe457b3ab6c48b0be72c2aa3811fc7f8943fe (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-rgw-foo-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2026-03-09T00:31:29.071 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 podman[79368]: 2026-03-09 00:31:28.739849741 +0000 UTC m=+0.059026106 container init 347ee5709c922d2c6953acc8c63fe457b3ab6c48b0be72c2aa3811fc7f8943fe (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-rgw-foo-a, io.buildah.version=1.41.3, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260223, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T00:31:29.071 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 podman[79368]: 2026-03-09 00:31:28.7428577 +0000 UTC m=+0.062034065 container start 347ee5709c922d2c6953acc8c63fe457b3ab6c48b0be72c2aa3811fc7f8943fe (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-rgw-foo-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T00:31:29.071 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 bash[79368]: 347ee5709c922d2c6953acc8c63fe457b3ab6c48b0be72c2aa3811fc7f8943fe 2026-03-09T00:31:29.071 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 podman[79368]: 2026-03-09 00:31:28.69084295 +0000 UTC m=+0.010019315 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T00:31:29.071 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:28 vm09 systemd[1]: Started Ceph rgw.foo.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:31:29.084 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.085+0000 7f9f27fff640 1 -- 192.168.123.111:0/3317044073 <== mon.1 v2:192.168.123.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v46) ==== 160+0+0 (secure 0 0 0) 0x7f9f38087f20 con 0x7f9f4406b4b0 2026-03-09T00:31:29.084 INFO:teuthology.orchestra.run.vm11.stderr:pool 'datapool' created 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f1c0776d0 msgr2=0x7f9f1c079b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 --2- 192.168.123.111:0/3317044073 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f1c0776d0 0x7f9f1c079b90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9f441aa980 tx=0x7f9f30009340 comp rx=0 tx=0).stop 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 msgr2=0x7f9f441a9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 0x7f9f441a9460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009930 tx=0x7f9f3802ff40 comp rx=0 tx=0).stop 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 shutdown_connections 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 --2- 192.168.123.111:0/3317044073 >> v2:192.168.123.109:6800/82853931 conn(0x7f9f1c0776d0 0x7f9f1c079b90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9f4410ae10 0x7f9f441b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f9f4410a470 0x7f9f441a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 --2- 192.168.123.111:0/3317044073 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9f4406b4b0 0x7f9f441a9460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 >> 192.168.123.111:0/3317044073 conn(0x7f9f44070950 msgr2=0x7f9f4410b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 shutdown_connections 2026-03-09T00:31:29.087 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:29.088+0000 7f9f493a6640 1 -- 192.168.123.111:0/3317044073 wait complete. 2026-03-09T00:31:29.137 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- rbd pool init datapool 2026-03-09T00:31:29.323 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:29.349 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm09=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: Saving service rgw.foo.a spec with placement vm09=foo.a;count:1 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: Deploying daemon rgw.foo.a on vm09 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: osdmap e45: 8 total, 8 up, 8 in 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/3317044073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:29.350 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:29 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: pgmap v94: 1 pgs: 1 remapped+peering; 449 KiB data, 214 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: Saving service rgw.foo.a spec with placement vm09=foo.a;count:1 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: osdmap e46: 8 total, 8 up, 8 in 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/70199265' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/2090256149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: Checking dashboard <-> RGW credentials 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: pgmap v94: 1 pgs: 1 remapped+peering; 449 KiB data, 214 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: Saving service rgw.foo.a spec with placement vm09=foo.a;count:1 2026-03-09T00:31:30.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: osdmap e46: 8 total, 8 up, 8 in 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/70199265' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/2090256149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: Checking dashboard <-> RGW credentials 2026-03-09T00:31:30.431 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:30 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: pgmap v94: 1 pgs: 1 remapped+peering; 449 KiB data, 214 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:30.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: Saving service rgw.foo.a spec with placement vm09=foo.a;count:1 2026-03-09T00:31:30.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2026-03-09T00:31:30.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: osdmap e46: 8 total, 8 up, 8 in 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/70199265' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/2090256149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: Checking dashboard <-> RGW credentials 2026-03-09T00:31:30.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:30 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:31.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:31 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T00:31:31.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:31 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2026-03-09T00:31:31.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:31 vm09 ceph-mon[56118]: osdmap e47: 8 total, 8 up, 8 in 2026-03-09T00:31:31.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:31 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T00:31:31.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:31 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2026-03-09T00:31:31.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:31 vm09 ceph-mon[49458]: osdmap e47: 8 total, 8 up, 8 in 2026-03-09T00:31:31.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:31 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T00:31:31.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:31 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2026-03-09T00:31:31.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:31 vm11 ceph-mon[53379]: osdmap e47: 8 total, 8 up, 8 in 2026-03-09T00:31:32.835 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 192.168.123.111 --placement '1;vm11=iscsi.a' 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[49458]: pgmap v97: 36 pgs: 7 active+clean, 28 unknown, 1 remapped+peering; 449 KiB data, 213 MiB used, 160 GiB / 160 GiB avail; 255 B/s wr, 0 op/s 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[49458]: osdmap e48: 8 total, 8 up, 8 in 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[56118]: pgmap v97: 36 pgs: 7 active+clean, 28 unknown, 1 remapped+peering; 449 KiB data, 213 MiB used, 160 GiB / 160 GiB avail; 255 B/s wr, 0 op/s 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[56118]: osdmap e48: 8 total, 8 up, 8 in 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:32 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:32 vm11 ceph-mon[53379]: pgmap v97: 36 pgs: 7 active+clean, 28 unknown, 1 remapped+peering; 449 KiB data, 213 MiB used, 160 GiB / 160 GiB avail; 255 B/s wr, 0 op/s 2026-03-09T00:31:32.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:32 vm11 ceph-mon[53379]: osdmap e48: 8 total, 8 up, 8 in 2026-03-09T00:31:32.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:32 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:32 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:32 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:32.950 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:32 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T00:31:33.008 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:33.135 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.136+0000 7fbb4133a640 1 -- 192.168.123.111:0/188235706 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c104d50 msgr2=0x7fbb3c105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.136+0000 7fbb4133a640 1 --2- 192.168.123.111:0/188235706 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c104d50 0x7fbb3c105150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009a80 tx=0x7fbb3002f290 comp rx=0 tx=0).stop 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 -- 192.168.123.111:0/188235706 shutdown_connections 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 --2- 192.168.123.111:0/188235706 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c106910 0x7fbb3c10d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 --2- 192.168.123.111:0/188235706 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fbb3c105f50 0x7fbb3c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 --2- 192.168.123.111:0/188235706 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c104d50 0x7fbb3c105150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 -- 192.168.123.111:0/188235706 >> 192.168.123.111:0/188235706 conn(0x7fbb3c1004e0 msgr2=0x7fbb3c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 -- 192.168.123.111:0/188235706 shutdown_connections 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.137+0000 7fbb4133a640 1 -- 192.168.123.111:0/188235706 wait complete. 2026-03-09T00:31:33.136 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.138+0000 7fbb4133a640 1 Processor -- start 2026-03-09T00:31:33.137 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.138+0000 7fbb4133a640 1 -- start start 2026-03-09T00:31:33.137 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.138+0000 7fbb4133a640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c104d50 0x7fbb3c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.137 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.138+0000 7fbb4133a640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fbb3c105f50 0x7fbb3c19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.137 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb3affd640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c104d50 0x7fbb3c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.137 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb3affd640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c104d50 0x7fbb3c19c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.111:34820/0 (socket says 192.168.123.111:34820) 2026-03-09T00:31:33.137 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb3affd640 1 -- 192.168.123.111:0/3655586340 learned_addr learned my addr 192.168.123.111:0/3655586340 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:33.138 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c106910 0x7fbb3c1a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.138 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb3b7fe640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c106910 0x7fbb3c1a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.138 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb3a7fc640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fbb3c105f50 0x7fbb3c19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.138 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c10fe80 con 0x7fbb3c105f50 2026-03-09T00:31:33.138 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.139+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c10fd00 con 0x7fbb3c106910 2026-03-09T00:31:33.138 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3c110000 con 0x7fbb3c104d50 2026-03-09T00:31:33.139 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb3b7fe640 1 -- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c104d50 msgr2=0x7fbb3c19c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.139 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb3b7fe640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c104d50 0x7fbb3c19c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.139 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb3b7fe640 1 -- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fbb3c105f50 msgr2=0x7fbb3c19cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.139 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb3b7fe640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fbb3c105f50 0x7fbb3c19cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.139 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb3b7fe640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c1a4250 con 0x7fbb3c106910 2026-03-09T00:31:33.139 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.140+0000 7fbb3b7fe640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c106910 0x7fbb3c1a3b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c004a60 tx=0x7fbb2c004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:33.140 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.141+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0090d0 con 0x7fbb3c106910 2026-03-09T00:31:33.140 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.141+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fbb2c009270 con 0x7fbb3c106910 2026-03-09T00:31:33.140 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.141+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c013610 con 0x7fbb3c106910 2026-03-09T00:31:33.140 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.141+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1a44e0 con 0x7fbb3c106910 2026-03-09T00:31:33.140 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.141+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1a49d0 con 0x7fbb3c106910 2026-03-09T00:31:33.143 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.142+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb00005180 con 0x7fbb3c106910 2026-03-09T00:31:33.144 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.145+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fbb2c025080 con 0x7fbb3c106910 2026-03-09T00:31:33.144 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.146+0000 7fbb1bfff640 1 --2- 192.168.123.111:0/3655586340 >> v2:192.168.123.109:6800/82853931 conn(0x7fbb10077650 0x7fbb10079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.144 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.146+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5199+0+0 (secure 0 0 0) 0x7fbb2c099ce0 con 0x7fbb3c106910 2026-03-09T00:31:33.145 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.146+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb2c010070 con 0x7fbb3c106910 2026-03-09T00:31:33.145 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.146+0000 7fbb3affd640 1 --2- 192.168.123.111:0/3655586340 >> v2:192.168.123.109:6800/82853931 conn(0x7fbb10077650 0x7fbb10079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.147 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.149+0000 7fbb3affd640 1 --2- 192.168.123.111:0/3655586340 >> v2:192.168.123.109:6800/82853931 conn(0x7fbb10077650 0x7fbb10079b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb30002410 tx=0x7fbb30031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:33.242 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.243+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.111", "placement": "1;vm11=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7fbb00002cc0 con 0x7fbb10077650 2026-03-09T00:31:33.250 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.251+0000 7fbb1bfff640 1 -- 192.168.123.111:0/3655586340 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (secure 0 0 0) 0x7fbb00002cc0 con 0x7fbb10077650 2026-03-09T00:31:33.250 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled iscsi.datapool update... 2026-03-09T00:31:33.252 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 >> v2:192.168.123.109:6800/82853931 conn(0x7fbb10077650 msgr2=0x7fbb10079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.252 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> v2:192.168.123.109:6800/82853931 conn(0x7fbb10077650 0x7fbb10079b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb30002410 tx=0x7fbb30031040 comp rx=0 tx=0).stop 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c106910 msgr2=0x7fbb3c1a3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c106910 0x7fbb3c1a3b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c004a60 tx=0x7fbb2c004a90 comp rx=0 tx=0).stop 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 shutdown_connections 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> v2:192.168.123.109:6800/82853931 conn(0x7fbb10077650 0x7fbb10079b10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fbb3c106910 0x7fbb3c1a3b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fbb3c105f50 0x7fbb3c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.254+0000 7fbb4133a640 1 --2- 192.168.123.111:0/3655586340 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fbb3c104d50 0x7fbb3c19c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.255+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 >> 192.168.123.111:0/3655586340 conn(0x7fbb3c1004e0 msgr2=0x7fbb3c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:33.253 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.255+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 shutdown_connections 2026-03-09T00:31:33.254 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.255+0000 7fbb4133a640 1 -- 192.168.123.111:0/3655586340 wait complete. 2026-03-09T00:31:33.294 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2026-03-09T00:31:33.294 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:31:33.294 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2026-03-09T00:31:33.323 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:31:33.323 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2026-03-09T00:31:33.349 DEBUG:teuthology.orchestra.run.vm11:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@iscsi.iscsi.a.service 2026-03-09T00:31:33.391 INFO:tasks.cephadm:Adding prometheus.a on vm11 2026-03-09T00:31:33.391 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply prometheus '1;vm11=a' 2026-03-09T00:31:33.593 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.722+0000 7fa67af5e640 1 -- 192.168.123.111:0/1729779516 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa6741024a0 msgr2=0x7fa6741005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.722+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1729779516 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa6741024a0 0x7fa6741005c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa664009a30 tx=0x7fa66402f220 comp rx=0 tx=0).stop 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.723+0000 7fa67af5e640 1 -- 192.168.123.111:0/1729779516 shutdown_connections 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.723+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1729779516 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fa674100cb0 0x7fa674102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.723+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1729779516 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa6741024a0 0x7fa6741005c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.723+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1729779516 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674101ad0 0x7fa674101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.723+0000 7fa67af5e640 1 -- 192.168.123.111:0/1729779516 >> 192.168.123.111:0/1729779516 conn(0x7fa6740fc260 msgr2=0x7fa6740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.724+0000 7fa67af5e640 1 -- 192.168.123.111:0/1729779516 shutdown_connections 2026-03-09T00:31:33.722 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.724+0000 7fa67af5e640 1 -- 192.168.123.111:0/1729779516 wait complete. 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.724+0000 7fa67af5e640 1 Processor -- start 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.724+0000 7fa67af5e640 1 -- start start 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67af5e640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674100cb0 0x7fa67419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67af5e640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 0x7fa67419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67af5e640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fa6741024a0 0x7fa6741a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67975b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 0x7fa67419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.723 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67975b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 0x7fa67419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:49062/0 (socket says 192.168.123.111:49062) 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa679f5c640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674100cb0 0x7fa67419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa679f5c640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674100cb0 0x7fa67419c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.111:57220/0 (socket says 192.168.123.111:57220) 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67af5e640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fa67410fd60 con 0x7fa674101ad0 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67af5e640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa67410fbe0 con 0x7fa674100cb0 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67af5e640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fa67410fee0 con 0x7fa6741024a0 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.725+0000 7fa67975b640 1 -- 192.168.123.111:0/1483222827 learned_addr learned my addr 192.168.123.111:0/1483222827 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67975b640 1 -- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fa6741024a0 msgr2=0x7fa6741a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67975b640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fa6741024a0 0x7fa6741a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67975b640 1 -- 192.168.123.111:0/1483222827 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674100cb0 msgr2=0x7fa67419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67975b640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674100cb0 0x7fa67419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67975b640 1 -- 192.168.123.111:0/1483222827 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6741a3fa0 con 0x7fa674101ad0 2026-03-09T00:31:33.724 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67975b640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 0x7fa67419c820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa664009a00 tx=0x7fa6640028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:33.725 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6640043c0 con 0x7fa674101ad0 2026-03-09T00:31:33.725 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fa664004560 con 0x7fa674101ad0 2026-03-09T00:31:33.725 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664005740 con 0x7fa674101ad0 2026-03-09T00:31:33.725 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6741a4230 con 0x7fa674101ad0 2026-03-09T00:31:33.725 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.726+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa674104370 con 0x7fa674101ad0 2026-03-09T00:31:33.725 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.727+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63c005180 con 0x7fa674101ad0 2026-03-09T00:31:33.727 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.728+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fa6640047c0 con 0x7fa674101ad0 2026-03-09T00:31:33.727 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.728+0000 7fa662ffd640 1 --2- 192.168.123.111:0/1483222827 >> v2:192.168.123.109:6800/82853931 conn(0x7fa650077870 0x7fa650079d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:33.727 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.728+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5529+0+0 (secure 0 0 0) 0x7fa6640bdd40 con 0x7fa674101ad0 2026-03-09T00:31:33.727 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.729+0000 7fa679f5c640 1 --2- 192.168.123.111:0/1483222827 >> v2:192.168.123.109:6800/82853931 conn(0x7fa650077870 0x7fa650079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:33.727 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.729+0000 7fa679f5c640 1 --2- 192.168.123.111:0/1483222827 >> v2:192.168.123.109:6800/82853931 conn(0x7fa650077870 0x7fa650079d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6680096f0 tx=0x7fa668009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:33.729 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.731+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa664087180 con 0x7fa674101ad0 2026-03-09T00:31:33.824 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.824+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}) -- 0x7fa63c002bf0 con 0x7fa650077870 2026-03-09T00:31:33.829 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.831+0000 7fa662ffd640 1 -- 192.168.123.111:0/1483222827 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7fa63c002bf0 con 0x7fa650077870 2026-03-09T00:31:33.829 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled prometheus update... 2026-03-09T00:31:33.831 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 >> v2:192.168.123.109:6800/82853931 conn(0x7fa650077870 msgr2=0x7fa650079d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.831 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1483222827 >> v2:192.168.123.109:6800/82853931 conn(0x7fa650077870 0x7fa650079d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6680096f0 tx=0x7fa668009290 comp rx=0 tx=0).stop 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 msgr2=0x7fa67419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 0x7fa67419c820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa664009a00 tx=0x7fa6640028f0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 shutdown_connections 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1483222827 >> v2:192.168.123.109:6800/82853931 conn(0x7fa650077870 0x7fa650079d30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fa6741024a0 0x7fa6741a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fa674101ad0 0x7fa67419c820 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.832 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 --2- 192.168.123.111:0/1483222827 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fa674100cb0 0x7fa67419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:33.833 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 >> 192.168.123.111:0/1483222827 conn(0x7fa6740fc260 msgr2=0x7fa6740fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:33.833 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 shutdown_connections 2026-03-09T00:31:33.833 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:33.833+0000 7fa67af5e640 1 -- 192.168.123.111:0/1483222827 wait complete. 2026-03-09T00:31:33.873 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T00:31:33.873 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T00:31:33.873 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: osdmap e49: 8 total, 8 up, 8 in 2026-03-09T00:31:33.873 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: pgmap v100: 68 pgs: 18 creating+peering, 36 active+clean, 14 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 112 KiB/s, 0 objects/s recovering 2026-03-09T00:31:33.874 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.111", "placement": "1;vm11=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:33.874 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: Saving service iscsi.datapool spec with placement vm11=iscsi.a;count:1 2026-03-09T00:31:33.874 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:33 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:33.887 DEBUG:teuthology.orchestra.run.vm11:prometheus.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@prometheus.a.service 2026-03-09T00:31:33.888 INFO:tasks.cephadm:Adding node-exporter.a on vm09 2026-03-09T00:31:33.888 INFO:tasks.cephadm:Adding node-exporter.b on vm11 2026-03-09T00:31:33.888 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply node-exporter '2;vm09=a;vm11=b' 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: osdmap e49: 8 total, 8 up, 8 in 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: pgmap v100: 68 pgs: 18 creating+peering, 36 active+clean, 14 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 112 KiB/s, 0 objects/s recovering 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.111", "placement": "1;vm11=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: Saving service iscsi.datapool spec with placement vm11=iscsi.a;count:1 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: osdmap e49: 8 total, 8 up, 8 in 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: pgmap v100: 68 pgs: 18 creating+peering, 36 active+clean, 14 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 112 KiB/s, 0 objects/s recovering 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.111", "placement": "1;vm11=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: Saving service iscsi.datapool spec with placement vm11=iscsi.a;count:1 2026-03-09T00:31:33.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:33 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.093 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:34.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 -- 192.168.123.111:0/3435969146 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f6524074210 msgr2=0x7f652410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 --2- 192.168.123.111:0/3435969146 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f6524074210 0x7f652410a470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6514009a30 tx=0x7f651402f220 comp rx=0 tx=0).stop 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 -- 192.168.123.111:0/3435969146 shutdown_connections 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 --2- 192.168.123.111:0/3435969146 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f652410aef0 0x7f652410b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 --2- 192.168.123.111:0/3435969146 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 0x7f652410a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 --2- 192.168.123.111:0/3435969146 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f6524074210 0x7f652410a470 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.210+0000 7f652a4dc640 1 -- 192.168.123.111:0/3435969146 >> 192.168.123.111:0/3435969146 conn(0x7f652406f8e0 msgr2=0x7f6524071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 -- 192.168.123.111:0/3435969146 shutdown_connections 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 -- 192.168.123.111:0/3435969146 wait complete. 2026-03-09T00:31:34.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 Processor -- start 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 -- start start 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 0x7f65241a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 0x7f65241a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f652410aef0 0x7f65241b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f652410e3d0 con 0x7f652410aef0 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f652410e250 con 0x7f6524074610 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.211+0000 7f652a4dc640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f652410e550 con 0x7f6524074210 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 0x7f65241a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 0x7f65241a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.111:45916/0 (socket says 192.168.123.111:45916) 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 -- 192.168.123.111:0/1129228526 learned_addr learned my addr 192.168.123.111:0/1129228526 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 -- 192.168.123.111:0/1129228526 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 msgr2=0x7f65241a99f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f651bfff640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 0x7f65241a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6528a52640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f652410aef0 0x7f65241b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 0x7f65241a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 -- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f652410aef0 msgr2=0x7f65241b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.212+0000 7f6523fff640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f652410aef0 0x7f65241b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f6523fff640 1 -- 192.168.123.111:0/1129228526 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65241190e0 con 0x7f6524074210 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f6528a52640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f652410aef0 0x7f65241b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f651bfff640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 0x7f65241a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f6523fff640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 0x7f65241a94b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6514002b30 tx=0x7f651402fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651402fe00 con 0x7f6524074210 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f6514038770 con 0x7f6524074210 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514042800 con 0x7f6524074210 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6524119370 con 0x7f6524074210 2026-03-09T00:31:34.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.213+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6524119800 con 0x7f6524074210 2026-03-09T00:31:34.213 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.214+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f65140429a0 con 0x7f6524074210 2026-03-09T00:31:34.213 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.215+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f0005180 con 0x7f6524074210 2026-03-09T00:31:34.214 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.215+0000 7f6521ffb640 1 --2- 192.168.123.111:0/1129228526 >> v2:192.168.123.109:6800/82853931 conn(0x7f64f4077650 0x7f64f4079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.214 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.215+0000 7f651bfff640 1 --2- 192.168.123.111:0/1129228526 >> v2:192.168.123.109:6800/82853931 conn(0x7f64f4077650 0x7f64f4079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.214 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.215+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(50..50 src has 1..50) ==== 5529+0+0 (secure 0 0 0) 0x7f65140bdeb0 con 0x7f6524074210 2026-03-09T00:31:34.214 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.216+0000 7f651bfff640 1 --2- 192.168.123.111:0/1129228526 >> v2:192.168.123.109:6800/82853931 conn(0x7f64f4077650 0x7f64f4079b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f65241aa9d0 tx=0x7f650c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:34.217 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.218+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f65140881c0 con 0x7f6524074210 2026-03-09T00:31:34.330 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.331+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm09=a;vm11=b", "target": ["mon-mgr", ""]}) -- 0x7f64f0002bf0 con 0x7f64f4077650 2026-03-09T00:31:34.336 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.337+0000 7f6521ffb640 1 -- 192.168.123.111:0/1129228526 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f64f0002bf0 con 0x7f64f4077650 2026-03-09T00:31:34.336 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled node-exporter update... 2026-03-09T00:31:34.338 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 >> v2:192.168.123.109:6800/82853931 conn(0x7f64f4077650 msgr2=0x7f64f4079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.338 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 --2- 192.168.123.111:0/1129228526 >> v2:192.168.123.109:6800/82853931 conn(0x7f64f4077650 0x7f64f4079b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f65241aa9d0 tx=0x7f650c009290 comp rx=0 tx=0).stop 2026-03-09T00:31:34.338 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 msgr2=0x7f65241a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.338 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 0x7f65241a94b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6514002b30 tx=0x7f651402fc90 comp rx=0 tx=0).stop 2026-03-09T00:31:34.338 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 shutdown_connections 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 --2- 192.168.123.111:0/1129228526 >> v2:192.168.123.109:6800/82853931 conn(0x7f64f4077650 0x7f64f4079b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f652410aef0 0x7f65241b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f6524074610 0x7f65241a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 --2- 192.168.123.111:0/1129228526 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f6524074210 0x7f65241a94b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 >> 192.168.123.111:0/1129228526 conn(0x7f652406f8e0 msgr2=0x7f6524072120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 shutdown_connections 2026-03-09T00:31:34.339 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.340+0000 7f652a4dc640 1 -- 192.168.123.111:0/1129228526 wait complete. 2026-03-09T00:31:34.400 DEBUG:teuthology.orchestra.run.vm09:node-exporter.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@node-exporter.a.service 2026-03-09T00:31:34.402 DEBUG:teuthology.orchestra.run.vm11:node-exporter.b> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@node-exporter.b.service 2026-03-09T00:31:34.403 INFO:tasks.cephadm:Adding alertmanager.a on vm09 2026-03-09T00:31:34.403 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply alertmanager '1;vm09=a' 2026-03-09T00:31:34.616 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: osdmap e50: 8 total, 8 up, 8 in 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: Saving service prometheus spec with placement vm11=a;count:1 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm09=a;vm11=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: Saving service node-exporter spec with placement vm09=a;vm11=b;count:2 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[56118]: osdmap e51: 8 total, 8 up, 8 in 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: osdmap e50: 8 total, 8 up, 8 in 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: Saving service prometheus spec with placement vm11=a;count:1 2026-03-09T00:31:34.681 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.682 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm09=a;vm11=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:34.682 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: Saving service node-exporter spec with placement vm09=a;vm11=b;count:2 2026-03-09T00:31:34.682 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.682 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T00:31:34.682 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T00:31:34.682 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:34 vm09 ceph-mon[49458]: osdmap e51: 8 total, 8 up, 8 in 2026-03-09T00:31:34.755 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.756+0000 7fb6064d9640 1 -- 192.168.123.111:0/2093110068 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 msgr2=0x7fb60010a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.755 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.756+0000 7fb6064d9640 1 --2- 192.168.123.111:0/2093110068 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 0x7fb60010a8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009990 tx=0x7fb5e802f150 comp rx=0 tx=0).stop 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 -- 192.168.123.111:0/2093110068 shutdown_connections 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 --2- 192.168.123.111:0/2093110068 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb60010ae30 0x7fb6001116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 --2- 192.168.123.111:0/2093110068 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 0x7fb60010a8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 --2- 192.168.123.111:0/2093110068 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb600074180 0x7fb600074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 -- 192.168.123.111:0/2093110068 >> 192.168.123.111:0/2093110068 conn(0x7fb60006f8e0 msgr2=0x7fb600071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 -- 192.168.123.111:0/2093110068 shutdown_connections 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.757+0000 7fb6064d9640 1 -- 192.168.123.111:0/2093110068 wait complete. 2026-03-09T00:31:34.756 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 Processor -- start 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 -- start start 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 0x7fb600119e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 0x7fb600116890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb60010ae30 0x7fb600116dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb60011cdd0 con 0x7fb600074180 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb60011cc50 con 0x7fb60010a470 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.758+0000 7fb6064d9640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fb60011cf50 con 0x7fb60010ae30 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.759+0000 7fb5fffff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 0x7fb600119e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.759+0000 7fb5fffff640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 0x7fb600119e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.111:49090/0 (socket says 192.168.123.111:49090) 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.759+0000 7fb604a4f640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb60010ae30 0x7fb600116dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.759+0000 7fb604a4f640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb60010ae30 0x7fb600116dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.111:45936/0 (socket says 192.168.123.111:45936) 2026-03-09T00:31:34.757 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.759+0000 7fb604a4f640 1 -- 192.168.123.111:0/3837931194 learned_addr learned my addr 192.168.123.111:0/3837931194 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:34.758 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.759+0000 7fb5ff7fe640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 0x7fb600116890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.758 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.760+0000 7fb5fffff640 1 -- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb60010ae30 msgr2=0x7fb600116dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.758 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.760+0000 7fb5fffff640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb60010ae30 0x7fb600116dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.758 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.760+0000 7fb5fffff640 1 -- 192.168.123.111:0/3837931194 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 msgr2=0x7fb600116890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.758 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.760+0000 7fb5fffff640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 0x7fb600116890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.758 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.760+0000 7fb5fffff640 1 -- 192.168.123.111:0/3837931194 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb600117440 con 0x7fb600074180 2026-03-09T00:31:34.759 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.760+0000 7fb5fffff640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 0x7fb600119e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400e9c0 tx=0x7fb5f400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:34.759 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.761+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400cd50 con 0x7fb600074180 2026-03-09T00:31:34.759 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.761+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6001b9e90 con 0x7fb600074180 2026-03-09T00:31:34.759 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.761+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001ba2f0 con 0x7fb600074180 2026-03-09T00:31:34.759 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.761+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fb5f4004540 con 0x7fb600074180 2026-03-09T00:31:34.760 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.761+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4010490 con 0x7fb600074180 2026-03-09T00:31:34.761 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.762+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fb5f4020070 con 0x7fb600074180 2026-03-09T00:31:34.761 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.763+0000 7fb5fd7fa640 1 --2- 192.168.123.111:0/3837931194 >> v2:192.168.123.109:6800/82853931 conn(0x7fb5d00775d0 0x7fb5d0079a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:34.762 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.763+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5540+0+0 (secure 0 0 0) 0x7fb5f4099a80 con 0x7fb600074180 2026-03-09T00:31:34.762 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.763+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb600074580 con 0x7fb600074180 2026-03-09T00:31:34.762 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.763+0000 7fb5ff7fe640 1 --2- 192.168.123.111:0/3837931194 >> v2:192.168.123.109:6800/82853931 conn(0x7fb5d00775d0 0x7fb5d0079a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:34.763 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.764+0000 7fb5ff7fe640 1 --2- 192.168.123.111:0/3837931194 >> v2:192.168.123.109:6800/82853931 conn(0x7fb5d00775d0 0x7fb5d0079a90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8002800 tx=0x7fb5e80023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:34.766 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.767+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb5f4066ae0 con 0x7fb600074180 2026-03-09T00:31:34.868 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.869+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm09=a", "target": ["mon-mgr", ""]}) -- 0x7fb6000630c0 con 0x7fb5d00775d0 2026-03-09T00:31:34.875 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.876+0000 7fb5fd7fa640 1 -- 192.168.123.111:0/3837931194 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7fb6000630c0 con 0x7fb5d00775d0 2026-03-09T00:31:34.875 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled alertmanager update... 2026-03-09T00:31:34.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 >> v2:192.168.123.109:6800/82853931 conn(0x7fb5d00775d0 msgr2=0x7fb5d0079a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 --2- 192.168.123.111:0/3837931194 >> v2:192.168.123.109:6800/82853931 conn(0x7fb5d00775d0 0x7fb5d0079a90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8002800 tx=0x7fb5e80023d0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 msgr2=0x7fb600119e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:34.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 0x7fb600119e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400e9c0 tx=0x7fb5f400ee90 comp rx=0 tx=0).stop 2026-03-09T00:31:34.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 shutdown_connections 2026-03-09T00:31:34.877 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 --2- 192.168.123.111:0/3837931194 >> v2:192.168.123.109:6800/82853931 conn(0x7fb5d00775d0 0x7fb5d0079a90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb60010ae30 0x7fb600116dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb60010a470 0x7fb600116890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 --2- 192.168.123.111:0/3837931194 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb600074180 0x7fb600119e30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:34.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 >> 192.168.123.111:0/3837931194 conn(0x7fb60006f8e0 msgr2=0x7fb6000724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:34.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 shutdown_connections 2026-03-09T00:31:34.878 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:34.879+0000 7fb6064d9640 1 -- 192.168.123.111:0/3837931194 wait complete. 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: osdmap e50: 8 total, 8 up, 8 in 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: Saving service prometheus spec with placement vm11=a;count:1 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm09=a;vm11=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: Saving service node-exporter spec with placement vm09=a;vm11=b;count:2 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T00:31:34.919 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:34 vm11 ceph-mon[53379]: osdmap e51: 8 total, 8 up, 8 in 2026-03-09T00:31:34.919 DEBUG:teuthology.orchestra.run.vm09:alertmanager.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@alertmanager.a.service 2026-03-09T00:31:34.921 INFO:tasks.cephadm:Adding grafana.a on vm11 2026-03-09T00:31:34.921 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph orch apply grafana '1;vm11=a' 2026-03-09T00:31:35.088 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.206+0000 7f38a5444640 1 -- 192.168.123.111:0/1434562694 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0106440 msgr2=0x7f38a0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.206+0000 7f38a5444640 1 --2- 192.168.123.111:0/1434562694 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0106440 0x7f38a0106840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3888009a80 tx=0x7f388802f280 comp rx=0 tx=0).stop 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.208+0000 7f38a5444640 1 -- 192.168.123.111:0/1434562694 shutdown_connections 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.208+0000 7f38a5444640 1 --2- 192.168.123.111:0/1434562694 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f38a0105340 0x7f38a010d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.208+0000 7f38a5444640 1 --2- 192.168.123.111:0/1434562694 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38a0104980 0x7f38a0104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.208+0000 7f38a5444640 1 --2- 192.168.123.111:0/1434562694 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0106440 0x7f38a0106840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.208+0000 7f38a5444640 1 -- 192.168.123.111:0/1434562694 >> 192.168.123.111:0/1434562694 conn(0x7f38a01004f0 msgr2=0x7f38a0102930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 -- 192.168.123.111:0/1434562694 shutdown_connections 2026-03-09T00:31:35.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 -- 192.168.123.111:0/1434562694 wait complete. 2026-03-09T00:31:35.208 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 Processor -- start 2026-03-09T00:31:35.208 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 -- start start 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38a0104980 0x7f38a0111610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 0x7f38a0111b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f38a0106440 0x7f38a0116bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0078540 con 0x7f38a0104980 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00783c0 con 0x7f38a0105340 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.209+0000 7f38a5444640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f38a00786c0 con 0x7f38a0106440 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 0x7f38a0111b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 0x7f38a0111b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.111:57280/0 (socket says 192.168.123.111:57280) 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 -- 192.168.123.111:0/734501464 learned_addr learned my addr 192.168.123.111:0/734501464 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389f7fe640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f38a0106440 0x7f38a0116bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 -- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f38a0106440 msgr2=0x7f38a0116bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f38a0106440 0x7f38a0116bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 -- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38a0104980 msgr2=0x7f38a0111610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38a0104980 0x7f38a0111610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 -- 192.168.123.111:0/734501464 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a01172c0 con 0x7f38a0105340 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f389e7fc640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 0x7f38a0111b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f389400ea40 tx=0x7f389400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389400ce30 con 0x7f38a0105340 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f3894004540 con 0x7f38a0105340 2026-03-09T00:31:35.210 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.210+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894010690 con 0x7f38a0105340 2026-03-09T00:31:35.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.212+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a01175b0 con 0x7f38a0105340 2026-03-09T00:31:35.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.212+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a006ca60 con 0x7f38a0105340 2026-03-09T00:31:35.211 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.213+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3864005180 con 0x7f38a0105340 2026-03-09T00:31:35.216 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.213+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f3894002870 con 0x7f38a0105340 2026-03-09T00:31:35.216 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.214+0000 7f387ffff640 1 --2- 192.168.123.111:0/734501464 >> v2:192.168.123.109:6800/82853931 conn(0x7f38740775d0 0x7f3874079a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.216 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.214+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5540+0+0 (secure 0 0 0) 0x7f389405dec0 con 0x7f38a0105340 2026-03-09T00:31:35.216 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.217+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3894062220 con 0x7f38a0105340 2026-03-09T00:31:35.217 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.217+0000 7f389effd640 1 --2- 192.168.123.111:0/734501464 >> v2:192.168.123.109:6800/82853931 conn(0x7f38740775d0 0x7f3874079a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.217 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.218+0000 7f389effd640 1 --2- 192.168.123.111:0/734501464 >> v2:192.168.123.109:6800/82853931 conn(0x7f38740775d0 0x7f3874079a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38880099a0 tx=0x7f38880023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:35.314 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.316+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}) -- 0x7f3864002bf0 con 0x7f38740775d0 2026-03-09T00:31:35.321 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.322+0000 7f387ffff640 1 -- 192.168.123.111:0/734501464 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3864002bf0 con 0x7f38740775d0 2026-03-09T00:31:35.323 INFO:teuthology.orchestra.run.vm11.stdout:Scheduled grafana update... 2026-03-09T00:31:35.326 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.327+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 >> v2:192.168.123.109:6800/82853931 conn(0x7f38740775d0 msgr2=0x7f3874079a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.326 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.327+0000 7f38a5444640 1 --2- 192.168.123.111:0/734501464 >> v2:192.168.123.109:6800/82853931 conn(0x7f38740775d0 0x7f3874079a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38880099a0 tx=0x7f38880023d0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.326 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.327+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 msgr2=0x7f38a0111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.326 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.327+0000 7f38a5444640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 0x7f38a0111b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f389400ea40 tx=0x7f389400ef10 comp rx=0 tx=0).stop 2026-03-09T00:31:35.326 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.328+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 shutdown_connections 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.328+0000 7f38a5444640 1 --2- 192.168.123.111:0/734501464 >> v2:192.168.123.109:6800/82853931 conn(0x7f38740775d0 0x7f3874079a90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.328+0000 7f38a5444640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f38a0106440 0x7f38a0116bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.328+0000 7f38a5444640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f38a0105340 0x7f38a0111b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.328+0000 7f38a5444640 1 --2- 192.168.123.111:0/734501464 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f38a0104980 0x7f38a0111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.328+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 >> 192.168.123.111:0/734501464 conn(0x7f38a01004f0 msgr2=0x7f38a01028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.329+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 shutdown_connections 2026-03-09T00:31:35.327 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:35.329+0000 7f38a5444640 1 -- 192.168.123.111:0/734501464 wait complete. 2026-03-09T00:31:35.378 DEBUG:teuthology.orchestra.run.vm11:grafana.a> sudo journalctl -f -n 0 -u ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@grafana.a.service 2026-03-09T00:31:35.379 INFO:tasks.cephadm:Setting up client nodes... 2026-03-09T00:31:35.380 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T00:31:35.541 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.691+0000 7f31d4d31640 1 -- 192.168.123.109:0/389392982 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 msgr2=0x7f31d0079f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.691+0000 7f31d4d31640 1 --2- 192.168.123.109:0/389392982 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 0x7f31d0079f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31c400b0a0 tx=0x7f31c402f450 comp rx=0 tx=0).stop 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 -- 192.168.123.109:0/389392982 shutdown_connections 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 --2- 192.168.123.109:0/389392982 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 0x7f31d0079f30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 --2- 192.168.123.109:0/389392982 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 0x7f31d0077b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 --2- 192.168.123.109:0/389392982 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 0x7f31d0079580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 -- 192.168.123.109:0/389392982 >> 192.168.123.109:0/389392982 conn(0x7f31d0100310 msgr2=0x7f31d0102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 -- 192.168.123.109:0/389392982 shutdown_connections 2026-03-09T00:31:35.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.692+0000 7f31d4d31640 1 -- 192.168.123.109:0/389392982 wait complete. 2026-03-09T00:31:35.692 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.693+0000 7f31d4d31640 1 Processor -- start 2026-03-09T00:31:35.692 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.693+0000 7f31d4d31640 1 -- start start 2026-03-09T00:31:35.692 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.693+0000 7f31d4d31640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 0x7f31d01a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.693+0000 7f31d4d31640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 0x7f31d01a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.693+0000 7f31d4d31640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 0x7f31d01a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31d4d31640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f31d01142f0 con 0x7f31d00780b0 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31d4d31640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0114170 con 0x7f31d0077710 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31d4d31640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f31d0114470 con 0x7f31d0079180 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cffff640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 0x7f31d01a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cffff640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 0x7f31d01a7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:38820/0 (socket says 192.168.123.109:38820) 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cf7fe640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 0x7f31d01a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cffff640 1 -- 192.168.123.109:0/2294675524 learned_addr learned my addr 192.168.123.109:0/2294675524 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:35.693 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31ceffd640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 0x7f31d01a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cf7fe640 1 -- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 msgr2=0x7f31d01a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cf7fe640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 0x7f31d01a7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cf7fe640 1 -- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 msgr2=0x7f31d01a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cf7fe640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 0x7f31d01a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.694+0000 7f31cf7fe640 1 -- 192.168.123.109:0/2294675524 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d01a8630 con 0x7f31d0077710 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.695+0000 7f31cf7fe640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 0x7f31d01a0970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d730 tx=0x7f31bc00dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:35.694 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.695+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc014070 con 0x7f31d0077710 2026-03-09T00:31:35.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.695+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f31bc0044e0 con 0x7f31d0077710 2026-03-09T00:31:35.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.695+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d01a8920 con 0x7f31d0077710 2026-03-09T00:31:35.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.696+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc005020 con 0x7f31d0077710 2026-03-09T00:31:35.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.696+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a8eb0 con 0x7f31d0077710 2026-03-09T00:31:35.696 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.697+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0079f30 con 0x7f31d0077710 2026-03-09T00:31:35.696 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.697+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f31bc0047c0 con 0x7f31d0077710 2026-03-09T00:31:35.697 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.698+0000 7f31ccff9640 1 --2- 192.168.123.109:0/2294675524 >> v2:192.168.123.109:6800/82853931 conn(0x7f31a4077600 0x7f31a4079ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:35.697 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.698+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5895+0+0 (secure 0 0 0) 0x7f31bc099300 con 0x7f31d0077710 2026-03-09T00:31:35.697 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.698+0000 7f31ceffd640 1 --2- 192.168.123.109:0/2294675524 >> v2:192.168.123.109:6800/82853931 conn(0x7f31a4077600 0x7f31a4079ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:35.697 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.698+0000 7f31ceffd640 1 --2- 192.168.123.109:0/2294675524 >> v2:192.168.123.109:6800/82853931 conn(0x7f31a4077600 0x7f31a4079ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f31d01a1e90 tx=0x7f31c00073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:35.699 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.700+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f31bc01d070 con 0x7f31d0077710 2026-03-09T00:31:35.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.823+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f31d0111170 con 0x7f31d0077710 2026-03-09T00:31:35.829 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.830+0000 7f31ccff9640 1 -- 192.168.123.109:0/2294675524 <== mon.1 v2:192.168.123.111:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) ==== 170+0+59 (secure 0 0 0) 0x7f31bc066280 con 0x7f31d0077710 2026-03-09T00:31:35.830 INFO:teuthology.orchestra.run.vm09.stdout:[client.0] 2026-03-09T00:31:35.830 INFO:teuthology.orchestra.run.vm09.stdout: key = AQDnFK5p/507MRAAdGHUeKqGV5EeQD24cmdK7g== 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.832+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 >> v2:192.168.123.109:6800/82853931 conn(0x7f31a4077600 msgr2=0x7f31a4079ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.832+0000 7f31d4d31640 1 --2- 192.168.123.109:0/2294675524 >> v2:192.168.123.109:6800/82853931 conn(0x7f31a4077600 0x7f31a4079ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f31d01a1e90 tx=0x7f31c00073d0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.832+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 msgr2=0x7f31d01a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.832+0000 7f31d4d31640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 0x7f31d01a0970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d730 tx=0x7f31bc00dc00 comp rx=0 tx=0).stop 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 shutdown_connections 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 --2- 192.168.123.109:0/2294675524 >> v2:192.168.123.109:6800/82853931 conn(0x7f31a4077600 0x7f31a4079ac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f31d0079180 0x7f31d01a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f31d00780b0 0x7f31d01a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 --2- 192.168.123.109:0/2294675524 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f31d0077710 0x7f31d01a0970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 >> 192.168.123.109:0/2294675524 conn(0x7f31d0100310 msgr2=0x7f31d0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 shutdown_connections 2026-03-09T00:31:35.832 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:35.833+0000 7f31d4d31640 1 -- 192.168.123.109:0/2294675524 wait complete. 2026-03-09T00:31:35.875 DEBUG:teuthology.orchestra.run.vm09:> set -ex 2026-03-09T00:31:35.875 DEBUG:teuthology.orchestra.run.vm09:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-03-09T00:31:35.875 DEBUG:teuthology.orchestra.run.vm09:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-03-09T00:31:35.912 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: pgmap v103: 100 pgs: 18 creating+peering, 36 active+clean, 46 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 112 KiB/s, 0 objects/s recovering 2026-03-09T00:31:35.912 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm09=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: Saving service alertmanager spec with placement vm09=a;count:1 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: Saving service grafana spec with placement vm11=a;count:1 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: osdmap e52: 8 total, 8 up, 8 in 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2294675524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: pgmap v103: 100 pgs: 18 creating+peering, 36 active+clean, 46 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 112 KiB/s, 0 objects/s recovering 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm09=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: Saving service alertmanager spec with placement vm09=a;count:1 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: Saving service grafana spec with placement vm11=a;count:1 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: osdmap e52: 8 total, 8 up, 8 in 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2294675524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:35.913 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:35 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:35.914 DEBUG:teuthology.orchestra.run.vm11:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T00:31:36.083 INFO:teuthology.orchestra.run.vm11.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.b/config 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: pgmap v103: 100 pgs: 18 creating+peering, 36 active+clean, 46 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 112 KiB/s, 0 objects/s recovering 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm09=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: Saving service alertmanager spec with placement vm09=a;count:1 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm11=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: Saving service grafana spec with placement vm11=a;count:1 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: osdmap e52: 8 total, 8 up, 8 in 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2294675524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:36.130 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:35 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.204+0000 7fe20f351640 1 -- 192.168.123.111:0/991082135 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208105f50 msgr2=0x7fe2081063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.204+0000 7fe20f351640 1 --2- 192.168.123.111:0/991082135 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208105f50 0x7fe2081063d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009a30 tx=0x7fe1f002f240 comp rx=0 tx=0).stop 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 -- 192.168.123.111:0/991082135 shutdown_connections 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 --2- 192.168.123.111:0/991082135 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208106910 0x7fe20810d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 --2- 192.168.123.111:0/991082135 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208105f50 0x7fe2081063d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 --2- 192.168.123.111:0/991082135 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 0x7fe208105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 -- 192.168.123.111:0/991082135 >> 192.168.123.111:0/991082135 conn(0x7fe2081004e0 msgr2=0x7fe208102920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 -- 192.168.123.111:0/991082135 shutdown_connections 2026-03-09T00:31:36.204 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.205+0000 7fe20f351640 1 -- 192.168.123.111:0/991082135 wait complete. 2026-03-09T00:31:36.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 Processor -- start 2026-03-09T00:31:36.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 -- start start 2026-03-09T00:31:36.205 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 0x7fe20819c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208105f50 0x7fe20819ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 0x7fe2081a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe20810fe70 con 0x7fe208105f50 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe20810fcf0 con 0x7fe208106910 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.206+0000 7fe20f351640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fe20810fff0 con 0x7fe208104d50 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d8c7640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 0x7fe2081a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d8c7640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 0x7fe2081a3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.111:57298/0 (socket says 192.168.123.111:57298) 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d8c7640 1 -- 192.168.123.111:0/3064901069 learned_addr learned my addr 192.168.123.111:0/3064901069 (peer_addr_for_me v2:192.168.123.111:0/0) 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d0c6640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 0x7fe20819c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20c8c5640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208105f50 0x7fe20819ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d0c6640 1 -- 192.168.123.111:0/3064901069 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 msgr2=0x7fe2081a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d0c6640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 0x7fe2081a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d0c6640 1 -- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208105f50 msgr2=0x7fe20819ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d0c6640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208105f50 0x7fe20819ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d0c6640 1 -- 192.168.123.111:0/3064901069 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2081a4150 con 0x7fe208104d50 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.207+0000 7fe20d8c7640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 0x7fe2081a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe20c8c5640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208105f50 0x7fe20819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe20d0c6640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 0x7fe20819c520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800c940 tx=0x7fe1f800ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:36.206 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8013070 con 0x7fe208104d50 2026-03-09T00:31:36.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2081a4440 con 0x7fe208104d50 2026-03-09T00:31:36.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2081a49d0 con 0x7fe208104d50 2026-03-09T00:31:36.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fe1f8004480 con 0x7fe208104d50 2026-03-09T00:31:36.207 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.208+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8002db0 con 0x7fe208104d50 2026-03-09T00:31:36.208 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.209+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208105150 con 0x7fe208104d50 2026-03-09T00:31:36.208 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.210+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fe1f8020020 con 0x7fe208104d50 2026-03-09T00:31:36.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.210+0000 7fe1fe7fc640 1 --2- 192.168.123.111:0/3064901069 >> v2:192.168.123.109:6800/82853931 conn(0x7fe1dc077600 0x7fe1dc079ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.210+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(52..52 src has 1..52) ==== 5895+0+0 (secure 0 0 0) 0x7fe1f80994e0 con 0x7fe208104d50 2026-03-09T00:31:36.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.210+0000 7fe20c8c5640 1 --2- 192.168.123.111:0/3064901069 >> v2:192.168.123.109:6800/82853931 conn(0x7fe1dc077600 0x7fe1dc079ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.209 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.211+0000 7fe20c8c5640 1 --2- 192.168.123.111:0/3064901069 >> v2:192.168.123.109:6800/82853931 conn(0x7fe1dc077600 0x7fe1dc079ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0002ae0 tx=0x7fe1f0005810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:36.212 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.213+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1f8062730 con 0x7fe208104d50 2026-03-09T00:31:36.337 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.339+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe20810b310 con 0x7fe208104d50 2026-03-09T00:31:36.344 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.345+0000 7fe1fe7fc640 1 -- 192.168.123.111:0/3064901069 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7fe1f80663e0 con 0x7fe208104d50 2026-03-09T00:31:36.344 INFO:teuthology.orchestra.run.vm11.stdout:[client.1] 2026-03-09T00:31:36.344 INFO:teuthology.orchestra.run.vm11.stdout: key = AQDoFK5pzphQFBAALPesCoFqHM9JrYqvTKIddw== 2026-03-09T00:31:36.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.347+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 >> v2:192.168.123.109:6800/82853931 conn(0x7fe1dc077600 msgr2=0x7fe1dc079ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 --2- 192.168.123.111:0/3064901069 >> v2:192.168.123.109:6800/82853931 conn(0x7fe1dc077600 0x7fe1dc079ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0002ae0 tx=0x7fe1f0005810 comp rx=0 tx=0).stop 2026-03-09T00:31:36.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 msgr2=0x7fe20819c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 0x7fe20819c520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800c940 tx=0x7fe1f800ce10 comp rx=0 tx=0).stop 2026-03-09T00:31:36.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 shutdown_connections 2026-03-09T00:31:36.346 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 --2- 192.168.123.111:0/3064901069 >> v2:192.168.123.109:6800/82853931 conn(0x7fe1dc077600 0x7fe1dc079ac0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe208106910 0x7fe2081a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe208105f50 0x7fe20819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 --2- 192.168.123.111:0/3064901069 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe208104d50 0x7fe20819c520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 >> 192.168.123.111:0/3064901069 conn(0x7fe2081004e0 msgr2=0x7fe208101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:36.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 shutdown_connections 2026-03-09T00:31:36.347 INFO:teuthology.orchestra.run.vm11.stderr:2026-03-09T00:31:36.348+0000 7fe20f351640 1 -- 192.168.123.111:0/3064901069 wait complete. 2026-03-09T00:31:36.408 DEBUG:teuthology.orchestra.run.vm11:> set -ex 2026-03-09T00:31:36.408 DEBUG:teuthology.orchestra.run.vm11:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-03-09T00:31:36.408 DEBUG:teuthology.orchestra.run.vm11:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-03-09T00:31:36.444 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-03-09T00:31:36.444 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-03-09T00:31:36.444 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph mgr dump --format=json 2026-03-09T00:31:36.609 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:36.738 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.738+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/2440066933 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c106920 msgr2=0x7f3e9c075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.738 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.738+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/2440066933 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c106920 0x7f3e9c075410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009a30 tx=0x7f3e8c02f2d0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.739+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/2440066933 shutdown_connections 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.739+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/2440066933 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3e9c113820 0x7f3e9c115c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.740+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/2440066933 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c075950 0x7f3e9c075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.740+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/2440066933 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c106920 0x7f3e9c075410 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.740+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/2440066933 >> 192.168.123.109:0/2440066933 conn(0x7f3e9c0fe770 msgr2=0x7f3e9c100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.740+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/2440066933 shutdown_connections 2026-03-09T00:31:36.739 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.740+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/2440066933 wait complete. 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 Processor -- start 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 -- start start 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3e9c075950 0x7f3e9c1a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 0x7f3e9c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c113820 0x7f3e9c1a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c118a50 con 0x7f3e9c113820 2026-03-09T00:31:36.740 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1188d0 con 0x7f3e9c106920 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea3bc1640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c118bd0 con 0x7f3e9c075950 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea1135640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 0x7f3e9c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea1135640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 0x7f3e9c1a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:60720/0 (socket says 192.168.123.109:60720) 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea1135640 1 -- 192.168.123.109:0/247830582 learned_addr learned my addr 192.168.123.109:0/247830582 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.741+0000 7f3ea2137640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c113820 0x7f3e9c1a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea1135640 1 -- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3e9c075950 msgr2=0x7f3e9c1a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.741 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea1135640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3e9c075950 0x7f3e9c1a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea1135640 1 -- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c113820 msgr2=0x7f3e9c1a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea1135640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c113820 0x7f3e9c1a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea1135640 1 -- 192.168.123.109:0/247830582 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1a60c0 con 0x7f3e9c106920 2026-03-09T00:31:36.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea1135640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 0x7f3e9c1a15b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000d950 tx=0x7f3e9000de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:36.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90014070 con 0x7f3e9c106920 2026-03-09T00:31:36.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1a63b0 con 0x7f3e9c106920 2026-03-09T00:31:36.743 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f3e900044e0 con 0x7f3e9c106920 2026-03-09T00:31:36.743 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9001e050 con 0x7f3e9c106920 2026-03-09T00:31:36.743 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.742+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1adbf0 con 0x7f3e9c106920 2026-03-09T00:31:36.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.744+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f3e90021020 con 0x7f3e9c106920 2026-03-09T00:31:36.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.744+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e68005180 con 0x7f3e9c106920 2026-03-09T00:31:36.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.744+0000 7f3e8affd640 1 --2- 192.168.123.109:0/247830582 >> v2:192.168.123.109:6800/82853931 conn(0x7f3e6c0775d0 0x7f3e6c079a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:36.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.744+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5906+0+0 (secure 0 0 0) 0x7f3e900997f0 con 0x7f3e9c106920 2026-03-09T00:31:36.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.744+0000 7f3ea1936640 1 --2- 192.168.123.109:0/247830582 >> v2:192.168.123.109:6800/82853931 conn(0x7f3e6c0775d0 0x7f3e6c079a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:36.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.745+0000 7f3ea1936640 1 --2- 192.168.123.109:0/247830582 >> v2:192.168.123.109:6800/82853931 conn(0x7f3e6c0775d0 0x7f3e6c079a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0097c0 tx=0x7f3e8c0057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:36.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.747+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3e90062a30 con 0x7f3e9c106920 2026-03-09T00:31:36.866 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.867+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3e68005470 con 0x7f3e9c106920 2026-03-09T00:31:36.868 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.869+0000 7f3e8affd640 1 -- 192.168.123.109:0/247830582 <== mon.1 v2:192.168.123.111:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v15) ==== 74+0+191976 (secure 0 0 0) 0x7f3e900666e0 con 0x7f3e9c106920 2026-03-09T00:31:36.869 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:36.873 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.874+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 >> v2:192.168.123.109:6800/82853931 conn(0x7f3e6c0775d0 msgr2=0x7f3e6c079a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.873 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.874+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/247830582 >> v2:192.168.123.109:6800/82853931 conn(0x7f3e6c0775d0 0x7f3e6c079a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0097c0 tx=0x7f3e8c0057d0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.873 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.874+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 msgr2=0x7f3e9c1a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:36.873 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.874+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 0x7f3e9c1a15b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000d950 tx=0x7f3e9000de20 comp rx=0 tx=0).stop 2026-03-09T00:31:36.874 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.874+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 shutdown_connections 2026-03-09T00:31:36.874 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.875+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/247830582 >> v2:192.168.123.109:6800/82853931 conn(0x7f3e6c0775d0 0x7f3e6c079a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.874 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.875+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3e9c113820 0x7f3e9c1a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.874 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.875+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3e9c106920 0x7f3e9c1a15b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.875 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.875+0000 7f3ea3bc1640 1 --2- 192.168.123.109:0/247830582 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3e9c075950 0x7f3e9c1a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:36.875 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.875+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 >> 192.168.123.109:0/247830582 conn(0x7f3e9c0fe770 msgr2=0x7f3e9c10f800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:36.875 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.875+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 shutdown_connections 2026-03-09T00:31:36.875 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:36.876+0000 7f3ea3bc1640 1 -- 192.168.123.109:0/247830582 wait complete. 2026-03-09T00:31:36.924 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":15,"flags":0,"active_gid":14150,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6800","nonce":82853931}]},"active_addr":"192.168.123.109:6800/82853931","active_change":"2026-03-09T00:29:30.753136+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://192.168.123.109:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"192.168.123.109:0","nonce":1953204487}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"192.168.123.109:0","nonce":1255206158}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"192.168.123.109:0","nonce":3888511412}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"192.168.123.109:0","nonce":571873594}]}]} 2026-03-09T00:31:36.925 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-03-09T00:31:36.925 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-03-09T00:31:36.925 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd dump --format=json 2026-03-09T00:31:37.099 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/3064901069' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: osdmap e53: 8 total, 8 up, 8 in 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/247830582' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/3064901069' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: osdmap e53: 8 total, 8 up, 8 in 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.122 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:36 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/247830582' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/3064901069' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: osdmap e53: 8 total, 8 up, 8 in 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2979821356' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1578420180' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T00:31:37.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:36 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/247830582' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.219+0000 7fdb5c0de640 1 -- 192.168.123.109:0/48618268 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb54075d30 msgr2=0x7fdb5410ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.219+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/48618268 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb54075d30 0x7fdb5410ee50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009a30 tx=0x7fdb4402f2d0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 -- 192.168.123.109:0/48618268 shutdown_connections 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/48618268 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb5410f390 0x7fdb54111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/48618268 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb54075d30 0x7fdb5410ee50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/48618268 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fdb54075410 0x7fdb540757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 -- 192.168.123.109:0/48618268 >> 192.168.123.109:0/48618268 conn(0x7fdb540fe770 msgr2=0x7fdb54100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 -- 192.168.123.109:0/48618268 shutdown_connections 2026-03-09T00:31:37.219 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 -- 192.168.123.109:0/48618268 wait complete. 2026-03-09T00:31:37.220 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 Processor -- start 2026-03-09T00:31:37.220 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.220+0000 7fdb5c0de640 1 -- start start 2026-03-09T00:31:37.220 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5c0de640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 0x7fdb541a2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.220 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb59e53640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 0x7fdb541a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:37.220 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb59e53640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 0x7fdb541a2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:38850/0 (socket says 192.168.123.109:38850) 2026-03-09T00:31:37.220 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5c0de640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fdb54075d30 0x7fdb541a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5c0de640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb5410f390 0x7fdb5419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5c0de640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541145f0 con 0x7fdb5410f390 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5c0de640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54114470 con 0x7fdb54075d30 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5c0de640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fdb54114770 con 0x7fdb54075410 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb59e53640 1 -- 192.168.123.109:0/646605513 learned_addr learned my addr 192.168.123.109:0/646605513 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb59e53640 1 -- 192.168.123.109:0/646605513 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fdb54075d30 msgr2=0x7fdb541a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb59e53640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fdb54075d30 0x7fdb541a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb59e53640 1 -- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb5410f390 msgr2=0x7fdb5419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.221+0000 7fdb5a654640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb5410f390 0x7fdb5419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.222+0000 7fdb59e53640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb5410f390 0x7fdb5419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.222+0000 7fdb59e53640 1 -- 192.168.123.109:0/646605513 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5419d110 con 0x7fdb54075410 2026-03-09T00:31:37.221 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.222+0000 7fdb59e53640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 0x7fdb541a2780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009990 tx=0x7fdb48009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:37.222 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.222+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb480040d0 con 0x7fdb54075410 2026-03-09T00:31:37.222 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.222+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fdb480026e0 con 0x7fdb54075410 2026-03-09T00:31:37.222 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.223+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48015b00 con 0x7fdb54075410 2026-03-09T00:31:37.222 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.223+0000 7fdb5a654640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb5410f390 0x7fdb5419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:37.222 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.223+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5419d400 con 0x7fdb54075410 2026-03-09T00:31:37.223 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.223+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541028e0 con 0x7fdb54075410 2026-03-09T00:31:37.224 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.225+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fdb4801b070 con 0x7fdb54075410 2026-03-09T00:31:37.224 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.225+0000 7fdb42ffd640 1 --2- 192.168.123.109:0/646605513 >> v2:192.168.123.109:6800/82853931 conn(0x7fdb30077590 0x7fdb30079a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.224 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.225+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(53..53 src has 1..53) ==== 5906+0+0 (secure 0 0 0) 0x7fdb480a16e0 con 0x7fdb54075410 2026-03-09T00:31:37.226 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.225+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c005180 con 0x7fdb54075410 2026-03-09T00:31:37.226 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.225+0000 7fdb59652640 1 --2- 192.168.123.109:0/646605513 >> v2:192.168.123.109:6800/82853931 conn(0x7fdb30077590 0x7fdb30079a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:37.227 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.226+0000 7fdb59652640 1 --2- 192.168.123.109:0/646605513 >> v2:192.168.123.109:6800/82853931 conn(0x7fdb30077590 0x7fdb30079a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb440097c0 tx=0x7fdb440057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:37.228 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.229+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdb4806a9a0 con 0x7fdb54075410 2026-03-09T00:31:37.330 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.330+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb1c005470 con 0x7fdb54075410 2026-03-09T00:31:37.331 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.332+0000 7fdb42ffd640 1 -- 192.168.123.109:0/646605513 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+20867 (secure 0 0 0) 0x7fdb4806e650 con 0x7fdb54075410 2026-03-09T00:31:37.331 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:37.331 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":53,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","created":"2026-03-09T00:29:07.790682+0000","modified":"2026-03-09T00:31:36.649614+0000","last_up_change":"2026-03-09T00:31:26.043166+0000","last_in_change":"2026-03-09T00:31:16.093998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T00:30:36.800055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2026-03-09T00:31:28.420247+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2026-03-09T00:31:28.806199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2026-03-09T00:31:30.191626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2026-03-09T00:31:32.672488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2026-03-09T00:31:34.801016+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"358ee389-cb78-4018-b8af-afdaff60ba71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6801","nonce":3241136735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6802","nonce":3241136735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6804","nonce":3241136735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6803","nonce":3241136735}]},"public_addr":"192.168.123.109:6801/3241136735","cluster_addr":"192.168.123.109:6802/3241136735","heartbeat_back_addr":"192.168.123.109:6804/3241136735","heartbeat_front_addr":"192.168.123.109:6803/3241136735","state":["exists","up"]},{"osd":1,"uuid":"504373ca-3989-4555-acb0-64b55de70bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6805","nonce":64355271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6806","nonce":64355271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6808","nonce":64355271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6807","nonce":64355271}]},"public_addr":"192.168.123.109:6805/64355271","cluster_addr":"192.168.123.109:6806/64355271","heartbeat_back_addr":"192.168.123.109:6808/64355271","heartbeat_front_addr":"192.168.123.109:6807/64355271","state":["exists","up"]},{"osd":2,"uuid":"d1e4aed4-61e3-4b5c-90eb-fd9480495a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6809","nonce":1100722638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6810","nonce":1100722638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6812","nonce":1100722638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6811","nonce":1100722638}]},"public_addr":"192.168.123.109:6809/1100722638","cluster_addr":"192.168.123.109:6810/1100722638","heartbeat_back_addr":"192.168.123.109:6812/1100722638","heartbeat_front_addr":"192.168.123.109:6811/1100722638","state":["exists","up"]},{"osd":3,"uuid":"f49ec9f2-9291-4311-ba8a-82828daa1996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6813","nonce":3343463680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6814","nonce":3343463680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6816","nonce":3343463680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6815","nonce":3343463680}]},"public_addr":"192.168.123.109:6813/3343463680","cluster_addr":"192.168.123.109:6814/3343463680","heartbeat_back_addr":"192.168.123.109:6816/3343463680","heartbeat_front_addr":"192.168.123.109:6815/3343463680","state":["exists","up"]},{"osd":4,"uuid":"074c1bd5-fecc-49fc-9e3b-607b8dab9818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6800","nonce":3070266009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6801","nonce":3070266009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6803","nonce":3070266009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6802","nonce":3070266009}]},"public_addr":"192.168.123.111:6800/3070266009","cluster_addr":"192.168.123.111:6801/3070266009","heartbeat_back_addr":"192.168.123.111:6803/3070266009","heartbeat_front_addr":"192.168.123.111:6802/3070266009","state":["exists","up"]},{"osd":5,"uuid":"8b4995fe-c439-4efc-a4cb-c80f3db969f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6804","nonce":833555371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6805","nonce":833555371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6807","nonce":833555371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6806","nonce":833555371}]},"public_addr":"192.168.123.111:6804/833555371","cluster_addr":"192.168.123.111:6805/833555371","heartbeat_back_addr":"192.168.123.111:6807/833555371","heartbeat_front_addr":"192.168.123.111:6806/833555371","state":["exists","up"]},{"osd":6,"uuid":"6529eea0-0bdd-40e2-b756-3a71b118612f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6808","nonce":11447683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6809","nonce":11447683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6811","nonce":11447683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6810","nonce":11447683}]},"public_addr":"192.168.123.111:6808/11447683","cluster_addr":"192.168.123.111:6809/11447683","heartbeat_back_addr":"192.168.123.111:6811/11447683","heartbeat_front_addr":"192.168.123.111:6810/11447683","state":["exists","up"]},{"osd":7,"uuid":"bf0064f2-9c2f-412d-8e15-98b229eaeb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6812","nonce":1070708555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6813","nonce":1070708555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6815","nonce":1070708555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6814","nonce":1070708555}]},"public_addr":"192.168.123.111:6812/1070708555","cluster_addr":"192.168.123.111:6813/1070708555","heartbeat_back_addr":"192.168.123.111:6815/1070708555","heartbeat_front_addr":"192.168.123.111:6814/1070708555","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:13.064912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:23.835218+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:34.626774+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:44.929867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:53.921929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:05.125931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:14.307281+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:24.548392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.109:6800/3433497319":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/461406719":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/1425409227":"2026-03-10T00:29:30.753036+0000","192.168.123.109:6800/770453877":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/3155151110":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/3016244507":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/252573567":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/3848899338":"2026-03-10T00:29:20.267467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 >> v2:192.168.123.109:6800/82853931 conn(0x7fdb30077590 msgr2=0x7fdb30079a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/646605513 >> v2:192.168.123.109:6800/82853931 conn(0x7fdb30077590 0x7fdb30079a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb440097c0 tx=0x7fdb440057d0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 msgr2=0x7fdb541a2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 0x7fdb541a2780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009990 tx=0x7fdb48009e60 comp rx=0 tx=0).stop 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 shutdown_connections 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/646605513 >> v2:192.168.123.109:6800/82853931 conn(0x7fdb30077590 0x7fdb30079a50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fdb5410f390 0x7fdb5419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fdb54075d30 0x7fdb541a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 --2- 192.168.123.109:0/646605513 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fdb54075410 0x7fdb541a2780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 >> 192.168.123.109:0/646605513 conn(0x7fdb540fe770 msgr2=0x7fdb54100010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 shutdown_connections 2026-03-09T00:31:37.334 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.335+0000 7fdb5c0de640 1 -- 192.168.123.109:0/646605513 wait complete. 2026-03-09T00:31:37.397 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-03-09T00:31:37.397 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd dump --format=json 2026-03-09T00:31:37.566 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:37.699 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.699+0000 7f85ea385640 1 -- 192.168.123.109:0/3143319324 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410e880 msgr2=0x7f85e410ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.699 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.699+0000 7f85ea385640 1 --2- 192.168.123.109:0/3143319324 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410e880 0x7f85e410ec60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009a30 tx=0x7f85e002f240 comp rx=0 tx=0).stop 2026-03-09T00:31:37.700 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 -- 192.168.123.109:0/3143319324 shutdown_connections 2026-03-09T00:31:37.700 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 --2- 192.168.123.109:0/3143319324 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 0x7f85e407bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.700 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 --2- 192.168.123.109:0/3143319324 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f85e410a470 0x7f85e410a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.700 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 --2- 192.168.123.109:0/3143319324 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410e880 0x7f85e410ec60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.700 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 -- 192.168.123.109:0/3143319324 >> 192.168.123.109:0/3143319324 conn(0x7f85e406d940 msgr2=0x7f85e406dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:37.700 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 -- 192.168.123.109:0/3143319324 shutdown_connections 2026-03-09T00:31:37.701 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.701+0000 7f85ea385640 1 -- 192.168.123.109:0/3143319324 wait complete. 2026-03-09T00:31:37.701 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.702+0000 7f85ea385640 1 Processor -- start 2026-03-09T00:31:37.702 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.702+0000 7f85ea385640 1 -- start start 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85ea385640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 0x7f85e41c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85ea385640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 0x7f85e41c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85ea385640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f85e410e880 0x7f85e41baa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85ea385640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f85e4132770 con 0x7f85e410adf0 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85ea385640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f85e41325f0 con 0x7f85e410e880 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85ea385640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f85e41328f0 con 0x7f85e410a470 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e8b82640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 0x7f85e41c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 0x7f85e41c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 0x7f85e41c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:38872/0 (socket says 192.168.123.109:38872) 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 -- 192.168.123.109:0/560998956 learned_addr learned my addr 192.168.123.109:0/560998956 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 -- 192.168.123.109:0/560998956 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f85e410e880 msgr2=0x7f85e41baa10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f85e410e880 0x7f85e41baa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 -- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 msgr2=0x7f85e41c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 0x7f85e41c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.703+0000 7f85e9383640 1 -- 192.168.123.109:0/560998956 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e41bb1e0 con 0x7f85e410a470 2026-03-09T00:31:37.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.704+0000 7f85e8b82640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 0x7f85e41c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:37.704 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.705+0000 7f85e9383640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 0x7f85e41c0850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85e002f750 tx=0x7f85e0002910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:37.704 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.705+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0002a80 con 0x7f85e410a470 2026-03-09T00:31:37.704 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.705+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e41bb470 con 0x7f85e410a470 2026-03-09T00:31:37.705 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.706+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e41c7720 con 0x7f85e410a470 2026-03-09T00:31:37.708 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.708+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f85e0005030 con 0x7f85e410a470 2026-03-09T00:31:37.708 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.709+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004ac0 con 0x7f85e410a470 2026-03-09T00:31:37.708 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.709+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f85e0038770 con 0x7f85e410a470 2026-03-09T00:31:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.709+0000 7f85da7fc640 1 --2- 192.168.123.109:0/560998956 >> v2:192.168.123.109:6800/82853931 conn(0x7f85b0077590 0x7f85b0079a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.709+0000 7f85e8b82640 1 --2- 192.168.123.109:0/560998956 >> v2:192.168.123.109:6800/82853931 conn(0x7f85b0077590 0x7f85b0079a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:37.709 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.710+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f85e00beae0 con 0x7f85e410a470 2026-03-09T00:31:37.712 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.710+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e4074560 con 0x7f85e410a470 2026-03-09T00:31:37.714 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.714+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f85e00051e0 con 0x7f85e410a470 2026-03-09T00:31:37.716 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.717+0000 7f85e8b82640 1 --2- 192.168.123.109:0/560998956 >> v2:192.168.123.109:6800/82853931 conn(0x7f85b0077590 0x7f85b0079a50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85e4073be0 tx=0x7f85dc00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:37.834 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.833+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85e410a8b0 con 0x7f85e410a470 2026-03-09T00:31:37.835 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.836+0000 7f85da7fc640 1 -- 192.168.123.109:0/560998956 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+20875 (secure 0 0 0) 0x7f85e008ba40 con 0x7f85e410a470 2026-03-09T00:31:37.836 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:37.836 INFO:teuthology.orchestra.run.vm09.stdout:{"epoch":54,"fsid":"c172d940-1b4e-11f1-be3e-fb1b568ebce1","created":"2026-03-09T00:29:07.790682+0000","modified":"2026-03-09T00:31:37.654272+0000","last_up_change":"2026-03-09T00:31:26.043166+0000","last_in_change":"2026-03-09T00:31:16.093998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T00:30:36.800055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2026-03-09T00:31:28.420247+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2026-03-09T00:31:28.806199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2026-03-09T00:31:30.191626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2026-03-09T00:31:32.672488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2026-03-09T00:31:34.801016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"358ee389-cb78-4018-b8af-afdaff60ba71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6801","nonce":3241136735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6802","nonce":3241136735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6804","nonce":3241136735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6803","nonce":3241136735}]},"public_addr":"192.168.123.109:6801/3241136735","cluster_addr":"192.168.123.109:6802/3241136735","heartbeat_back_addr":"192.168.123.109:6804/3241136735","heartbeat_front_addr":"192.168.123.109:6803/3241136735","state":["exists","up"]},{"osd":1,"uuid":"504373ca-3989-4555-acb0-64b55de70bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6805","nonce":64355271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6806","nonce":64355271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6808","nonce":64355271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6807","nonce":64355271}]},"public_addr":"192.168.123.109:6805/64355271","cluster_addr":"192.168.123.109:6806/64355271","heartbeat_back_addr":"192.168.123.109:6808/64355271","heartbeat_front_addr":"192.168.123.109:6807/64355271","state":["exists","up"]},{"osd":2,"uuid":"d1e4aed4-61e3-4b5c-90eb-fd9480495a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6809","nonce":1100722638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6810","nonce":1100722638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6812","nonce":1100722638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6811","nonce":1100722638}]},"public_addr":"192.168.123.109:6809/1100722638","cluster_addr":"192.168.123.109:6810/1100722638","heartbeat_back_addr":"192.168.123.109:6812/1100722638","heartbeat_front_addr":"192.168.123.109:6811/1100722638","state":["exists","up"]},{"osd":3,"uuid":"f49ec9f2-9291-4311-ba8a-82828daa1996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6813","nonce":3343463680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6814","nonce":3343463680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6816","nonce":3343463680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.109:6815","nonce":3343463680}]},"public_addr":"192.168.123.109:6813/3343463680","cluster_addr":"192.168.123.109:6814/3343463680","heartbeat_back_addr":"192.168.123.109:6816/3343463680","heartbeat_front_addr":"192.168.123.109:6815/3343463680","state":["exists","up"]},{"osd":4,"uuid":"074c1bd5-fecc-49fc-9e3b-607b8dab9818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6800","nonce":3070266009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6801","nonce":3070266009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6803","nonce":3070266009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6802","nonce":3070266009}]},"public_addr":"192.168.123.111:6800/3070266009","cluster_addr":"192.168.123.111:6801/3070266009","heartbeat_back_addr":"192.168.123.111:6803/3070266009","heartbeat_front_addr":"192.168.123.111:6802/3070266009","state":["exists","up"]},{"osd":5,"uuid":"8b4995fe-c439-4efc-a4cb-c80f3db969f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6804","nonce":833555371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6805","nonce":833555371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6807","nonce":833555371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6806","nonce":833555371}]},"public_addr":"192.168.123.111:6804/833555371","cluster_addr":"192.168.123.111:6805/833555371","heartbeat_back_addr":"192.168.123.111:6807/833555371","heartbeat_front_addr":"192.168.123.111:6806/833555371","state":["exists","up"]},{"osd":6,"uuid":"6529eea0-0bdd-40e2-b756-3a71b118612f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6808","nonce":11447683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6809","nonce":11447683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6811","nonce":11447683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6810","nonce":11447683}]},"public_addr":"192.168.123.111:6808/11447683","cluster_addr":"192.168.123.111:6809/11447683","heartbeat_back_addr":"192.168.123.111:6811/11447683","heartbeat_front_addr":"192.168.123.111:6810/11447683","state":["exists","up"]},{"osd":7,"uuid":"bf0064f2-9c2f-412d-8e15-98b229eaeb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6812","nonce":1070708555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6813","nonce":1070708555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6815","nonce":1070708555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.111:6814","nonce":1070708555}]},"public_addr":"192.168.123.111:6812/1070708555","cluster_addr":"192.168.123.111:6813/1070708555","heartbeat_back_addr":"192.168.123.111:6815/1070708555","heartbeat_front_addr":"192.168.123.111:6814/1070708555","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:13.064912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:23.835218+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:34.626774+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:44.929867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:53.921929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:05.125931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:14.307281+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:24.548392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.109:6800/3433497319":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/461406719":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/1425409227":"2026-03-10T00:29:30.753036+0000","192.168.123.109:6800/770453877":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/3155151110":"2026-03-10T00:29:30.753036+0000","192.168.123.109:0/3016244507":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/252573567":"2026-03-10T00:29:20.267467+0000","192.168.123.109:0/3848899338":"2026-03-10T00:29:20.267467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T00:31:37.840 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 >> v2:192.168.123.109:6800/82853931 conn(0x7f85b0077590 msgr2=0x7f85b0079a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.840 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 --2- 192.168.123.109:0/560998956 >> v2:192.168.123.109:6800/82853931 conn(0x7f85b0077590 0x7f85b0079a50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85e4073be0 tx=0x7f85dc00b040 comp rx=0 tx=0).stop 2026-03-09T00:31:37.840 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 msgr2=0x7f85e41c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:37.840 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 0x7f85e41c0850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85e002f750 tx=0x7f85e0002910 comp rx=0 tx=0).stop 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 shutdown_connections 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 --2- 192.168.123.109:0/560998956 >> v2:192.168.123.109:6800/82853931 conn(0x7f85b0077590 0x7f85b0079a50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f85e410e880 0x7f85e41baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f85e410adf0 0x7f85e41c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 --2- 192.168.123.109:0/560998956 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f85e410a470 0x7f85e41c0850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.841+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 >> 192.168.123.109:0/560998956 conn(0x7f85e406d940 msgr2=0x7f85e410d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.842+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 shutdown_connections 2026-03-09T00:31:37.841 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:37.842+0000 7f85ea385640 1 -- 192.168.123.109:0/560998956 wait complete. 2026-03-09T00:31:37.892 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[56118]: pgmap v106: 132 pgs: 19 creating+peering, 75 active+clean, 38 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/646605513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[56118]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[56118]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[56118]: osdmap e54: 8 total, 8 up, 8 in 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/560998956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[49458]: pgmap v106: 132 pgs: 19 creating+peering, 75 active+clean, 38 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/646605513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[49458]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[49458]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[49458]: osdmap e54: 8 total, 8 up, 8 in 2026-03-09T00:31:37.893 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/560998956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:37.893 INFO:journalctl@ceph.rgw.foo.a.vm09.stdout:Mar 09 00:31:37 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-rgw-foo-a[79378]: 2026-03-09T00:31:37.769+0000 7f37e05dd980 -1 LDAP not started since no server URIs were provided in the configuration. 2026-03-09T00:31:37.926 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.0 flush_pg_stats 2026-03-09T00:31:37.926 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.1 flush_pg_stats 2026-03-09T00:31:37.927 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.2 flush_pg_stats 2026-03-09T00:31:37.927 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.3 flush_pg_stats 2026-03-09T00:31:37.927 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.4 flush_pg_stats 2026-03-09T00:31:37.927 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.5 flush_pg_stats 2026-03-09T00:31:37.927 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.6 flush_pg_stats 2026-03-09T00:31:37.927 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph tell osd.7 flush_pg_stats 2026-03-09T00:31:38.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:37 vm11 ceph-mon[53379]: pgmap v106: 132 pgs: 19 creating+peering, 75 active+clean, 38 unknown; 450 KiB data, 214 MiB used, 160 GiB / 160 GiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2026-03-09T00:31:38.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:37 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/646605513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:38.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:37 vm11 ceph-mon[53379]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T00:31:38.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:37 vm11 ceph-mon[53379]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T00:31:38.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:37 vm11 ceph-mon[53379]: osdmap e54: 8 total, 8 up, 8 in 2026-03-09T00:31:38.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:37 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/560998956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:38.998 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.044 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.072 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.091 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.104 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.200 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.200 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 systemd[1]: Starting Ceph iscsi.iscsi.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:31:39.280 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.309 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:39.404 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[49458]: Deploying daemon iscsi.iscsi.a on vm11 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:39.405 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:39 vm09 ceph-mon[56118]: Deploying daemon iscsi.iscsi.a on vm11 2026-03-09T00:31:39.422 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.409+0000 7fc9ad01a640 1 -- 192.168.123.109:0/3954120036 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 msgr2=0x7fc9a810acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.422 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.409+0000 7fc9ad01a640 1 --2- 192.168.123.109:0/3954120036 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 0x7fc9a810acb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009990 tx=0x7fc99c02f1b0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.432 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.429+0000 7fc9ad01a640 1 -- 192.168.123.109:0/3954120036 shutdown_connections 2026-03-09T00:31:39.432 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.429+0000 7fc9ad01a640 1 --2- 192.168.123.109:0/3954120036 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc9a811c780 0x7fc9a811eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.432 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.429+0000 7fc9ad01a640 1 --2- 192.168.123.109:0/3954120036 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 0x7fc9a810acb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.432 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.429+0000 7fc9ad01a640 1 --2- 192.168.123.109:0/3954120036 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc9a810a470 0x7fc9a81114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.432 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.429+0000 7fc9ad01a640 1 -- 192.168.123.109:0/3954120036 >> 192.168.123.109:0/3954120036 conn(0x7fc9a806dae0 msgr2=0x7fc9a806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.432 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.429+0000 7fc9ad01a640 1 -- 192.168.123.109:0/3954120036 shutdown_connections 2026-03-09T00:31:39.433 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 -- 192.168.123.109:0/3954120036 wait complete. 2026-03-09T00:31:39.433 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 Processor -- start 2026-03-09T00:31:39.433 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 -- start start 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc9a810a470 0x7fc9a81af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 0x7fc9a81afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc9a811c780 0x7fc9a81a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8121550 con 0x7fc9a810a850 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81213d0 con 0x7fc9a810a470 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.433+0000 7fc9ad01a640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a81216d0 con 0x7fc9a811c780 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.443+0000 7fc9a7577640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc9a811c780 0x7fc9a81a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.443+0000 7fc9a6d76640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc9a810a470 0x7fc9a81af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.443+0000 7fc9a6575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 0x7fc9a81afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.443+0000 7fc9a6575640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 0x7fc9a81afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:58788/0 (socket says 192.168.123.109:58788) 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.443+0000 7fc9a6575640 1 -- 192.168.123.109:0/619346615 learned_addr learned my addr 192.168.123.109:0/619346615 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.445+0000 7fc9a7577640 1 -- 192.168.123.109:0/619346615 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc9a810a470 msgr2=0x7fc9a81af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.445+0000 7fc9a7577640 1 --2- 192.168.123.109:0/619346615 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc9a810a470 0x7fc9a81af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.445+0000 7fc9a7577640 1 -- 192.168.123.109:0/619346615 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 msgr2=0x7fc9a81afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.445+0000 7fc9a7577640 1 --2- 192.168.123.109:0/619346615 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc9a810a850 0x7fc9a81afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.447 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.445+0000 7fc9a7577640 1 -- 192.168.123.109:0/619346615 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a81aa0d0 con 0x7fc9a811c780 2026-03-09T00:31:39.449 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.447+0000 7fc9a7577640 1 --2- 192.168.123.109:0/619346615 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc9a811c780 0x7fc9a81a9900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000efc0 tx=0x7fc9a000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.449 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.447+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0019070 con 0x7fc9a811c780 2026-03-09T00:31:39.449 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.448+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fc9a00092d0 con 0x7fc9a811c780 2026-03-09T00:31:39.449 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.448+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0004890 con 0x7fc9a811c780 2026-03-09T00:31:39.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.450+0000 7fc9ad01a640 1 -- 192.168.123.109:0/619346615 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a81aa360 con 0x7fc9a811c780 2026-03-09T00:31:39.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.450+0000 7fc9ad01a640 1 -- 192.168.123.109:0/619346615 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81b6610 con 0x7fc9a811c780 2026-03-09T00:31:39.464 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.454+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc96c000f80 con 0x7fc9a811c780 2026-03-09T00:31:39.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.456+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fc9a0002a60 con 0x7fc9a811c780 2026-03-09T00:31:39.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.456+0000 7fc987fff640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6800/82853931 conn(0x7fc97c077540 0x7fc97c079a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.456+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fc9a00996f0 con 0x7fc9a811c780 2026-03-09T00:31:39.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.457+0000 7fc987fff640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6801/3241136735 conn(0x7fc97c080b10 0x7fc97c082f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.457+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 --> v2:192.168.123.109:6801/3241136735 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9a00092d0 con 0x7fc97c080b10 2026-03-09T00:31:39.469 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.457+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc9a0099ae0 con 0x7fc9a811c780 2026-03-09T00:31:39.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.474+0000 7fc9a6d76640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6800/82853931 conn(0x7fc97c077540 0x7fc97c079a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.474+0000 7fc9a6575640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6801/3241136735 conn(0x7fc97c080b10 0x7fc97c082f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:39.475 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:39 vm11 ceph-mon[53379]: Deploying daemon iscsi.iscsi.a on vm11 2026-03-09T00:31:39.476 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 podman[77592]: 2026-03-09 00:31:39.222225157 +0000 UTC m=+0.017456696 container create f76c6e12d3e40a54953a37bf326ae408b520bba868cb1df551bc1229f2bbfd52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T00:31:39.476 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 podman[77592]: 2026-03-09 00:31:39.261612175 +0000 UTC m=+0.056843714 container init f76c6e12d3e40a54953a37bf326ae408b520bba868cb1df551bc1229f2bbfd52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image) 2026-03-09T00:31:39.476 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 podman[77592]: 2026-03-09 00:31:39.265087499 +0000 UTC m=+0.060319027 container start f76c6e12d3e40a54953a37bf326ae408b520bba868cb1df551bc1229f2bbfd52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-03-09T00:31:39.476 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 bash[77592]: f76c6e12d3e40a54953a37bf326ae408b520bba868cb1df551bc1229f2bbfd52 2026-03-09T00:31:39.476 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 podman[77592]: 2026-03-09 00:31:39.215484714 +0000 UTC m=+0.010716263 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T00:31:39.476 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 systemd[1]: Started Ceph iscsi.iscsi.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:31:39.493 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.482+0000 7fc9a6d76640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6800/82853931 conn(0x7fc97c077540 0x7fc97c079a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc9a81aaa40 tx=0x7fc998009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.493 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.491+0000 7fc9a6575640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6801/3241136735 conn(0x7fc97c080b10 0x7fc97c082f70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.493 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.492+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== osd.0 v2:192.168.123.109:6801/3241136735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc9a00092d0 con 0x7fc97c080b10 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- 192.168.123.109:0/1625268955 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410adf0 msgr2=0x7f2dc407bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/1625268955 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410adf0 0x7f2dc407bbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2db8008900 tx=0x7f2db8033630 comp rx=0 tx=0).stop 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- 192.168.123.109:0/1625268955 shutdown_connections 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/1625268955 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410adf0 0x7f2dc407bbe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/1625268955 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 0x7f2dc410a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/1625268955 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2dc410e880 0x7f2dc410ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- 192.168.123.109:0/1625268955 >> 192.168.123.109:0/1625268955 conn(0x7f2dc406d970 msgr2=0x7f2dc406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- 192.168.123.109:0/1625268955 shutdown_connections 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- 192.168.123.109:0/1625268955 wait complete. 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 Processor -- start 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- start start 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 0x7f2dc407b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2dc410adf0 0x7f2dc4075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410e880 0x7f2dc4075cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc407e6b0 con 0x7f2dc410a470 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc407e530 con 0x7f2dc410adf0 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.504+0000 7f2dc9f14640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc407e830 con 0x7f2dc410e880 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.505+0000 7f2dc37fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 0x7f2dc407b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.505+0000 7f2dc37fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 0x7f2dc407b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:58810/0 (socket says 192.168.123.109:58810) 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.505+0000 7f2dc37fe640 1 -- 192.168.123.109:0/3032693676 learned_addr learned my addr 192.168.123.109:0/3032693676 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.505+0000 7f2dc2ffd640 1 --2- 192.168.123.109:0/3032693676 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2dc410adf0 0x7f2dc4075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.505+0000 7f2dc3fff640 1 --2- 192.168.123.109:0/3032693676 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410e880 0x7f2dc4075cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.506+0000 7f2dc37fe640 1 -- 192.168.123.109:0/3032693676 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410e880 msgr2=0x7f2dc4075cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.506+0000 7f2dc37fe640 1 --2- 192.168.123.109:0/3032693676 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f2dc410e880 0x7f2dc4075cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.506+0000 7f2dc37fe640 1 -- 192.168.123.109:0/3032693676 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2dc410adf0 msgr2=0x7f2dc4075790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.506+0000 7f2dc37fe640 1 --2- 192.168.123.109:0/3032693676 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f2dc410adf0 0x7f2dc4075790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.506+0000 7f2dc37fe640 1 -- 192.168.123.109:0/3032693676 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc4076310 con 0x7f2dc410a470 2026-03-09T00:31:39.510 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.507+0000 7f2dc37fe640 1 --2- 192.168.123.109:0/3032693676 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 0x7f2dc407b6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c990 tx=0x7f2db400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.562 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.561+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007c70 con 0x7f2dc410a470 2026-03-09T00:31:39.562 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.562+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f2db4007e10 con 0x7f2dc410a470 2026-03-09T00:31:39.562 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.562+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db400f450 con 0x7f2dc410a470 2026-03-09T00:31:39.564 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.564+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc41cfd60 con 0x7f2dc410a470 2026-03-09T00:31:39.564 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.564+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc41d0100 con 0x7f2dc410a470 2026-03-09T00:31:39.614 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.583+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d88000f80 con 0x7f2dc410a470 2026-03-09T00:31:39.629 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.612+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f2db4020020 con 0x7f2dc410a470 2026-03-09T00:31:39.634 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.613+0000 7f2dc0ff9640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.109:6800/82853931 conn(0x7f2d940776a0 0x7f2d94079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.634 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.613+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f2db4099300 con 0x7f2dc410a470 2026-03-09T00:31:39.634 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.613+0000 7f2dc0ff9640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.111:6808/11447683 conn(0x7f2d94080cf0 0x7f2d94083150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.634 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.613+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 --> v2:192.168.123.111:6808/11447683 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2db4019e50 con 0x7f2d94080cf0 2026-03-09T00:31:39.634 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.615+0000 7f2dc2ffd640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.109:6800/82853931 conn(0x7f2d940776a0 0x7f2d94079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.634 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.615+0000 7f2dc3fff640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.111:6808/11447683 conn(0x7f2d94080cf0 0x7f2d94083150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.635 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.621+0000 7f2dc3fff640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.111:6808/11447683 conn(0x7f2d94080cf0 0x7f2d94083150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.635 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.634+0000 7f2dc2ffd640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.109:6800/82853931 conn(0x7f2d940776a0 0x7f2d94079b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2dc407f220 tx=0x7f2dbc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.671 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.672+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 --> v2:192.168.123.109:6801/3241136735 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc96c002cf0 con 0x7fc97c080b10 2026-03-09T00:31:39.680 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.681+0000 7fc987fff640 1 -- 192.168.123.109:0/619346615 <== osd.0 v2:192.168.123.109:6801/3241136735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc96c002cf0 con 0x7fc97c080b10 2026-03-09T00:31:39.690 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.634+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== osd.6 v2:192.168.123.111:6808/11447683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2db4019e50 con 0x7f2d94080cf0 2026-03-09T00:31:39.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.685+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6801/3241136735 conn(0x7fc97c080b10 msgr2=0x7fc97c082f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.691 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.685+0000 7fc985ffb640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6801/3241136735 conn(0x7fc97c080b10 0x7fc97c082f70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.692+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6800/82853931 conn(0x7fc97c077540 msgr2=0x7fc97c079a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.692+0000 7fc985ffb640 1 --2- 192.168.123.109:0/619346615 >> v2:192.168.123.109:6800/82853931 conn(0x7fc97c077540 0x7fc97c079a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc9a81aaa40 tx=0x7fc998009340 comp rx=0 tx=0).stop 2026-03-09T00:31:39.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.692+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc9a811c780 msgr2=0x7fc9a81a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.692+0000 7fc985ffb640 1 --2- 192.168.123.109:0/619346615 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc9a811c780 0x7fc9a81a9900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000efc0 tx=0x7fc9a000c490 comp rx=0 tx=0).stop 2026-03-09T00:31:39.695 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.696+0000 7fc9a7577640 1 -- 192.168.123.109:0/619346615 reap_dead start 2026-03-09T00:31:39.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.701+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 shutdown_connections 2026-03-09T00:31:39.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.701+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 >> 192.168.123.109:0/619346615 conn(0x7fc9a806dae0 msgr2=0x7fc9a811d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.704+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 shutdown_connections 2026-03-09T00:31:39.703 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.704+0000 7fc985ffb640 1 -- 192.168.123.109:0/619346615 wait complete. 2026-03-09T00:31:39.729 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.728+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2db40a0050 con 0x7f2dc410a470 2026-03-09T00:31:39.734 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.734+0000 7fd19f465640 1 -- 192.168.123.109:0/414663025 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd1981139c0 msgr2=0x7fd198115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.734 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.734+0000 7fd19f465640 1 --2- 192.168.123.109:0/414663025 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd1981139c0 0x7fd198115db0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd19400b0a0 tx=0x7fd19402f450 comp rx=0 tx=0).stop 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 -- 192.168.123.109:0/414663025 shutdown_connections 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 --2- 192.168.123.109:0/414663025 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd1981139c0 0x7fd198115db0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 --2- 192.168.123.109:0/414663025 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd198077f40 0x7fd198113480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 --2- 192.168.123.109:0/414663025 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd198077620 0x7fd198077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 -- 192.168.123.109:0/414663025 >> 192.168.123.109:0/414663025 conn(0x7fd198100840 msgr2=0x7fd198102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 -- 192.168.123.109:0/414663025 shutdown_connections 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.740+0000 7f00d2758640 1 -- 192.168.123.109:0/986995171 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f00cc10a850 msgr2=0x7f00cc10acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.740+0000 7f00d2758640 1 --2- 192.168.123.109:0/986995171 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f00cc10a850 0x7f00cc10acb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00c401c4f0 tx=0x7f00c40408b0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7fd19f465640 1 -- 192.168.123.109:0/414663025 wait complete. 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7f00d2758640 1 -- 192.168.123.109:0/986995171 shutdown_connections 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7f00d2758640 1 --2- 192.168.123.109:0/986995171 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc11c780 0x7f00cc11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7f00d2758640 1 --2- 192.168.123.109:0/986995171 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f00cc10a850 0x7f00cc10acb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7f00d2758640 1 --2- 192.168.123.109:0/986995171 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f00cc10a470 0x7f00cc1114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.746+0000 7f00d2758640 1 -- 192.168.123.109:0/986995171 >> 192.168.123.109:0/986995171 conn(0x7f00cc06dae0 msgr2=0x7f00cc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 Processor -- start 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7f00d2758640 1 -- 192.168.123.109:0/986995171 shutdown_connections 2026-03-09T00:31:39.746 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7f00d2758640 1 -- 192.168.123.109:0/986995171 wait complete. 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 -- start start 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd198077620 0x7fd19810c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd198077f40 0x7fd19810ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd1981139c0 0x7fd198111370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fd198104d90 con 0x7fd198077620 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd198104c10 con 0x7fd1981139c0 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.747+0000 7fd19f465640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fd198104f10 con 0x7fd198077f40 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.748+0000 7fd19ec64640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd1981139c0 0x7fd198111370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.749 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.748+0000 7f00d2758640 1 Processor -- start 2026-03-09T00:31:39.750 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 -- start start 2026-03-09T00:31:39.750 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f00cc10a470 0x7f00cc117430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.750 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc10a850 0x7f00cc117970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.750 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f00cc11c780 0x7f00cc117eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.750 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc113c20 con 0x7f00cc10a850 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc113aa0 con 0x7f00cc11c780 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00d2758640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc113da0 con 0x7f00cc10a470 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00cb7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc10a850 0x7f00cc117970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00cb7fe640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc10a850 0x7f00cc117970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:58854/0 (socket says 192.168.123.109:58854) 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00cb7fe640 1 -- 192.168.123.109:0/881263519 learned_addr learned my addr 192.168.123.109:0/881263519 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.750+0000 7f00cbfff640 1 --2- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f00cc10a470 0x7f00cc117430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cb7fe640 1 -- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f00cc10a470 msgr2=0x7f00cc117430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cb7fe640 1 --2- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f00cc10a470 0x7f00cc117430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cb7fe640 1 -- 192.168.123.109:0/881263519 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f00cc11c780 msgr2=0x7f00cc117eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cb7fe640 1 --2- 192.168.123.109:0/881263519 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f00cc11c780 0x7f00cc117eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cb7fe640 1 -- 192.168.123.109:0/881263519 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc1ad480 con 0x7f00cc10a850 2026-03-09T00:31:39.751 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cbfff640 1 --2- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f00cc10a470 0x7f00cc117430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7fd19ec64640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd1981139c0 0x7fd198111370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48514/0 (socket says 192.168.123.109:48514) 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7fd19ec64640 1 -- 192.168.123.109:0/1684964913 learned_addr learned my addr 192.168.123.109:0/1684964913 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19ec64640 1 -- 192.168.123.109:0/1684964913 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd198077f40 msgr2=0x7fd19810ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19ec64640 1 --2- 192.168.123.109:0/1684964913 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fd198077f40 0x7fd19810ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.751+0000 7f00cb7fe640 1 --2- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc10a850 0x7f00cc117970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f00c40047f0 tx=0x7f00c4004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.753+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4018be0 con 0x7f00cc10a850 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.753+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc1ad710 con 0x7f00cc10a850 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.753+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc1adba0 con 0x7f00cc10a850 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.753+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f00c4018d80 con 0x7f00cc10a850 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.753+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4048940 con 0x7f00cc10a850 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.753+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00cc071ea0 con 0x7f00cc10a850 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19ec64640 1 -- 192.168.123.109:0/1684964913 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd198077620 msgr2=0x7fd19810c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19e463640 1 --2- 192.168.123.109:0/1684964913 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd198077620 0x7fd19810c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19ec64640 1 --2- 192.168.123.109:0/1684964913 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd198077620 0x7fd19810c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19ec64640 1 -- 192.168.123.109:0/1684964913 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1981118b0 con 0x7fd1981139c0 2026-03-09T00:31:39.753 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.754+0000 7fd19e463640 1 --2- 192.168.123.109:0/1684964913 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fd198077620 0x7fd19810c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:39.756 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.757+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f00c4048ae0 con 0x7f00cc10a850 2026-03-09T00:31:39.756 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.757+0000 7f00c97fa640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6800/82853931 conn(0x7f009c0776a0 0x7f009c079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.758 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.759+0000 7fd19ec64640 1 --2- 192.168.123.109:0/1684964913 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd1981139c0 0x7fd198111370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1940095a0 tx=0x7fd19400b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.762+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194045070 con 0x7fd1981139c0 2026-03-09T00:31:39.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.762+0000 7fd19f465640 1 -- 192.168.123.109:0/1684964913 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd198111b40 con 0x7fd1981139c0 2026-03-09T00:31:39.761 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.762+0000 7fd19f465640 1 -- 192.168.123.109:0/1684964913 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd198112080 con 0x7fd1981139c0 2026-03-09T00:31:39.762 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.763+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fd194033050 con 0x7fd1981139c0 2026-03-09T00:31:39.762 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.763+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194040860 con 0x7fd1981139c0 2026-03-09T00:31:39.766 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.765+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd164000f80 con 0x7fd1981139c0 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 -- 192.168.123.109:0/752619425 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb810a470 msgr2=0x7f7bb810a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 --2- 192.168.123.109:0/752619425 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb810a470 0x7f7bb810a8b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000b0a0 tx=0x7f7bb002f450 comp rx=0 tx=0).stop 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 -- 192.168.123.109:0/752619425 shutdown_connections 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 --2- 192.168.123.109:0/752619425 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 0x7f7bb807bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 --2- 192.168.123.109:0/752619425 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb810a470 0x7f7bb810a8b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 --2- 192.168.123.109:0/752619425 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7bb810e880 0x7f7bb810ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.769 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 -- 192.168.123.109:0/752619425 >> 192.168.123.109:0/752619425 conn(0x7f7bb806d970 msgr2=0x7f7bb806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.771 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 -- 192.168.123.109:0/752619425 shutdown_connections 2026-03-09T00:31:39.771 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.769+0000 7f7bbec49640 1 -- 192.168.123.109:0/752619425 wait complete. 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 Processor -- start 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 -- start start 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 0x7f7bb80758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7bb810e880 0x7f7bb8075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb807b0f0 0x7f7bb807b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb807e820 con 0x7f7bb807b0f0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb807e6a0 con 0x7f7bb810adf0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.771+0000 7f7bbec49640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb807e9a0 con 0x7f7bb810e880 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 0x7f7bb80758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 0x7f7bb80758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48520/0 (socket says 192.168.123.109:48520) 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 -- 192.168.123.109:0/1205409259 learned_addr learned my addr 192.168.123.109:0/1205409259 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bb7fff640 1 --2- 192.168.123.109:0/1205409259 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7bb810e880 0x7f7bb8075df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbd1bf640 1 --2- 192.168.123.109:0/1205409259 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb807b0f0 0x7f7bb807b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 -- 192.168.123.109:0/1205409259 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7bb810e880 msgr2=0x7f7bb8075df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 --2- 192.168.123.109:0/1205409259 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f7bb810e880 0x7f7bb8075df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 -- 192.168.123.109:0/1205409259 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb807b0f0 msgr2=0x7f7bb807b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 --2- 192.168.123.109:0/1205409259 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f7bb807b0f0 0x7f7bb807b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.772+0000 7f7bbc9be640 1 -- 192.168.123.109:0/1205409259 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb807bd40 con 0x7f7bb810adf0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.773+0000 7f7bbc9be640 1 --2- 192.168.123.109:0/1205409259 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 0x7f7bb80758b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800afa0 tx=0x7f7ba800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.773 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.774+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8004480 con 0x7f7bb810adf0 2026-03-09T00:31:39.776 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.774+0000 7f7bbec49640 1 -- 192.168.123.109:0/1205409259 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb81be950 con 0x7f7bb810adf0 2026-03-09T00:31:39.776 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.774+0000 7f7bbec49640 1 -- 192.168.123.109:0/1205409259 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb81bee00 con 0x7f7bb810adf0 2026-03-09T00:31:39.776 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.775+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f7ba8015070 con 0x7f7bb810adf0 2026-03-09T00:31:39.776 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.775+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8002700 con 0x7f7bb810adf0 2026-03-09T00:31:39.776 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.775+0000 7f7bbec49640 1 -- 192.168.123.109:0/1205409259 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b84000f80 con 0x7f7bb810adf0 2026-03-09T00:31:39.776 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.777+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f7ba8011910 con 0x7f7bb810adf0 2026-03-09T00:31:39.778 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb5ffb640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.109:6800/82853931 conn(0x7f7b900776a0 0x7f7b90079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.780 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb7fff640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.109:6800/82853931 conn(0x7f7b900776a0 0x7f7b90079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.780 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f7ba809dc10 con 0x7f7bb810adf0 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb7fff640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.109:6800/82853931 conn(0x7f7b900776a0 0x7f7b90079b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8076d30 tx=0x7f7bb003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb5ffb640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.111:6800/3070266009 conn(0x7f7b90080d70 0x7f7b900831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 --> v2:192.168.123.111:6800/3070266009 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b90083860 con 0x7f7b90080d70 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.779+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f7ba809df80 con 0x7f7bb810adf0 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.780+0000 7f7bbd1bf640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.111:6800/3070266009 conn(0x7f7b90080d70 0x7f7b900831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.782+0000 7f7bbd1bf640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.111:6800/3070266009 conn(0x7f7b90080d70 0x7f7b900831d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.781 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.782+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== osd.4 v2:192.168.123.111:6800/3070266009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f7b90083860 con 0x7f7b90080d70 2026-03-09T00:31:39.784 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.784+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fd19404a430 con 0x7fd1981139c0 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.787+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 --> v2:192.168.123.111:6808/11447683 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d88002d70 con 0x7f2d94080cf0 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.757+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f00c40d0780 con 0x7f00cc10a850 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.757+0000 7f00c97fa640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6813/3343463680 conn(0x7f009c080d70 0x7f009c0831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.757+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 --> v2:192.168.123.109:6813/3343463680 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00c4060ea0 con 0x7f009c080d70 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.757+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f00c40d0b70 con 0x7f00cc10a850 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.759+0000 7f00cbfff640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6800/82853931 conn(0x7f009c0776a0 0x7f009c079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.760+0000 7f00cbfff640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6800/82853931 conn(0x7f009c0776a0 0x7f009c079b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00bc004500 tx=0x7f00bc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.795+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 --> v2:192.168.123.111:6800/3070266009 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b84002cb0 con 0x7f7b90080d70 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.794+0000 7fd1877fe640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.109:6800/82853931 conn(0x7fd1740776a0 0x7fd174079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.794+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fd1940bed90 con 0x7fd1981139c0 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.794+0000 7fd1877fe640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.111:6812/1070708555 conn(0x7fd174080d70 0x7fd1740831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.794+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 --> v2:192.168.123.111:6812/1070708555 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd194033ec0 con 0x7fd174080d70 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.794+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd1940c2020 con 0x7fd1981139c0 2026-03-09T00:31:39.796 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.797+0000 7f00d0cce640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6813/3343463680 conn(0x7f009c080d70 0x7f009c0831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7bb5ffb640 1 -- 192.168.123.109:0/1205409259 <== osd.4 v2:192.168.123.111:6800/3070266009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7b84002cb0 con 0x7f7b90080d70 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 >> v2:192.168.123.111:6800/3070266009 conn(0x7f7b90080d70 msgr2=0x7f7b900831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.111:6800/3070266009 conn(0x7f7b90080d70 0x7f7b900831d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 >> v2:192.168.123.109:6800/82853931 conn(0x7f7b900776a0 msgr2=0x7f7b90079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 --2- 192.168.123.109:0/1205409259 >> v2:192.168.123.109:6800/82853931 conn(0x7f7b900776a0 0x7f7b90079b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8076d30 tx=0x7f7bb003a040 comp rx=0 tx=0).stop 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 msgr2=0x7f7bb80758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 --2- 192.168.123.109:0/1205409259 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f7bb810adf0 0x7f7bb80758b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800afa0 tx=0x7f7ba800cf20 comp rx=0 tx=0).stop 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7bbd1bf640 1 -- 192.168.123.109:0/1205409259 reap_dead start 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 shutdown_connections 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 >> 192.168.123.109:0/1205409259 conn(0x7f7bb806d970 msgr2=0x7f7bb8072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 shutdown_connections 2026-03-09T00:31:39.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.800+0000 7f7b8f7fe640 1 -- 192.168.123.109:0/1205409259 wait complete. 2026-03-09T00:31:39.801 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.801+0000 7fd19dc62640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.111:6812/1070708555 conn(0x7fd174080d70 0x7fd1740831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.801 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.801+0000 7fd19e463640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.109:6800/82853931 conn(0x7fd1740776a0 0x7fd174079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.803 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.802+0000 7f2dc0ff9640 1 -- 192.168.123.109:0/3032693676 <== osd.6 v2:192.168.123.111:6808/11447683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2d88002d70 con 0x7f2d94080cf0 2026-03-09T00:31:39.805 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.806+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 >> v2:192.168.123.111:6808/11447683 conn(0x7f2d94080cf0 msgr2=0x7f2d94083150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.805 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.806+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.111:6808/11447683 conn(0x7f2d94080cf0 0x7f2d94083150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7fd19dc62640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.111:6812/1070708555 conn(0x7fd174080d70 0x7fd1740831d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7f00d0cce640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6813/3343463680 conn(0x7f009c080d70 0x7f009c0831d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 >> v2:192.168.123.109:6800/82853931 conn(0x7f2d940776a0 msgr2=0x7f2d94079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/3032693676 >> v2:192.168.123.109:6800/82853931 conn(0x7f2d940776a0 0x7f2d94079b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2dc407f220 tx=0x7f2dbc00d040 comp rx=0 tx=0).stop 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 msgr2=0x7f2dc407b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7f2dc9f14640 1 --2- 192.168.123.109:0/3032693676 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f2dc410a470 0x7f2dc407b6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c990 tx=0x7f2db400ce60 comp rx=0 tx=0).stop 2026-03-09T00:31:39.807 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.808+0000 7f2dc3fff640 1 -- 192.168.123.109:0/3032693676 reap_dead start 2026-03-09T00:31:39.813 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.812+0000 7fd19e463640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.109:6800/82853931 conn(0x7fd1740776a0 0x7fd174079b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.813 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.812+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== osd.7 v2:192.168.123.111:6812/1070708555 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd194033ec0 con 0x7fd174080d70 2026-03-09T00:31:39.815 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.812+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== osd.3 v2:192.168.123.109:6813/3343463680 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f00c4060ea0 con 0x7f009c080d70 2026-03-09T00:31:39.816 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.816+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 shutdown_connections 2026-03-09T00:31:39.816 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.816+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 >> 192.168.123.109:0/3032693676 conn(0x7f2dc406d970 msgr2=0x7f2dc410d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.816 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.817+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 shutdown_connections 2026-03-09T00:31:39.816 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.817+0000 7f2dc9f14640 1 -- 192.168.123.109:0/3032693676 wait complete. 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.821+0000 7fee03b23640 1 -- 192.168.123.109:0/3808153190 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fedfc11c780 msgr2=0x7fedfc11eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.821+0000 7fee03b23640 1 --2- 192.168.123.109:0/3808153190 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fedfc11c780 0x7fedfc11eb70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009fc0 tx=0x7fedf802f3d0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.821+0000 7fee03b23640 1 -- 192.168.123.109:0/3808153190 shutdown_connections 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 --2- 192.168.123.109:0/3808153190 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fedfc11c780 0x7fedfc11eb70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 --2- 192.168.123.109:0/3808153190 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fedfc10a850 0x7fedfc10acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 --2- 192.168.123.109:0/3808153190 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fedfc10a470 0x7fedfc1114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 -- 192.168.123.109:0/3808153190 >> 192.168.123.109:0/3808153190 conn(0x7fedfc06dae0 msgr2=0x7fedfc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 -- 192.168.123.109:0/3808153190 shutdown_connections 2026-03-09T00:31:39.821 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 -- 192.168.123.109:0/3808153190 wait complete. 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.822+0000 7fee03b23640 1 Processor -- start 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 -- start start 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fedfc10a470 0x7fedfc1a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fedfc10a850 0x7fedfc1a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fedfc1ae020 0x7fedfc1ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc121550 con 0x7fedfc1ae020 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1213d0 con 0x7fedfc10a470 2026-03-09T00:31:39.822 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee03b23640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc1216d0 con 0x7fedfc10a850 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.823+0000 7fee01898640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fedfc10a470 0x7fedfc1a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fedfc10a850 0x7fedfc1a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01898640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fedfc10a470 0x7fedfc1a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48540/0 (socket says 192.168.123.109:48540) 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01898640 1 -- 192.168.123.109:0/2760445734 learned_addr learned my addr 192.168.123.109:0/2760445734 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 -- 192.168.123.109:0/2760445734 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fedfc10a470 msgr2=0x7fedfc1a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 --2- 192.168.123.109:0/2760445734 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fedfc10a470 0x7fedfc1a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 -- 192.168.123.109:0/2760445734 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fedfc1ae020 msgr2=0x7fedfc1ae4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 --2- 192.168.123.109:0/2760445734 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fedfc1ae020 0x7fedfc1ae4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.823 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 -- 192.168.123.109:0/2760445734 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc1aeb70 con 0x7fedfc10a850 2026-03-09T00:31:39.824 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.824+0000 7fee01097640 1 --2- 192.168.123.109:0/2760445734 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fedfc10a850 0x7fedfc1a9c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fedf000ed30 tx=0x7fedf000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.824 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.825+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf000cdc0 con 0x7fedfc10a850 2026-03-09T00:31:39.825 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.825+0000 7fee03b23640 1 -- 192.168.123.109:0/2760445734 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc1aee60 con 0x7fedfc10a850 2026-03-09T00:31:39.825 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.825+0000 7fee03b23640 1 -- 192.168.123.109:0/2760445734 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc1120d0 con 0x7fedfc10a850 2026-03-09T00:31:39.826 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.827+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fedf0004540 con 0x7fedfc10a850 2026-03-09T00:31:39.826 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.827+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0010450 con 0x7fedfc10a850 2026-03-09T00:31:39.827 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.828+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fedf0020070 con 0x7fedfc10a850 2026-03-09T00:31:39.827 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.828+0000 7fedeaffd640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.109:6800/82853931 conn(0x7fedcc0776d0 0x7fedcc079b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.830 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.831+0000 7fee01898640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.109:6800/82853931 conn(0x7fedcc0776d0 0x7fedcc079b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.830 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.831+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fedf009ab90 con 0x7fedfc10a850 2026-03-09T00:31:39.834 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.831+0000 7fee01898640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.109:6800/82853931 conn(0x7fedcc0776d0 0x7fedcc079b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fedec0046b0 tx=0x7fedec009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.834 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.834+0000 7fede8ff9640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.111:6804/833555371 conn(0x7fedc8001630 0x7fedc8003af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.834 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.834+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 --> v2:192.168.123.111:6804/833555371 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedc8006ba0 con 0x7fedc8001630 2026-03-09T00:31:39.834 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.834+0000 7fee02099640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.111:6804/833555371 conn(0x7fedc8001630 0x7fedc8003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.834 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.835+0000 7fee02099640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.111:6804/833555371 conn(0x7fedc8001630 0x7fedc8003af0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.835 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.835+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== osd.5 v2:192.168.123.111:6804/833555371 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fedc8006ba0 con 0x7fedc8001630 2026-03-09T00:31:39.847 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.845+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 --> v2:192.168.123.111:6812/1070708555 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd164002d70 con 0x7fd174080d70 2026-03-09T00:31:39.850 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.849+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 --> v2:192.168.123.109:6813/3343463680 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00cc0720b0 con 0x7f009c080d70 2026-03-09T00:31:39.855 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.856+0000 7f00c97fa640 1 -- 192.168.123.109:0/881263519 <== osd.3 v2:192.168.123.109:6813/3343463680 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00cc0720b0 con 0x7f009c080d70 2026-03-09T00:31:39.856 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.856+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 --> v2:192.168.123.111:6804/833555371 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedc8005ca0 con 0x7fedc8001630 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.857+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6813/3343463680 conn(0x7f009c080d70 msgr2=0x7f009c0831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.857+0000 7f00d2758640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6813/3343463680 conn(0x7f009c080d70 0x7f009c0831d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.858+0000 7fd1877fe640 1 -- 192.168.123.109:0/1684964913 <== osd.7 v2:192.168.123.111:6812/1070708555 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd164002d70 con 0x7fd174080d70 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.858+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6800/82853931 conn(0x7f009c0776a0 msgr2=0x7f009c079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.858+0000 7f00d2758640 1 --2- 192.168.123.109:0/881263519 >> v2:192.168.123.109:6800/82853931 conn(0x7f009c0776a0 0x7f009c079b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00bc004500 tx=0x7f00bc009290 comp rx=0 tx=0).stop 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.858+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc10a850 msgr2=0x7f00cc117970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.858+0000 7f00d2758640 1 --2- 192.168.123.109:0/881263519 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f00cc10a850 0x7f00cc117970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f00c40047f0 tx=0x7f00c4004820 comp rx=0 tx=0).stop 2026-03-09T00:31:39.857 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.858+0000 7f00d0cce640 1 -- 192.168.123.109:0/881263519 reap_dead start 2026-03-09T00:31:39.858 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.859+0000 7fedeaffd640 1 -- 192.168.123.109:0/2760445734 <== osd.5 v2:192.168.123.111:6804/833555371 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fedc8005ca0 con 0x7fedc8001630 2026-03-09T00:31:39.858 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.859+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 >> v2:192.168.123.111:6812/1070708555 conn(0x7fd174080d70 msgr2=0x7fd1740831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.858 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.859+0000 7fd1857fa640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.111:6812/1070708555 conn(0x7fd174080d70 0x7fd1740831d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 >> v2:192.168.123.109:6800/82853931 conn(0x7fd1740776a0 msgr2=0x7fd174079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd1857fa640 1 --2- 192.168.123.109:0/1684964913 >> v2:192.168.123.109:6800/82853931 conn(0x7fd1740776a0 0x7fd174079b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).stop 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd1981139c0 msgr2=0x7fd198111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.861+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 shutdown_connections 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.861+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 >> 192.168.123.109:0/881263519 conn(0x7f00cc06dae0 msgr2=0x7f00cc0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.861+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 shutdown_connections 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd1857fa640 1 --2- 192.168.123.109:0/1684964913 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fd1981139c0 0x7fd198111370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1940095a0 tx=0x7fd19400b000 comp rx=0 tx=0).stop 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd19ec64640 1 -- 192.168.123.109:0/1684964913 reap_dead start 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7f00d2758640 1 -- 192.168.123.109:0/881263519 wait complete. 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 shutdown_connections 2026-03-09T00:31:39.861 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.862+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 >> 192.168.123.109:0/1684964913 conn(0x7fd198100840 msgr2=0x7fd198102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.862 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.863+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 shutdown_connections 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.863+0000 7fd1857fa640 1 -- 192.168.123.109:0/1684964913 wait complete. 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.863+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 >> v2:192.168.123.111:6804/833555371 conn(0x7fedc8001630 msgr2=0x7fedc8003af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.863+0000 7fede8ff9640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.111:6804/833555371 conn(0x7fedc8001630 0x7fedc8003af0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.863+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 >> v2:192.168.123.109:6800/82853931 conn(0x7fedcc0776d0 msgr2=0x7fedcc079b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.863+0000 7fede8ff9640 1 --2- 192.168.123.109:0/2760445734 >> v2:192.168.123.109:6800/82853931 conn(0x7fedcc0776d0 0x7fedcc079b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fedec0046b0 tx=0x7fedec009290 comp rx=0 tx=0).stop 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.864+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fedfc10a850 msgr2=0x7fedfc1a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.864+0000 7fede8ff9640 1 --2- 192.168.123.109:0/2760445734 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fedfc10a850 0x7fedfc1a9c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fedf000ed30 tx=0x7fedf000c6a0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.863 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.864+0000 7fee02099640 1 -- 192.168.123.109:0/2760445734 reap_dead start 2026-03-09T00:31:39.870 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.870+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 shutdown_connections 2026-03-09T00:31:39.870 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.870+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 >> 192.168.123.109:0/2760445734 conn(0x7fedfc06dae0 msgr2=0x7fedfc11a770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.870 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.871+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 shutdown_connections 2026-03-09T00:31:39.870 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.871+0000 7fede8ff9640 1 -- 192.168.123.109:0/2760445734 wait complete. 2026-03-09T00:31:39.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.886+0000 7f3d81f25640 1 -- 192.168.123.109:0/1528408186 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10a470 msgr2=0x7f3d7c10a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.886+0000 7f3d81f25640 1 --2- 192.168.123.109:0/1528408186 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10a470 0x7f3d7c10a8b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400b0a0 tx=0x7f3d7402f450 comp rx=0 tx=0).stop 2026-03-09T00:31:39.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.888+0000 7f3d81f25640 1 -- 192.168.123.109:0/1528408186 shutdown_connections 2026-03-09T00:31:39.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.888+0000 7f3d81f25640 1 --2- 192.168.123.109:0/1528408186 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 0x7f3d7c07bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.888+0000 7f3d81f25640 1 --2- 192.168.123.109:0/1528408186 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10a470 0x7f3d7c10a8b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.888+0000 7f3d81f25640 1 --2- 192.168.123.109:0/1528408186 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3d7c10e880 0x7f3d7c10ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.888+0000 7f3d81f25640 1 -- 192.168.123.109:0/1528408186 >> 192.168.123.109:0/1528408186 conn(0x7f3d7c06d970 msgr2=0x7f3d7c06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.891 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.888+0000 7f3d81f25640 1 -- 192.168.123.109:0/1528408186 shutdown_connections 2026-03-09T00:31:39.891 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 -- 192.168.123.109:0/1528408186 wait complete. 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 Processor -- start 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 -- start start 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 0x7f3d7c0758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10e880 0x7f3d7c075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3d7c07b0f0 0x7f3d7c07b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c07e820 con 0x7f3d7c10e880 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c07e6a0 con 0x7f3d7c10adf0 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.889+0000 7f3d81f25640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c07e9a0 con 0x7f3d7c07b0f0 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.890+0000 7f3d7affd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10e880 0x7f3d7c075df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.891+0000 7f3d7b7fe640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 0x7f3d7c0758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.891+0000 7f3d7b7fe640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 0x7f3d7c0758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48544/0 (socket says 192.168.123.109:48544) 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.891+0000 7f3d7b7fe640 1 -- 192.168.123.109:0/70706517 learned_addr learned my addr 192.168.123.109:0/70706517 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7bfff640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3d7c07b0f0 0x7f3d7c07b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7b7fe640 1 -- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3d7c07b0f0 msgr2=0x7f3d7c07b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7b7fe640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3d7c07b0f0 0x7f3d7c07b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7b7fe640 1 -- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10e880 msgr2=0x7f3d7c075df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7b7fe640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10e880 0x7f3d7c075df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7b7fe640 1 -- 192.168.123.109:0/70706517 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c07bd40 con 0x7f3d7c10adf0 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7affd640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f3d7c10e880 0x7f3d7c075df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7bfff640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f3d7c07b0f0 0x7f3d7c07b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:39.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.892+0000 7f3d7b7fe640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 0x7f3d7c0758b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00cab0 tx=0x7f3d6c00cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.896 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.896+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c013070 con 0x7f3d7c10adf0 2026-03-09T00:31:39.906 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.897+0000 7f3d81f25640 1 -- 192.168.123.109:0/70706517 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c1be950 con 0x7f3d7c10adf0 2026-03-09T00:31:39.907 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.897+0000 7f3d81f25640 1 -- 192.168.123.109:0/70706517 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c1bee00 con 0x7f3d7c10adf0 2026-03-09T00:31:39.907 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.907+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f3d6c007da0 con 0x7f3d7c10adf0 2026-03-09T00:31:39.907 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.907+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00f450 con 0x7f3d7c10adf0 2026-03-09T00:31:39.908 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.909+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f3d6c020020 con 0x7f3d7c10adf0 2026-03-09T00:31:39.919 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.919+0000 7f3d78ff9640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6800/82853931 conn(0x7f3d4c0776a0 0x7f3d4c079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.920+0000 7f3d7affd640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6800/82853931 conn(0x7f3d4c0776a0 0x7f3d4c079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.920+0000 7f3d7affd640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6800/82853931 conn(0x7f3d4c0776a0 0x7f3d4c079b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c076d30 tx=0x7f3d7403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.920+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f3d6c09a3b0 con 0x7f3d7c10adf0 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.920+0000 7f3d81f25640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6805/64355271 conn(0x7f3d48001630 0x7f3d48003af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.920+0000 7f3d7bfff640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6805/64355271 conn(0x7f3d48001630 0x7f3d48003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.921+0000 7f3d7bfff640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6805/64355271 conn(0x7f3d48001630 0x7f3d48003af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.921+0000 7f3d81f25640 1 -- 192.168.123.109:0/70706517 --> v2:192.168.123.109:6805/64355271 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d48006ba0 con 0x7f3d48001630 2026-03-09T00:31:39.928 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.922+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== osd.1 v2:192.168.123.109:6805/64355271 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3d48006ba0 con 0x7f3d48001630 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug Started the configuration object watcher 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug Checking for config object changes every 1s 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug Processing osd blocklist entries for this node 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug Reading the configuration object to update local LIO configuration 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug Configuration does not have an entry for this host(vm11.local) - nothing to define to LIO 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: * Serving Flask app 'rbd-target-api' (lazy loading) 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: * Environment: production 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: WARNING: This is a development server. Do not use it in a production deployment. 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: Use a production WSGI server instead. 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: * Debug mode: off 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug * Running on all addresses. 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: WARNING: This is a development server. Do not use it in a production deployment. 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: * Running on all addresses. 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: WARNING: This is a development server. Do not use it in a production deployment. 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug * Running on http://[::1]:5000/ (Press CTRL+C to quit) 2026-03-09T00:31:39.950 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:39 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: * Running on http://[::1]:5000/ (Press CTRL+C to quit) 2026-03-09T00:31:39.959 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.959+0000 7f3d81f25640 1 -- 192.168.123.109:0/70706517 --> v2:192.168.123.109:6805/64355271 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d48005ca0 con 0x7f3d48001630 2026-03-09T00:31:39.964 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.963+0000 7f3d78ff9640 1 -- 192.168.123.109:0/70706517 <== osd.1 v2:192.168.123.109:6805/64355271 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d48005ca0 con 0x7f3d48001630 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.964+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6805/64355271 conn(0x7f3d48001630 msgr2=0x7f3d48003af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6805/64355271 conn(0x7f3d48001630 0x7f3d48003af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6800/82853931 conn(0x7f3d4c0776a0 msgr2=0x7f3d4c079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 --2- 192.168.123.109:0/70706517 >> v2:192.168.123.109:6800/82853931 conn(0x7f3d4c0776a0 0x7f3d4c079b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c076d30 tx=0x7f3d7403a040 comp rx=0 tx=0).stop 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 msgr2=0x7f3d7c0758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 --2- 192.168.123.109:0/70706517 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f3d7c10adf0 0x7f3d7c0758b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00cab0 tx=0x7f3d6c00cf80 comp rx=0 tx=0).stop 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d7bfff640 1 -- 192.168.123.109:0/70706517 reap_dead start 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 shutdown_connections 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.966+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 >> 192.168.123.109:0/70706517 conn(0x7f3d7c06d970 msgr2=0x7f3d7c072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.967+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 shutdown_connections 2026-03-09T00:31:39.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.967+0000 7f3d5a7fc640 1 -- 192.168.123.109:0/70706517 wait complete. 2026-03-09T00:31:39.973 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.973+0000 7f1779826640 1 -- 192.168.123.109:0/1027899125 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 msgr2=0x7f177410a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.973 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.973+0000 7f1779826640 1 --2- 192.168.123.109:0/1027899125 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f177410a8b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d310 tx=0x7f176c033bf0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.981+0000 7f1779826640 1 -- 192.168.123.109:0/1027899125 shutdown_connections 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.981+0000 7f1779826640 1 --2- 192.168.123.109:0/1027899125 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f177410adf0 0x7f177407bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.981+0000 7f1779826640 1 --2- 192.168.123.109:0/1027899125 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f177410a8b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.981+0000 7f1779826640 1 --2- 192.168.123.109:0/1027899125 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f177410e880 0x7f177410ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.981+0000 7f1779826640 1 -- 192.168.123.109:0/1027899125 >> 192.168.123.109:0/1027899125 conn(0x7f177406d970 msgr2=0x7f177406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.981+0000 7f1779826640 1 -- 192.168.123.109:0/1027899125 shutdown_connections 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.982+0000 7f1779826640 1 -- 192.168.123.109:0/1027899125 wait complete. 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 Processor -- start 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 -- start start 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f17741c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f177410adf0 0x7f17741c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f177410e880 0x7f17741ba950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f17741327a0 con 0x7f177410a470 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1774132620 con 0x7f177410e880 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1779826640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f1774132920 con 0x7f177410adf0 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1772ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f17741c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1772ffd640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f17741c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:58906/0 (socket says 192.168.123.109:58906) 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f1772ffd640 1 -- 192.168.123.109:0/564362498 learned_addr learned my addr 192.168.123.109:0/564362498 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f17737fe640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f177410e880 0x7f17741ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.983+0000 7f17727fc640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f177410adf0 0x7f17741c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:39.983 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.984+0000 7f1772ffd640 1 -- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f177410adf0 msgr2=0x7f17741c0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:39.992 INFO:teuthology.orchestra.run.vm09.stdout:98784247820 2026-03-09T00:31:39.992 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.3 2026-03-09T00:31:40.010 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.984+0000 7f1772ffd640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f177410adf0 0x7f17741c0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.010 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.984+0000 7f1772ffd640 1 -- 192.168.123.109:0/564362498 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f177410e880 msgr2=0x7f17741ba950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:40.010 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.984+0000 7f1772ffd640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f177410e880 0x7f17741ba950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.010 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.984+0000 7f1772ffd640 1 -- 192.168.123.109:0/564362498 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17741bb120 con 0x7f177410a470 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:39.997+0000 7f17727fc640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f177410adf0 0x7f17741c0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.000+0000 7f17737fe640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f177410e880 0x7f17741ba950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.001+0000 7f1772ffd640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f17741c0790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f176800d950 tx=0x7f176800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.002+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768014070 con 0x7f177410a470 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.002+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17741bb410 con 0x7f177410a470 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.002+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177407d980 con 0x7f177410a470 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.002+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f17680044e0 con 0x7f177410a470 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.002+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768002e50 con 0x7f177410a470 2026-03-09T00:31:40.011 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.003+0000 7f17527fc640 1 -- 192.168.123.109:0/564362498 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1738000f80 con 0x7f177410a470 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.008+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f1768021020 con 0x7f177410a470 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.008+0000 7f1778824640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6800/82853931 conn(0x7f1744077840 0x7f1744079d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.008+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f17680996a0 con 0x7f177410a470 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.009+0000 7f1778824640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6809/1100722638 conn(0x7f1744080e90 0x7f17440832f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.009+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 --> v2:192.168.123.109:6809/1100722638 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1768012e80 con 0x7f1744080e90 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.013+0000 7f17727fc640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6800/82853931 conn(0x7f1744077840 0x7f1744079d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.013+0000 7f17727fc640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6800/82853931 conn(0x7f1744077840 0x7f1744079d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f177406de90 tx=0x7f176c002750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.013+0000 7f17737fe640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6809/1100722638 conn(0x7f1744080e90 0x7f17440832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:40.015 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.016+0000 7f17737fe640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6809/1100722638 conn(0x7f1744080e90 0x7f17440832f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:40.024 INFO:teuthology.orchestra.run.vm09.stdout:38654705682 2026-03-09T00:31:40.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.016+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f17680a0050 con 0x7f177410a470 2026-03-09T00:31:40.024 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.019+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== osd.2 v2:192.168.123.109:6809/1100722638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f1768012e80 con 0x7f1744080e90 2026-03-09T00:31:40.024 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.0 2026-03-09T00:31:40.085 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.085+0000 7f17527fc640 1 -- 192.168.123.109:0/564362498 --> v2:192.168.123.109:6809/1100722638 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1738002d70 con 0x7f1744080e90 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.086+0000 7f1778824640 1 -- 192.168.123.109:0/564362498 <== osd.2 v2:192.168.123.109:6809/1100722638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1738002d70 con 0x7f1744080e90 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.087+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6809/1100722638 conn(0x7f1744080e90 msgr2=0x7f17440832f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.087+0000 7f1779826640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6809/1100722638 conn(0x7f1744080e90 0x7f17440832f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.088+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6800/82853931 conn(0x7f1744077840 msgr2=0x7f1744079d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.088+0000 7f1779826640 1 --2- 192.168.123.109:0/564362498 >> v2:192.168.123.109:6800/82853931 conn(0x7f1744077840 0x7f1744079d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f177406de90 tx=0x7f176c002750 comp rx=0 tx=0).stop 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.088+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 msgr2=0x7f17741c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.088+0000 7f1779826640 1 --2- 192.168.123.109:0/564362498 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f177410a470 0x7f17741c0790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f176800d950 tx=0x7f176800de20 comp rx=0 tx=0).stop 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.088+0000 7f17737fe640 1 -- 192.168.123.109:0/564362498 reap_dead start 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.089+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 shutdown_connections 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.089+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 >> 192.168.123.109:0/564362498 conn(0x7f177406d970 msgr2=0x7f1774073100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.089+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 shutdown_connections 2026-03-09T00:31:40.091 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.089+0000 7f1779826640 1 -- 192.168.123.109:0/564362498 wait complete. 2026-03-09T00:31:40.133 INFO:teuthology.orchestra.run.vm09.stdout:115964117002 2026-03-09T00:31:40.134 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.4 2026-03-09T00:31:40.137 INFO:teuthology.orchestra.run.vm09.stdout:55834574864 2026-03-09T00:31:40.137 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.1 2026-03-09T00:31:40.162 INFO:teuthology.orchestra.run.vm09.stdout:137438953480 2026-03-09T00:31:40.162 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.5 2026-03-09T00:31:40.178 INFO:teuthology.orchestra.run.vm09.stdout:163208757254 2026-03-09T00:31:40.179 INFO:teuthology.orchestra.run.vm09.stdout:184683593732 2026-03-09T00:31:40.179 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.6 2026-03-09T00:31:40.179 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.7 2026-03-09T00:31:40.189 INFO:teuthology.orchestra.run.vm09.stdout:73014444046 2026-03-09T00:31:40.189 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.2 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: pgmap v108: 132 pgs: 4 creating+activating, 9 creating+peering, 111 active+clean, 8 unknown; 450 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.5 KiB/s rd, 743 B/s wr, 3 op/s 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: Checking pool "datapool" exists for service iscsi.datapool 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[49458]: from='client.? 192.168.123.111:0/2653810011' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: pgmap v108: 132 pgs: 4 creating+activating, 9 creating+peering, 111 active+clean, 8 unknown; 450 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.5 KiB/s rd, 743 B/s wr, 3 op/s 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: Checking pool "datapool" exists for service iscsi.datapool 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.427 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:40 vm09 ceph-mon[56118]: from='client.? 192.168.123.111:0/2653810011' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T00:31:40.617 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:40.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: pgmap v108: 132 pgs: 4 creating+activating, 9 creating+peering, 111 active+clean, 8 unknown; 450 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.5 KiB/s rd, 743 B/s wr, 3 op/s 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: Checking pool "datapool" exists for service iscsi.datapool 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:40.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:40 vm11 ceph-mon[53379]: from='client.? 192.168.123.111:0/2653810011' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T00:31:40.868 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 -- 192.168.123.109:0/3851992658 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac10a6d0 msgr2=0x7fe7ac10aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 --2- 192.168.123.109:0/3851992658 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac10a6d0 0x7fe7ac10aab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80079a0 tx=0x7fe7a8031130 comp rx=0 tx=0).stop 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 -- 192.168.123.109:0/3851992658 shutdown_connections 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 --2- 192.168.123.109:0/3851992658 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 0x7fe7ac07bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 --2- 192.168.123.109:0/3851992658 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 --2- 192.168.123.109:0/3851992658 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac10a6d0 0x7fe7ac10aab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.883 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 -- 192.168.123.109:0/3851992658 >> 192.168.123.109:0/3851992658 conn(0x7fe7ac06dae0 msgr2=0x7fe7ac06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 -- 192.168.123.109:0/3851992658 shutdown_connections 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.883+0000 7fe7b474f640 1 -- 192.168.123.109:0/3851992658 wait complete. 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 Processor -- start 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 -- start start 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 0x7fe7ac07bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac075de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac076320 0x7fe7ac0767d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac07df10 con 0x7fe7ac075560 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac07dd90 con 0x7fe7ac10b080 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b474f640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac07e090 con 0x7fe7ac076320 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b1cc3640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac075de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b1cc3640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac075de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48566/0 (socket says 192.168.123.109:48566) 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b1cc3640 1 -- 192.168.123.109:0/374041123 learned_addr learned my addr 192.168.123.109:0/374041123 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b24c4640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 0x7fe7ac07bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b24c4640 1 -- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac076320 msgr2=0x7fe7ac0767d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b2cc5640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac076320 0x7fe7ac0767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b24c4640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac076320 0x7fe7ac0767d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b24c4640 1 -- 192.168.123.109:0/374041123 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 msgr2=0x7fe7ac075de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b24c4640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac075de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b24c4640 1 -- 192.168.123.109:0/374041123 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac137e00 con 0x7fe7ac075560 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.884+0000 7fe7b1cc3640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac075de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.885+0000 7fe7b24c4640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 0x7fe7ac07bb90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8002410 tx=0x7fe7a8031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.885+0000 7fe7b2cc5640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac076320 0x7fe7ac0767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-03-09T00:31:40.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.885+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a803e070 con 0x7fe7ac075560 2026-03-09T00:31:40.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.885+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac138090 con 0x7fe7ac075560 2026-03-09T00:31:40.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.885+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac138520 con 0x7fe7ac075560 2026-03-09T00:31:40.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.887+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fe7a8035070 con 0x7fe7ac075560 2026-03-09T00:31:40.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.887+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8043460 con 0x7fe7ac075560 2026-03-09T00:31:40.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.887+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7fe7a804b070 con 0x7fe7ac075560 2026-03-09T00:31:40.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.888+0000 7fe7a37fe640 1 --2- 192.168.123.109:0/374041123 >> v2:192.168.123.109:6800/82853931 conn(0x7fe7900776d0 0x7fe790079b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:40.889 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.890+0000 7fe7b1cc3640 1 --2- 192.168.123.109:0/374041123 >> v2:192.168.123.109:6800/82853931 conn(0x7fe7900776d0 0x7fe790079b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:40.889 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.890+0000 7fe7b1cc3640 1 --2- 192.168.123.109:0/374041123 >> v2:192.168.123.109:6800/82853931 conn(0x7fe7900776d0 0x7fe790079b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0773d0 tx=0x7fe7a400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:40.889 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.890+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fe7a80becd0 con 0x7fe7ac075560 2026-03-09T00:31:40.889 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.890+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c005180 con 0x7fe7ac075560 2026-03-09T00:31:40.893 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:40.893+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe7a8007580 con 0x7fe7ac075560 2026-03-09T00:31:41.010 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stdout:98784247819 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.011+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe77c005470 con 0x7fe7ac075560 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.013+0000 7fe7a37fe640 1 -- 192.168.123.109:0/374041123 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe7a8087f80 con 0x7fe7ac075560 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.015+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 >> v2:192.168.123.109:6800/82853931 conn(0x7fe7900776d0 msgr2=0x7fe790079b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.015+0000 7fe7b474f640 1 --2- 192.168.123.109:0/374041123 >> v2:192.168.123.109:6800/82853931 conn(0x7fe7900776d0 0x7fe790079b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0773d0 tx=0x7fe7a400b040 comp rx=0 tx=0).stop 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.015+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 msgr2=0x7fe7ac07bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 0x7fe7ac07bb90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8002410 tx=0x7fe7a8031c40 comp rx=0 tx=0).stop 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 shutdown_connections 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 --2- 192.168.123.109:0/374041123 >> v2:192.168.123.109:6800/82853931 conn(0x7fe7900776d0 0x7fe790079b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fe7ac076320 0x7fe7ac0767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fe7ac10b080 0x7fe7ac075de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 --2- 192.168.123.109:0/374041123 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fe7ac075560 0x7fe7ac07bb90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 >> 192.168.123.109:0/374041123 conn(0x7fe7ac06dae0 msgr2=0x7fe7ac080460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 shutdown_connections 2026-03-09T00:31:41.019 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.016+0000 7fe7b474f640 1 -- 192.168.123.109:0/374041123 wait complete. 2026-03-09T00:31:41.148 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247820 got 98784247819 for osd.3 2026-03-09T00:31:41.184 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:41.187 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:41.197 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:41.203 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 -- 192.168.123.109:0/2259544439 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 msgr2=0x7f9830102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 --2- 192.168.123.109:0/2259544439 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 0x7f9830102d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9824009a60 tx=0x7f982402f290 comp rx=0 tx=0).stop 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 -- 192.168.123.109:0/2259544439 shutdown_connections 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 --2- 192.168.123.109:0/2259544439 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f9830103240 0x7f983010f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 --2- 192.168.123.109:0/2259544439 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 0x7f9830102d00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 --2- 192.168.123.109:0/2259544439 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f98301088a0 0x7f9830108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.205+0000 7f9836064640 1 -- 192.168.123.109:0/2259544439 >> 192.168.123.109:0/2259544439 conn(0x7f98300fe580 msgr2=0x7f98301009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.206+0000 7f9836064640 1 -- 192.168.123.109:0/2259544439 shutdown_connections 2026-03-09T00:31:41.205 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.206+0000 7f9836064640 1 -- 192.168.123.109:0/2259544439 wait complete. 2026-03-09T00:31:41.207 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.207+0000 7f9836064640 1 Processor -- start 2026-03-09T00:31:41.207 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.207+0000 7f9836064640 1 -- start start 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9836064640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 0x7f98301a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9836064640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9830103240 0x7f98301a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9836064640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f98301088a0 0x7f983019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9836064640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9830112190 con 0x7f98301028a0 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9836064640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9830112010 con 0x7f98301088a0 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9836064640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f9830112310 con 0x7f9830103240 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9834861640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9830103240 0x7f98301a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9834861640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9830103240 0x7f98301a2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57308/0 (socket says 192.168.123.109:57308) 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9834861640 1 -- 192.168.123.109:0/619629319 learned_addr learned my addr 192.168.123.109:0/619629319 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835863640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f98301088a0 0x7f983019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835062640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 0x7f98301a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835863640 1 -- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9830103240 msgr2=0x7f98301a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835863640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9830103240 0x7f98301a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835863640 1 -- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 msgr2=0x7f98301a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835863640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 0x7f98301a2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.209+0000 7f9835863640 1 -- 192.168.123.109:0/619629319 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983019cf60 con 0x7f98301088a0 2026-03-09T00:31:41.209 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.210+0000 7f9835863640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f98301088a0 0x7f983019c6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f982c004830 tx=0x7f982c00d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.210+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c00db60 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.210+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983019d1f0 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.210+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98301a93b0 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.211+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f8005180 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.211+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f982c00dd00 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.211+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c013650 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.212+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 15) ==== 100000+0+0 (secure 0 0 0) 0x7f982c025080 con 0x7f98301088a0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.213+0000 7f981e7fc640 1 --2- 192.168.123.109:0/619629319 >> v2:192.168.123.109:6800/82853931 conn(0x7f9800077540 0x7f9800079a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.213+0000 7f9835062640 1 --2- 192.168.123.109:0/619629319 >> v2:192.168.123.109:6800/82853931 conn(0x7f9800077540 0x7f9800079a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.213+0000 7f9835062640 1 --2- 192.168.123.109:0/619629319 >> v2:192.168.123.109:6800/82853931 conn(0x7f9800077540 0x7f9800079a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f98200046d0 tx=0x7f9820009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.213 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.213+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f982c099f20 con 0x7f98301088a0 2026-03-09T00:31:41.214 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.214+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f982c010070 con 0x7f98301088a0 2026-03-09T00:31:41.332 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.330+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 7 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f982c012070 con 0x7f98301088a0 2026-03-09T00:31:41.363 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:41.473 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.468+0000 7fc916ea1640 1 -- 192.168.123.109:0/1820904818 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a850 msgr2=0x7fc91010ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.473 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.468+0000 7fc916ea1640 1 --2- 192.168.123.109:0/1820904818 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a850 0x7fc91010ac90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc904009a30 tx=0x7fc90402f2f0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.482 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.479+0000 7fc916ea1640 1 -- 192.168.123.109:0/1820904818 shutdown_connections 2026-03-09T00:31:41.482 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.479+0000 7fc916ea1640 1 --2- 192.168.123.109:0/1820904818 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 0x7fc91011eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.482 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.479+0000 7fc916ea1640 1 --2- 192.168.123.109:0/1820904818 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a850 0x7fc91010ac90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.482 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.479+0000 7fc916ea1640 1 --2- 192.168.123.109:0/1820904818 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc91010a470 0x7fc9101114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.482 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.479+0000 7fc916ea1640 1 -- 192.168.123.109:0/1820904818 >> 192.168.123.109:0/1820904818 conn(0x7fc91006d940 msgr2=0x7fc91006dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.482 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.481+0000 7fc916ea1640 1 -- 192.168.123.109:0/1820904818 shutdown_connections 2026-03-09T00:31:41.487 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.483+0000 7fc916ea1640 1 -- 192.168.123.109:0/1820904818 wait complete. 2026-03-09T00:31:41.487 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.483+0000 7fc916ea1640 1 Processor -- start 2026-03-09T00:31:41.487 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 -- start start 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a470 0x7fc91011bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc91010a850 0x7fc91011bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 0x7fc910115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc9101124b0 con 0x7fc91011c780 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc910112330 con 0x7fc91010a470 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.487+0000 7fc916ea1640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fc910112630 con 0x7fc91010a850 2026-03-09T00:31:41.488 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.488+0000 7fc9166a0640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 0x7fc910115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc915e9f640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a470 0x7fc91011bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc915e9f640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a470 0x7fc91011bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48622/0 (socket says 192.168.123.109:48622) 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc915e9f640 1 -- 192.168.123.109:0/767292713 learned_addr learned my addr 192.168.123.109:0/767292713 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc9166a0640 1 -- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc91010a850 msgr2=0x7fc91011bff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc91569e640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc91010a850 0x7fc91011bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc9166a0640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc91010a850 0x7fc91011bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc9166a0640 1 -- 192.168.123.109:0/767292713 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a470 msgr2=0x7fc91011bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc9166a0640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a470 0x7fc91011bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc9166a0640 1 -- 192.168.123.109:0/767292713 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc910116410 con 0x7fc91011c780 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.489+0000 7fc9166a0640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 0x7fc910115b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009f20 tx=0x7fc90c002b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.490+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00ed40 con 0x7fc91011c780 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.490+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fc90c002e40 con 0x7fc91011c780 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.490+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c018660 con 0x7fc91011c780 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.490+0000 7fc916ea1640 1 -- 192.168.123.109:0/767292713 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc910116700 con 0x7fc91011c780 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.490+0000 7fc916ea1640 1 -- 192.168.123.109:0/767292713 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9101bede0 con 0x7fc91011c780 2026-03-09T00:31:41.495 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.491+0000 7fc916ea1640 1 -- 192.168.123.109:0/767292713 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d8005180 con 0x7fc91011c780 2026-03-09T00:31:41.508 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.498+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7fc90c010430 con 0x7fc91011c780 2026-03-09T00:31:41.508 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.504+0000 7fc8feffd640 1 --2- 192.168.123.109:0/767292713 >> v2:192.168.123.109:6800/82853931 conn(0x7fc8e4077730 0x7fc8e4079bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.508 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.504+0000 7fc915e9f640 1 --2- 192.168.123.109:0/767292713 >> v2:192.168.123.109:6800/82853931 conn(0x7fc8e4077730 0x7fc8e4079bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.508 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.504+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fc90c099ff0 con 0x7fc91011c780 2026-03-09T00:31:41.508 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.505+0000 7fc915e9f640 1 --2- 192.168.123.109:0/767292713 >> v2:192.168.123.109:6800/82853931 conn(0x7fc8e4077730 0x7fc8e4079bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc900009c10 tx=0x7fc90000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.517 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.505+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc90c014030 con 0x7fc91011c780 2026-03-09T00:31:41.523 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:41 vm09 ceph-mon[49458]: Deploying daemon prometheus.a on vm11 2026-03-09T00:31:41.523 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:41 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/374041123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T00:31:41.523 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:41 vm09 ceph-mon[56118]: Deploying daemon prometheus.a on vm11 2026-03-09T00:31:41.523 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:41 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/374041123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T00:31:41.598 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.599+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f97f8005740 con 0x7f98301088a0 2026-03-09T00:31:41.599 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.599+0000 7f981e7fc640 1 -- 192.168.123.109:0/619629319 <== mon.1 v2:192.168.123.111:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f982c06ec70 con 0x7f98301088a0 2026-03-09T00:31:41.604 INFO:teuthology.orchestra.run.vm09.stdout:163208757254 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 -- 192.168.123.109:0/593284073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f542811c780 msgr2=0x7f542811eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 --2- 192.168.123.109:0/593284073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f542811c780 0x7f542811eb70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f541c00b0d0 tx=0x7f541c02f520 comp rx=0 tx=0).stop 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 -- 192.168.123.109:0/593284073 shutdown_connections 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 --2- 192.168.123.109:0/593284073 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f542811c780 0x7f542811eb70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 --2- 192.168.123.109:0/593284073 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 0x7f542810ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 --2- 192.168.123.109:0/593284073 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 -- 192.168.123.109:0/593284073 >> 192.168.123.109:0/593284073 conn(0x7f542806d970 msgr2=0x7f542806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.616 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.616+0000 7f5430926640 1 -- 192.168.123.109:0/593284073 shutdown_connections 2026-03-09T00:31:41.619 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.617+0000 7f5430926640 1 -- 192.168.123.109:0/593284073 wait complete. 2026-03-09T00:31:41.619 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.617+0000 7f5430926640 1 Processor -- start 2026-03-09T00:31:41.620 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.617+0000 7f5430926640 1 -- start start 2026-03-09T00:31:41.620 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f5430926640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.620 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f5430926640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 0x7f5428112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.620 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f5430926640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f54281bbb70 0x7f54281bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.620 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f5430926640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5428121380 con 0x7f54281bbb70 2026-03-09T00:31:41.620 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f5430926640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5428121200 con 0x7f542810a850 2026-03-09T00:31:41.621 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f5430926640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f5428121500 con 0x7f542810a470 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f542e69b640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f542e69b640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281129f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57324/0 (socket says 192.168.123.109:57324) 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f542e69b640 1 -- 192.168.123.109:0/1285729996 learned_addr learned my addr 192.168.123.109:0/1285729996 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f542de9a640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 0x7f5428112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.621+0000 7f542ee9c640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f54281bbb70 0x7f54281bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542de9a640 1 -- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 msgr2=0x7f54281129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542de9a640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542de9a640 1 -- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f54281bbb70 msgr2=0x7f54281bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542de9a640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f54281bbb70 0x7f54281bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.623 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542de9a640 1 -- 192.168.123.109:0/1285729996 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54281be5a0 con 0x7f542810a850 2026-03-09T00:31:41.624 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542e69b640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:41.624 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f542de9a640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 0x7f5428112f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.624 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400cd80 con 0x7f542810a850 2026-03-09T00:31:41.624 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 >> v2:192.168.123.109:6800/82853931 conn(0x7f9800077540 msgr2=0x7f9800079a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.624 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f9836064640 1 --2- 192.168.123.109:0/619629319 >> v2:192.168.123.109:6800/82853931 conn(0x7f9800077540 0x7f9800079a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f98200046d0 tx=0x7f9820009290 comp rx=0 tx=0).stop 2026-03-09T00:31:41.624 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f98301088a0 msgr2=0x7f983019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f9836064640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f98301088a0 0x7f983019c6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f982c004830 tx=0x7f982c00d4a0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 shutdown_connections 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 --2- 192.168.123.109:0/619629319 >> v2:192.168.123.109:6800/82853931 conn(0x7f9800077540 0x7f9800079a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f98301088a0 0x7f983019c6d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f9830103240 0x7f98301a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 --2- 192.168.123.109:0/619629319 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f98301028a0 0x7f98301a2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 >> 192.168.123.109:0/619629319 conn(0x7f98300fe580 msgr2=0x7f9830100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.625 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 shutdown_connections 2026-03-09T00:31:41.628 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.626+0000 7f9836064640 1 -- 192.168.123.109:0/619629319 wait complete. 2026-03-09T00:31:41.632 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.624+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54281be830 con 0x7f542810a850 2026-03-09T00:31:41.632 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.632+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281bedc0 con 0x7f542810a850 2026-03-09T00:31:41.632 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.633+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f5414004540 con 0x7f542810a850 2026-03-09T00:31:41.632 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.633+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414010690 con 0x7f542810a850 2026-03-09T00:31:41.633 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.633+0000 7f54197fa640 1 -- 192.168.123.109:0/1285729996 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f0005180 con 0x7f542810a850 2026-03-09T00:31:41.639 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.640+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f5414002870 con 0x7f542810a850 2026-03-09T00:31:41.645 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.646+0000 7f541b7fe640 1 --2- 192.168.123.109:0/1285729996 >> v2:192.168.123.109:6800/82853931 conn(0x7f5404077660 0x7f5404079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.646 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.647+0000 7f542e69b640 1 --2- 192.168.123.109:0/1285729996 >> v2:192.168.123.109:6800/82853931 conn(0x7f5404077660 0x7f5404079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.647 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.648+0000 7f542e69b640 1 --2- 192.168.123.109:0/1285729996 >> v2:192.168.123.109:6800/82853931 conn(0x7f5404077660 0x7f5404079b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5420009fd0 tx=0x7f5420009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.647 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.648+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f541409a2e0 con 0x7f542810a850 2026-03-09T00:31:41.649 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.650+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f541409a700 con 0x7f542810a850 2026-03-09T00:31:41.657 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.657+0000 7f45c82e4640 1 -- 192.168.123.109:0/3502470989 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c010f390 msgr2=0x7f45c0111780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.657 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.657+0000 7f45c82e4640 1 --2- 192.168.123.109:0/3502470989 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c010f390 0x7f45c0111780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009f90 tx=0x7f45bc02f470 comp rx=0 tx=0).stop 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 -- 192.168.123.109:0/3502470989 shutdown_connections 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 --2- 192.168.123.109:0/3502470989 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c010f390 0x7f45c0111780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 --2- 192.168.123.109:0/3502470989 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f45c0075d30 0x7f45c010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 --2- 192.168.123.109:0/3502470989 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c0075410 0x7f45c00757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 -- 192.168.123.109:0/3502470989 >> 192.168.123.109:0/3502470989 conn(0x7f45c00fe770 msgr2=0x7f45c0100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 -- 192.168.123.109:0/3502470989 shutdown_connections 2026-03-09T00:31:41.663 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.664+0000 7f45c82e4640 1 -- 192.168.123.109:0/3502470989 wait complete. 2026-03-09T00:31:41.666 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.667+0000 7f45c82e4640 1 Processor -- start 2026-03-09T00:31:41.667 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.667+0000 7f45c82e4640 1 -- start start 2026-03-09T00:31:41.667 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c82e4640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f45c0075410 0x7f45c01029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.667 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c82e4640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c0075d30 0x7f45c0102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.667 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c82e4640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c010f390 0x7f45c0103430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c82e4640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0114640 con 0x7f45c010f390 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c82e4640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01144c0 con 0x7f45c0075d30 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c82e4640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f45c01147c0 con 0x7f45c0075410 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c5858640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c0075d30 0x7f45c0102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c5858640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c0075d30 0x7f45c0102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48668/0 (socket says 192.168.123.109:48668) 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c5858640 1 -- 192.168.123.109:0/2265246966 learned_addr learned my addr 192.168.123.109:0/2265246966 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c6059640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f45c0075410 0x7f45c01029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c685a640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c010f390 0x7f45c0103430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c685a640 1 -- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f45c0075410 msgr2=0x7f45c01029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.668+0000 7f45c685a640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f45c0075410 0x7f45c01029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.669+0000 7f45c685a640 1 -- 192.168.123.109:0/2265246966 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c0075d30 msgr2=0x7f45c0102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.669+0000 7f45c685a640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c0075d30 0x7f45c0102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.669+0000 7f45c685a640 1 -- 192.168.123.109:0/2265246966 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c01ad2f0 con 0x7f45c010f390 2026-03-09T00:31:41.668 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.669+0000 7f45c685a640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c010f390 0x7f45c0103430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45c00763f0 tx=0x7f45bc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.671 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.671+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc004d40 con 0x7f45c010f390 2026-03-09T00:31:41.671 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.671+0000 7f45c82e4640 1 -- 192.168.123.109:0/2265246966 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c01ad580 con 0x7f45c010f390 2026-03-09T00:31:41.672 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.671+0000 7f45c82e4640 1 -- 192.168.123.109:0/2265246966 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c01adac0 con 0x7f45c010f390 2026-03-09T00:31:41.672 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.671+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f45bc004870 con 0x7f45c010f390 2026-03-09T00:31:41.672 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.672+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc007e00 con 0x7f45c010f390 2026-03-09T00:31:41.674 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.674+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f45bc005030 con 0x7f45c010f390 2026-03-09T00:31:41.675 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.676+0000 7f45af7fe640 1 --2- 192.168.123.109:0/2265246966 >> v2:192.168.123.109:6800/82853931 conn(0x7f458c077730 0x7f458c079bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.681 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.682+0000 7f45c6059640 1 --2- 192.168.123.109:0/2265246966 >> v2:192.168.123.109:6800/82853931 conn(0x7f458c077730 0x7f458c079bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.682 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.683+0000 7f45c6059640 1 --2- 192.168.123.109:0/2265246966 >> v2:192.168.123.109:6800/82853931 conn(0x7f458c077730 0x7f458c079bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45b0005fd0 tx=0x7f45b0004420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.682 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.683+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f45bc0bf620 con 0x7f45c010f390 2026-03-09T00:31:41.686 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.684+0000 7f45c82e4640 1 -- 192.168.123.109:0/2265246966 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4590005180 con 0x7f45c010f390 2026-03-09T00:31:41.687 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.687+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f45bc088770 con 0x7f45c010f390 2026-03-09T00:31:41.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:41 vm11 ceph-mon[53379]: Deploying daemon prometheus.a on vm11 2026-03-09T00:31:41.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:41 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/374041123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T00:31:41.728 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.728+0000 7fc916ea1640 1 -- 192.168.123.109:0/767292713 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc8d8005740 con 0x7fc91011c780 2026-03-09T00:31:41.735 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.736+0000 7fc8feffd640 1 -- 192.168.123.109:0/767292713 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc90c063140 con 0x7fc91011c780 2026-03-09T00:31:41.735 INFO:teuthology.orchestra.run.vm09.stdout:55834574865 2026-03-09T00:31:41.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 -- 192.168.123.109:0/767292713 >> v2:192.168.123.109:6800/82853931 conn(0x7fc8e4077730 msgr2=0x7fc8e4079bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 --2- 192.168.123.109:0/767292713 >> v2:192.168.123.109:6800/82853931 conn(0x7fc8e4077730 0x7fc8e4079bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc900009c10 tx=0x7fc90000b040 comp rx=0 tx=0).stop 2026-03-09T00:31:41.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 -- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 msgr2=0x7fc910115b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.742 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 0x7fc910115b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009f20 tx=0x7fc90c002b80 comp rx=0 tx=0).stop 2026-03-09T00:31:41.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 -- 192.168.123.109:0/767292713 shutdown_connections 2026-03-09T00:31:41.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 --2- 192.168.123.109:0/767292713 >> v2:192.168.123.109:6800/82853931 conn(0x7fc8e4077730 0x7fc8e4079bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc91011c780 0x7fc910115b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc91010a850 0x7fc91011bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 --2- 192.168.123.109:0/767292713 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc91010a470 0x7fc91011bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.744 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.743+0000 7fc8fcff9640 1 -- 192.168.123.109:0/767292713 >> 192.168.123.109:0/767292713 conn(0x7fc91006d940 msgr2=0x7fc91010b430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.745+0000 7fc8fcff9640 1 -- 192.168.123.109:0/767292713 shutdown_connections 2026-03-09T00:31:41.745 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.745+0000 7fc8fcff9640 1 -- 192.168.123.109:0/767292713 wait complete. 2026-03-09T00:31:41.785 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.781+0000 7fb520a7c640 1 -- 192.168.123.109:0/2598629653 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a470 msgr2=0x7fb51c1114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.785 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.781+0000 7fb520a7c640 1 --2- 192.168.123.109:0/2598629653 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a470 0x7fb51c1114d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb510009a60 tx=0x7fb51002f300 comp rx=0 tx=0).stop 2026-03-09T00:31:41.785 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.786+0000 7fb520a7c640 1 -- 192.168.123.109:0/2598629653 shutdown_connections 2026-03-09T00:31:41.786 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.786+0000 7fb520a7c640 1 --2- 192.168.123.109:0/2598629653 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb51c11c780 0x7fb51c11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.786 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.786+0000 7fb520a7c640 1 --2- 192.168.123.109:0/2598629653 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb51c10a850 0x7fb51c10ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.786 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.786+0000 7fb520a7c640 1 --2- 192.168.123.109:0/2598629653 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a470 0x7fb51c1114d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.786 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.786+0000 7fb520a7c640 1 -- 192.168.123.109:0/2598629653 >> 192.168.123.109:0/2598629653 conn(0x7fb51c06d970 msgr2=0x7fb51c06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.786 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.787+0000 7fb520a7c640 1 -- 192.168.123.109:0/2598629653 shutdown_connections 2026-03-09T00:31:41.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.787+0000 7fb520a7c640 1 -- 192.168.123.109:0/2598629653 wait complete. 2026-03-09T00:31:41.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.788+0000 7fb520a7c640 1 Processor -- start 2026-03-09T00:31:41.787 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.788+0000 7fb520a7c640 1 -- start start 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.788+0000 7fb520a7c640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb51c10a470 0x7fb51c1126e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.788+0000 7fb520a7c640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 0x7fb51c112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb520a7c640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb51c11c780 0x7fb51c1be170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb520a7c640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c121380 con 0x7fb51c10a850 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb520a7c640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c121200 con 0x7fb51c10a470 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb520a7c640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c121500 con 0x7fb51c11c780 2026-03-09T00:31:41.788 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 0x7fb51c112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 0x7fb51c112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59006/0 (socket says 192.168.123.109:59006) 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 -- 192.168.123.109:0/1475322255 learned_addr learned my addr 192.168.123.109:0/1475322255 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 -- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb51c11c780 msgr2=0x7fb51c1be170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb51c11c780 0x7fb51c1be170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 -- 192.168.123.109:0/1475322255 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb51c10a470 msgr2=0x7fb51c1126e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb51c10a470 0x7fb51c1126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 -- 192.168.123.109:0/1475322255 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c1be6b0 con 0x7fb51c10a850 2026-03-09T00:31:41.789 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.789+0000 7fb519d74640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 0x7fb51c112c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb50400b780 tx=0x7fb50400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.790 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.790+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504004480 con 0x7fb51c10a850 2026-03-09T00:31:41.790 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.791+0000 7fb520a7c640 1 -- 192.168.123.109:0/1475322255 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c1be8e0 con 0x7fb51c10a850 2026-03-09T00:31:41.790 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.791+0000 7fb520a7c640 1 -- 192.168.123.109:0/1475322255 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c1bee20 con 0x7fb51c10a850 2026-03-09T00:31:41.790 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.791+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fb504010070 con 0x7fb51c10a850 2026-03-09T00:31:41.790 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.791+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50400ca10 con 0x7fb51c10a850 2026-03-09T00:31:41.798 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.796+0000 7fb520a7c640 1 -- 192.168.123.109:0/1475322255 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e0005180 con 0x7fb51c10a850 2026-03-09T00:31:41.799 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.799+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7fb50400cbb0 con 0x7fb51c10a850 2026-03-09T00:31:41.799 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.800+0000 7fb50b7fe640 1 --2- 192.168.123.109:0/1475322255 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4f0077730 0x7fb4f0079bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.799 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.800+0000 7fb51a575640 1 --2- 192.168.123.109:0/1475322255 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4f0077730 0x7fb4f0079bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.801+0000 7fb51a575640 1 --2- 192.168.123.109:0/1475322255 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4f0077730 0x7fb4f0079bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb510009a60 tx=0x7fb5100023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.801+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fb504099c10 con 0x7fb51c10a850 2026-03-09T00:31:41.800 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.801+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb504002be0 con 0x7fb51c10a850 2026-03-09T00:31:41.846 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757254 got 163208757254 for osd.6 2026-03-09T00:31:41.846 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:41.885 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574864 got 55834574865 for osd.1 2026-03-09T00:31:41.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.884+0000 7f67dd1dc640 1 -- 192.168.123.109:0/3478219618 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 msgr2=0x7f67d811eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.885 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.884+0000 7f67dd1dc640 1 --2- 192.168.123.109:0/3478219618 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d811eb70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b3e0 tx=0x7f67c802f750 comp rx=0 tx=0).stop 2026-03-09T00:31:41.886 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.886+0000 7f67dd1dc640 1 -- 192.168.123.109:0/3478219618 shutdown_connections 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.886+0000 7f67dd1dc640 1 --2- 192.168.123.109:0/3478219618 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d811eb70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.886+0000 7f67dd1dc640 1 --2- 192.168.123.109:0/3478219618 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f67d810a850 0x7f67d810ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.886+0000 7f67dd1dc640 1 --2- 192.168.123.109:0/3478219618 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f67d810a470 0x7f67d81114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.886+0000 7f67dd1dc640 1 -- 192.168.123.109:0/3478219618 >> 192.168.123.109:0/3478219618 conn(0x7f67d806d970 msgr2=0x7f67d806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.886+0000 7f67dd1dc640 1 -- 192.168.123.109:0/3478219618 shutdown_connections 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 -- 192.168.123.109:0/3478219618 wait complete. 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 Processor -- start 2026-03-09T00:31:41.886 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 -- start start 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f67d810a470 0x7f67d8112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f67d810a850 0x7f67d8112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d81be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8121400 con 0x7f67d810a850 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8121280 con 0x7f67d810a470 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.887+0000 7f67dd1dc640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f67d8121580 con 0x7f67d811c780 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d81be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d81be230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57376/0 (socket says 192.168.123.109:57376) 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 -- 192.168.123.109:0/1219603581 learned_addr learned my addr 192.168.123.109:0/1219603581 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d6575640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f67d810a850 0x7f67d8112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.887 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d6d76640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f67d810a470 0x7f67d8112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 -- 192.168.123.109:0/1219603581 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f67d810a470 msgr2=0x7f67d8112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f67d810a470 0x7f67d8112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 -- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f67d810a850 msgr2=0x7f67d8112b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f67d810a850 0x7f67d8112b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.888+0000 7f67d7577640 1 -- 192.168.123.109:0/1219603581 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d81be770 con 0x7f67d811c780 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.889+0000 7f67d7577640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d81be230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f67c8008cc0 tx=0x7f67c8008cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.889+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8004240 con 0x7f67d811c780 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.889+0000 7f67dd1dc640 1 -- 192.168.123.109:0/1219603581 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d81be940 con 0x7f67d811c780 2026-03-09T00:31:41.888 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.889+0000 7f67dd1dc640 1 -- 192.168.123.109:0/1219603581 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d81bed40 con 0x7f67d811c780 2026-03-09T00:31:41.892 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.890+0000 7f67dd1dc640 1 -- 192.168.123.109:0/1219603581 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d80745d0 con 0x7f67d811c780 2026-03-09T00:31:41.893 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.894+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f67c8008e90 con 0x7f67d811c780 2026-03-09T00:31:41.893 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.894+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8037ae0 con 0x7f67d811c780 2026-03-09T00:31:41.893 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.894+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f67c804d480 con 0x7f67d811c780 2026-03-09T00:31:41.893 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.894+0000 7f67bbfff640 1 --2- 192.168.123.109:0/1219603581 >> v2:192.168.123.109:6800/82853931 conn(0x7f67a4077760 0x7f67a4079c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.893 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.894+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f67c80c01c0 con 0x7f67d811c780 2026-03-09T00:31:41.898 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.894+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f67c80c0630 con 0x7f67d811c780 2026-03-09T00:31:41.898 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.895+0000 7f67d6d76640 1 --2- 192.168.123.109:0/1219603581 >> v2:192.168.123.109:6800/82853931 conn(0x7f67a4077760 0x7f67a4079c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.898 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.895+0000 7f67d6d76640 1 --2- 192.168.123.109:0/1219603581 >> v2:192.168.123.109:6800/82853931 conn(0x7f67a4077760 0x7f67a4079c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67cc006fd0 tx=0x7f67cc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.918 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.918+0000 7f8d6122b640 1 -- 192.168.123.109:0/85341050 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 msgr2=0x7f8d5c10ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.918 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.918+0000 7f8d6122b640 1 --2- 192.168.123.109:0/85341050 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 0x7f8d5c10ac90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400b0d0 tx=0x7f8d5402f500 comp rx=0 tx=0).stop 2026-03-09T00:31:41.920 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 -- 192.168.123.109:0/85341050 shutdown_connections 2026-03-09T00:31:41.920 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 --2- 192.168.123.109:0/85341050 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d5c11c780 0x7f8d5c11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.920 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 --2- 192.168.123.109:0/85341050 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 0x7f8d5c10ac90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.920 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 --2- 192.168.123.109:0/85341050 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c1114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.920 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 -- 192.168.123.109:0/85341050 >> 192.168.123.109:0/85341050 conn(0x7f8d5c06d970 msgr2=0x7f8d5c06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.920 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 -- 192.168.123.109:0/85341050 shutdown_connections 2026-03-09T00:31:41.921 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 -- 192.168.123.109:0/85341050 wait complete. 2026-03-09T00:31:41.921 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.921+0000 7f8d6122b640 1 Processor -- start 2026-03-09T00:31:41.921 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 -- start start 2026-03-09T00:31:41.921 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.921 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 0x7f8d5c112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.921 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d5c11c780 0x7f8d5c1be190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c121380 con 0x7f8d5c10a850 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c121200 con 0x7f8d5c11c780 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d6122b640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c121500 con 0x7f8d5c10a470 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57398/0 (socket says 192.168.123.109:57398) 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 -- 192.168.123.109:0/3777087132 learned_addr learned my addr 192.168.123.109:0/3777087132 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 -- 192.168.123.109:0/3777087132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d5c11c780 msgr2=0x7f8d5c1be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d5c11c780 0x7f8d5c1be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 -- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 msgr2=0x7f8d5c112c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 0x7f8d5c112c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.922+0000 7f8d5ad76640 1 -- 192.168.123.109:0/3777087132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c1be6d0 con 0x7f8d5c10a470 2026-03-09T00:31:41.922 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.923+0000 7f8d5ad76640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c112720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c990 tx=0x7f8d4c00ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.923 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.923+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c007c70 con 0x7f8d5c10a470 2026-03-09T00:31:41.924 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.924+0000 7f8d6122b640 1 -- 192.168.123.109:0/3777087132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c1be960 con 0x7f8d5c10a470 2026-03-09T00:31:41.924 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.924+0000 7f8d6122b640 1 -- 192.168.123.109:0/3777087132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1beea0 con 0x7f8d5c10a470 2026-03-09T00:31:41.924 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.925+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f8d4c007e10 con 0x7f8d5c10a470 2026-03-09T00:31:41.924 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.925+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00f450 con 0x7f8d5c10a470 2026-03-09T00:31:41.926 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.927+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f8d4c020020 con 0x7f8d5c10a470 2026-03-09T00:31:41.927 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.928+0000 7f8d3bfff640 1 --2- 192.168.123.109:0/3777087132 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d2c077730 0x7f8d2c079bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:41.929 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.930+0000 7f8d5a575640 1 --2- 192.168.123.109:0/3777087132 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d2c077730 0x7f8d2c079bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:41.929 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.930+0000 7f8d5a575640 1 --2- 192.168.123.109:0/3777087132 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d2c077730 0x7f8d2c079bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c113f70 tx=0x7f8d54002750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:41.930 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.931+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f8d4c09a450 con 0x7f8d5c10a470 2026-03-09T00:31:41.930 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.931+0000 7f8d6122b640 1 -- 192.168.123.109:0/3777087132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d20005180 con 0x7f8d5c10a470 2026-03-09T00:31:41.933 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.934+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8d4c014030 con 0x7f8d5c10a470 2026-03-09T00:31:41.960 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.960+0000 7f54197fa640 1 -- 192.168.123.109:0/1285729996 --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f53f0005740 con 0x7f542810a850 2026-03-09T00:31:41.960 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.961+0000 7f541b7fe640 1 -- 192.168.123.109:0/1285729996 <== mon.1 v2:192.168.123.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54140670e0 con 0x7f542810a850 2026-03-09T00:31:41.967 INFO:teuthology.orchestra.run.vm09.stdout:38654705682 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 >> v2:192.168.123.109:6800/82853931 conn(0x7f5404077660 msgr2=0x7f5404079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 --2- 192.168.123.109:0/1285729996 >> v2:192.168.123.109:6800/82853931 conn(0x7f5404077660 0x7f5404079b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5420009fd0 tx=0x7f5420009290 comp rx=0 tx=0).stop 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 msgr2=0x7f5428112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 0x7f5428112f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400eec0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 shutdown_connections 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 --2- 192.168.123.109:0/1285729996 >> v2:192.168.123.109:6800/82853931 conn(0x7f5404077660 0x7f5404079b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.971 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f54281bbb70 0x7f54281bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.972 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f542810a850 0x7f5428112f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.972 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 --2- 192.168.123.109:0/1285729996 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f542810a470 0x7f54281129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:41.972 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 >> 192.168.123.109:0/1285729996 conn(0x7f542806d970 msgr2=0x7f542810b480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:41.972 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 shutdown_connections 2026-03-09T00:31:41.972 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:41.972+0000 7f5430926640 1 -- 192.168.123.109:0/1285729996 wait complete. 2026-03-09T00:31:42.030 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705682 got 38654705682 for osd.0 2026-03-09T00:31:42.030 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:42.050 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.050+0000 7f45c82e4640 1 -- 192.168.123.109:0/2265246966 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4590005740 con 0x7f45c010f390 2026-03-09T00:31:42.056 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.057+0000 7f45af7fe640 1 -- 192.168.123.109:0/2265246966 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f45bc08c420 con 0x7f45c010f390 2026-03-09T00:31:42.056 INFO:teuthology.orchestra.run.vm09.stdout:184683593732 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 -- 192.168.123.109:0/2265246966 >> v2:192.168.123.109:6800/82853931 conn(0x7f458c077730 msgr2=0x7f458c079bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 --2- 192.168.123.109:0/2265246966 >> v2:192.168.123.109:6800/82853931 conn(0x7f458c077730 0x7f458c079bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45b0005fd0 tx=0x7f45b0004420 comp rx=0 tx=0).stop 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 -- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c010f390 msgr2=0x7f45c0103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c010f390 0x7f45c0103430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45c00763f0 tx=0x7f45bc004290 comp rx=0 tx=0).stop 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 -- 192.168.123.109:0/2265246966 shutdown_connections 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 --2- 192.168.123.109:0/2265246966 >> v2:192.168.123.109:6800/82853931 conn(0x7f458c077730 0x7f458c079bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f45c010f390 0x7f45c0103430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f45c0075d30 0x7f45c0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 --2- 192.168.123.109:0/2265246966 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f45c0075410 0x7f45c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 -- 192.168.123.109:0/2265246966 >> 192.168.123.109:0/2265246966 conn(0x7f45c00fe770 msgr2=0x7f45c00ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.067 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.068+0000 7f45ad7ba640 1 -- 192.168.123.109:0/2265246966 shutdown_connections 2026-03-09T00:31:42.068 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.069+0000 7f45ad7ba640 1 -- 192.168.123.109:0/2265246966 wait complete. 2026-03-09T00:31:42.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.096+0000 7fb520a7c640 1 -- 192.168.123.109:0/1475322255 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb4e0005740 con 0x7fb51c10a850 2026-03-09T00:31:42.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.096+0000 7fb50b7fe640 1 -- 192.168.123.109:0/1475322255 <== mon.0 v2:192.168.123.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb504062e70 con 0x7fb51c10a850 2026-03-09T00:31:42.096 INFO:teuthology.orchestra.run.vm09.stdout:115964117003 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.101+0000 7fb5097fa640 1 -- 192.168.123.109:0/1475322255 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4f0077730 msgr2=0x7fb4f0079bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.101+0000 7fb5097fa640 1 --2- 192.168.123.109:0/1475322255 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4f0077730 0x7fb4f0079bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb510009a60 tx=0x7fb5100023d0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.101+0000 7fb5097fa640 1 -- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 msgr2=0x7fb51c112c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.101+0000 7fb5097fa640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 0x7fb51c112c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb50400b780 tx=0x7fb50400bc50 comp rx=0 tx=0).stop 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 -- 192.168.123.109:0/1475322255 shutdown_connections 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 --2- 192.168.123.109:0/1475322255 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4f0077730 0x7fb4f0079bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb51c11c780 0x7fb51c1be170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb51c10a850 0x7fb51c112c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 --2- 192.168.123.109:0/1475322255 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb51c10a470 0x7fb51c1126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 -- 192.168.123.109:0/1475322255 >> 192.168.123.109:0/1475322255 conn(0x7fb51c06d970 msgr2=0x7fb51c10b480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 -- 192.168.123.109:0/1475322255 shutdown_connections 2026-03-09T00:31:42.101 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.102+0000 7fb5097fa640 1 -- 192.168.123.109:0/1475322255 wait complete. 2026-03-09T00:31:42.149 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph osd last-stat-seq osd.3 2026-03-09T00:31:42.170 INFO:teuthology.orchestra.run.vm09.stdout:137438953480 2026-03-09T00:31:42.170 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.168+0000 7f67dd1dc640 1 -- 192.168.123.109:0/1219603581 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f67d8113b60 con 0x7f67d811c780 2026-03-09T00:31:42.170 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.168+0000 7f67bbfff640 1 -- 192.168.123.109:0/1219603581 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f67c8089310 con 0x7f67d811c780 2026-03-09T00:31:42.178 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.172+0000 7f67b9ffb640 1 -- 192.168.123.109:0/1219603581 >> v2:192.168.123.109:6800/82853931 conn(0x7f67a4077760 msgr2=0x7f67a4079c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.178 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.172+0000 7f67b9ffb640 1 --2- 192.168.123.109:0/1219603581 >> v2:192.168.123.109:6800/82853931 conn(0x7f67a4077760 0x7f67a4079c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67cc006fd0 tx=0x7f67cc008040 comp rx=0 tx=0).stop 2026-03-09T00:31:42.178 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.172+0000 7f67b9ffb640 1 -- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 msgr2=0x7f67d81be230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.178 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.172+0000 7f67b9ffb640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d81be230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f67c8008cc0 tx=0x7f67c8008cf0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.180 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593732 got 184683593732 for osd.7 2026-03-09T00:31:42.180 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 -- 192.168.123.109:0/1219603581 shutdown_connections 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 --2- 192.168.123.109:0/1219603581 >> v2:192.168.123.109:6800/82853931 conn(0x7f67a4077760 0x7f67a4079c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f67d811c780 0x7f67d81be230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f67d810a850 0x7f67d8112b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 --2- 192.168.123.109:0/1219603581 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f67d810a470 0x7f67d8112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 -- 192.168.123.109:0/1219603581 >> 192.168.123.109:0/1219603581 conn(0x7f67d806d970 msgr2=0x7f67d811dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.181+0000 7f67b9ffb640 1 -- 192.168.123.109:0/1219603581 shutdown_connections 2026-03-09T00:31:42.183 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.182+0000 7f67b9ffb640 1 -- 192.168.123.109:0/1219603581 wait complete. 2026-03-09T00:31:42.186 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.186+0000 7f8d6122b640 1 -- 192.168.123.109:0/3777087132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8d20005740 con 0x7f8d5c10a470 2026-03-09T00:31:42.187 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.187+0000 7f8d3bfff640 1 -- 192.168.123.109:0/3777087132 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d4c0635a0 con 0x7f8d5c10a470 2026-03-09T00:31:42.190 INFO:teuthology.orchestra.run.vm09.stdout:73014444046 2026-03-09T00:31:42.198 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.199+0000 7f8d39ffb640 1 -- 192.168.123.109:0/3777087132 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d2c077730 msgr2=0x7f8d2c079bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.199+0000 7f8d39ffb640 1 --2- 192.168.123.109:0/3777087132 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d2c077730 0x7f8d2c079bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c113f70 tx=0x7f8d54002750 comp rx=0 tx=0).stop 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.199+0000 7f8d39ffb640 1 -- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 msgr2=0x7f8d5c112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.199+0000 7f8d39ffb640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c112720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c990 tx=0x7f8d4c00ce60 comp rx=0 tx=0).stop 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 -- 192.168.123.109:0/3777087132 shutdown_connections 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 --2- 192.168.123.109:0/3777087132 >> v2:192.168.123.109:6800/82853931 conn(0x7f8d2c077730 0x7f8d2c079bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f8d5c11c780 0x7f8d5c1be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f8d5c10a850 0x7f8d5c112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 --2- 192.168.123.109:0/3777087132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f8d5c10a470 0x7f8d5c112720 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 -- 192.168.123.109:0/3777087132 >> 192.168.123.109:0/3777087132 conn(0x7f8d5c06d970 msgr2=0x7f8d5c0732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.199 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 -- 192.168.123.109:0/3777087132 shutdown_connections 2026-03-09T00:31:42.200 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.200+0000 7f8d39ffb640 1 -- 192.168.123.109:0/3777087132 wait complete. 2026-03-09T00:31:42.287 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117002 got 115964117003 for osd.4 2026-03-09T00:31:42.287 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:42.335 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953480 got 137438953480 for osd.5 2026-03-09T00:31:42.335 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:42.345 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444046 got 73014444046 for osd.2 2026-03-09T00:31:42.345 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:42.408 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.527+0000 7fc0c808f640 1 -- 192.168.123.109:0/1878869342 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c010f410 msgr2=0x7fc0c0111800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.527+0000 7fc0c808f640 1 --2- 192.168.123.109:0/1878869342 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c010f410 0x7fc0c0111800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00b0a0 tx=0x7fc0bc02f4c0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 -- 192.168.123.109:0/1878869342 shutdown_connections 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 --2- 192.168.123.109:0/1878869342 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c010f410 0x7fc0c0111800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 --2- 192.168.123.109:0/1878869342 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c010eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 --2- 192.168.123.109:0/1878869342 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc0c0075390 0x7fc0c0075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 -- 192.168.123.109:0/1878869342 >> 192.168.123.109:0/1878869342 conn(0x7fc0c00fe770 msgr2=0x7fc0c0100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 -- 192.168.123.109:0/1878869342 shutdown_connections 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 -- 192.168.123.109:0/1878869342 wait complete. 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 Processor -- start 2026-03-09T00:31:42.527 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.528+0000 7fc0c808f640 1 -- start start 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c808f640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 0x7fc0c01a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c808f640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c01a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c808f640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc0c010f410 0x7fc0c019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c808f640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0114560 con 0x7fc0c0075390 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c808f640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c01143e0 con 0x7fc0c010f410 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c808f640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c01146e0 con 0x7fc0c0075cb0 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5e04640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 0x7fc0c01a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c01a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c01a2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57406/0 (socket says 192.168.123.109:57406) 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 -- 192.168.123.109:0/2175550043 learned_addr learned my addr 192.168.123.109:0/2175550043 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c6605640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc0c010f410 0x7fc0c019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5e04640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 0x7fc0c01a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59052/0 (socket says 192.168.123.109:59052) 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 -- 192.168.123.109:0/2175550043 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc0c010f410 msgr2=0x7fc0c019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc0c010f410 0x7fc0c019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 -- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 msgr2=0x7fc0c01a2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.528 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 0x7fc0c01a2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.529 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5603640 1 -- 192.168.123.109:0/2175550043 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c019d0c0 con 0x7fc0c0075cb0 2026-03-09T00:31:42.529 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.529+0000 7fc0c5e04640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 0x7fc0c01a2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-03-09T00:31:42.529 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.530+0000 7fc0c5603640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c01a2c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4002a10 tx=0x7fc0b4002ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:42.530 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.530+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b400ecc0 con 0x7fc0c0075cb0 2026-03-09T00:31:42.530 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.530+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fc0b400ee60 con 0x7fc0c0075cb0 2026-03-09T00:31:42.530 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.530+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4018810 con 0x7fc0c0075cb0 2026-03-09T00:31:42.530 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.530+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c019d3b0 con 0x7fc0c0075cb0 2026-03-09T00:31:42.530 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.530+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c01a9600 con 0x7fc0c0075cb0 2026-03-09T00:31:42.533 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.532+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7fc0b40189b0 con 0x7fc0c0075cb0 2026-03-09T00:31:42.533 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.532+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc088005180 con 0x7fc0c0075cb0 2026-03-09T00:31:42.533 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.532+0000 7fc0aeffd640 1 --2- 192.168.123.109:0/2175550043 >> v2:192.168.123.109:6800/82853931 conn(0x7fc09c0776b0 0x7fc09c079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.534 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.532+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fc0b409a180 con 0x7fc0c0075cb0 2026-03-09T00:31:42.534 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.532+0000 7fc0c5e04640 1 --2- 192.168.123.109:0/2175550043 >> v2:192.168.123.109:6800/82853931 conn(0x7fc09c0776b0 0x7fc09c079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.534 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.535+0000 7fc0c5e04640 1 --2- 192.168.123.109:0/2175550043 >> v2:192.168.123.109:6800/82853931 conn(0x7fc09c0776b0 0x7fc09c079b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00046d0 tx=0x7fc0b0004420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:42.534 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.534+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc0b4014030 con 0x7fc0c0075cb0 2026-03-09T00:31:42.630 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.631+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc088005740 con 0x7fc0c0075cb0 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: pgmap v109: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 120 KiB/s rd, 6.3 KiB/s wr, 269 op/s 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: mgrmap e16: y(active, since 2m), standbys: x 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/619629319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/767292713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1285729996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2265246966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1475322255' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/1219603581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-03-09T00:31:42.630 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/3777087132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: pgmap v109: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 120 KiB/s rd, 6.3 KiB/s wr, 269 op/s 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: mgrmap e16: y(active, since 2m), standbys: x 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/619629319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/767292713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1285729996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2265246966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1475322255' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/1219603581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-03-09T00:31:42.631 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:42 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/3777087132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T00:31:42.632 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.632+0000 7fc0aeffd640 1 -- 192.168.123.109:0/2175550043 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0b40632d0 con 0x7fc0c0075cb0 2026-03-09T00:31:42.633 INFO:teuthology.orchestra.run.vm09.stdout:98784247820 2026-03-09T00:31:42.636 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.636+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 >> v2:192.168.123.109:6800/82853931 conn(0x7fc09c0776b0 msgr2=0x7fc09c079b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.636 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.636+0000 7fc0c808f640 1 --2- 192.168.123.109:0/2175550043 >> v2:192.168.123.109:6800/82853931 conn(0x7fc09c0776b0 0x7fc09c079b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00046d0 tx=0x7fc0b0004420 comp rx=0 tx=0).stop 2026-03-09T00:31:42.636 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 msgr2=0x7fc0c01a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.636 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c01a2c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4002a10 tx=0x7fc0b4002ee0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.636 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 shutdown_connections 2026-03-09T00:31:42.636 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 --2- 192.168.123.109:0/2175550043 >> v2:192.168.123.109:6800/82853931 conn(0x7fc09c0776b0 0x7fc09c079b70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.637 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fc0c010f410 0x7fc0c019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.637 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fc0c0075cb0 0x7fc0c01a2c70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.637 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 --2- 192.168.123.109:0/2175550043 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fc0c0075390 0x7fc0c01a2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.637 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 >> 192.168.123.109:0/2175550043 conn(0x7fc0c00fe770 msgr2=0x7fc0c0110a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.637 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 shutdown_connections 2026-03-09T00:31:42.637 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.637+0000 7fc0c808f640 1 -- 192.168.123.109:0/2175550043 wait complete. 2026-03-09T00:31:42.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: pgmap v109: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 120 KiB/s rd, 6.3 KiB/s wr, 269 op/s 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: mgrmap e16: y(active, since 2m), standbys: x 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/619629319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/767292713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1285729996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2265246966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1475322255' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/1219603581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-03-09T00:31:42.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:42 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/3777087132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T00:31:42.707 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247820 got 98784247820 for osd.3 2026-03-09T00:31:42.707 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:42.707 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-03-09T00:31:42.707 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph pg dump --format=json 2026-03-09T00:31:42.872 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.988+0000 7fb4e83cf640 1 -- 192.168.123.109:0/1744204626 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 msgr2=0x7fb4e00757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.988+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/1744204626 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e00757f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00b0a0 tx=0x7fb4dc02f4c0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 -- 192.168.123.109:0/1744204626 shutdown_connections 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/1744204626 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e0111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/1744204626 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb4e0075d30 0x7fb4e010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/1744204626 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e00757f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 -- 192.168.123.109:0/1744204626 >> 192.168.123.109:0/1744204626 conn(0x7fb4e00fe770 msgr2=0x7fb4e0100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 -- 192.168.123.109:0/1744204626 shutdown_connections 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 -- 192.168.123.109:0/1744204626 wait complete. 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 Processor -- start 2026-03-09T00:31:42.988 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.989+0000 7fb4e83cf640 1 -- start start 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e83cf640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e01a2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e83cf640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb4e0075d30 0x7fb4e01a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e83cf640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e83cf640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0114500 con 0x7fb4e0075410 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e83cf640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0114380 con 0x7fb4e010f390 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e83cf640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e0114680 con 0x7fb4e0075d30 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6144640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e01a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6945640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6945640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.111:3300/0 says I am v2:192.168.123.109:48766/0 (socket says 192.168.123.109:48766) 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6945640 1 -- 192.168.123.109:0/4034998078 learned_addr learned my addr 192.168.123.109:0/4034998078 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6144640 1 -- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb4e0075d30 msgr2=0x7fb4e01a2d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:42.989 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6144640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb4e0075d30 0x7fb4e01a2d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6144640 1 -- 192.168.123.109:0/4034998078 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 msgr2=0x7fb4e019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6144640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6144640 1 -- 192.168.123.109:0/4034998078 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e019d120 con 0x7fb4e0075410 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.990+0000 7fb4e6945640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.991+0000 7fb4e6144640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e01a2830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc036000 tx=0x7fb4dc0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.991+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mon.0 v2:192.168.123.109:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc004e00 con 0x7fb4e0075410 2026-03-09T00:31:42.990 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.991+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e019d3b0 con 0x7fb4e0075410 2026-03-09T00:31:42.991 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.991+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01028e0 con 0x7fb4e0075410 2026-03-09T00:31:42.992 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.992+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e00757f0 con 0x7fb4e0075410 2026-03-09T00:31:42.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.994+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mon.0 v2:192.168.123.109:3300/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7fb4dc004550 con 0x7fb4e0075410 2026-03-09T00:31:42.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.994+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mon.0 v2:192.168.123.109:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc007db0 con 0x7fb4e0075410 2026-03-09T00:31:42.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.994+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mon.0 v2:192.168.123.109:3300/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7fb4dc005030 con 0x7fb4e0075410 2026-03-09T00:31:42.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.994+0000 7fb4c77fe640 1 --2- 192.168.123.109:0/4034998078 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4b4077720 0x7fb4b4079be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:42.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.995+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mon.0 v2:192.168.123.109:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7fb4dc0c87e0 con 0x7fb4e0075410 2026-03-09T00:31:42.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.995+0000 7fb4e5943640 1 --2- 192.168.123.109:0/4034998078 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4b4077720 0x7fb4b4079be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:42.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.996+0000 7fb4e5943640 1 --2- 192.168.123.109:0/4034998078 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4b4077720 0x7fb4b4079be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0109e60 tx=0x7fb4d4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:42.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:42.996+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mon.0 v2:192.168.123.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb4dc091930 con 0x7fb4e0075410 2026-03-09T00:31:43.084 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.085+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4e0111160 con 0x7fb4b4077720 2026-03-09T00:31:43.090 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.091+0000 7fb4c77fe640 1 -- 192.168.123.109:0/4034998078 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+347445 (secure 0 0 0) 0x7fb4e0111160 con 0x7fb4b4077720 2026-03-09T00:31:43.090 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:43.094 INFO:teuthology.orchestra.run.vm09.stderr:dumped all 2026-03-09T00:31:43.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4b4077720 msgr2=0x7fb4b4079be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/4034998078 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4b4077720 0x7fb4b4079be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0109e60 tx=0x7fb4d4006cd0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 msgr2=0x7fb4e01a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e01a2830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc036000 tx=0x7fb4dc0096e0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 shutdown_connections 2026-03-09T00:31:43.096 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/4034998078 >> v2:192.168.123.109:6800/82853931 conn(0x7fb4b4077720 0x7fb4b4079be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.097 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7fb4e010f390 0x7fb4e019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.097 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7fb4e0075d30 0x7fb4e01a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.097 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 --2- 192.168.123.109:0/4034998078 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7fb4e0075410 0x7fb4e01a2830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.097 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 >> 192.168.123.109:0/4034998078 conn(0x7fb4e00fe770 msgr2=0x7fb4e0110a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:43.097 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 shutdown_connections 2026-03-09T00:31:43.097 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.097+0000 7fb4e83cf640 1 -- 192.168.123.109:0/4034998078 wait complete. 2026-03-09T00:31:43.138 INFO:teuthology.orchestra.run.vm09.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2026-03-09T00:31:42.780775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":465419,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":1064,"num_read_kb":775,"num_write":685,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":459280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":701,"ondisk_log_size":701,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":374,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":167739392,"kb_used":220356,"kb_used_data":5692,"kb_used_omap":12,"kb_used_meta":214515,"kb_avail":167519036,"statfs":{"total":171765137408,"available":171539492864,"internally_reserved":0,"allocated":5828608,"data_stored":3027569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12712,"internal_metadata":219663960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4518,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":1004,"num_read_kb":724,"num_write":617,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.130283"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685574+0000","last_change":"2026-03-09T00:31:30.103541+0000","last_active":"2026-03-09T00:31:37.685574+0000","last_peered":"2026-03-09T00:31:37.685574+0000","last_clean":"2026-03-09T00:31:37.685574+0000","last_became_active":"2026-03-09T00:31:30.103288+0000","last_became_peered":"2026-03-09T00:31:30.103288+0000","last_unstale":"2026-03-09T00:31:37.685574+0000","last_undegraded":"2026-03-09T00:31:37.685574+0000","last_fullsized":"2026-03-09T00:31:37.685574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:35:30.190775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"54'15","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.287191+0000","last_change":"2026-03-09T00:31:32.655627+0000","last_active":"2026-03-09T00:31:38.287191+0000","last_peered":"2026-03-09T00:31:38.287191+0000","last_clean":"2026-03-09T00:31:38.287191+0000","last_became_active":"2026-03-09T00:31:32.655058+0000","last_became_peered":"2026-03-09T00:31:32.655058+0000","last_unstale":"2026-03-09T00:31:38.287191+0000","last_undegraded":"2026-03-09T00:31:38.287191+0000","last_fullsized":"2026-03-09T00:31:38.287191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:53:42.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680606+0000","last_change":"2026-03-09T00:31:34.692952+0000","last_active":"2026-03-09T00:31:37.680606+0000","last_peered":"2026-03-09T00:31:37.680606+0000","last_clean":"2026-03-09T00:31:37.680606+0000","last_became_active":"2026-03-09T00:31:34.692810+0000","last_became_peered":"2026-03-09T00:31:34.692810+0000","last_unstale":"2026-03-09T00:31:37.680606+0000","last_undegraded":"2026-03-09T00:31:37.680606+0000","last_fullsized":"2026-03-09T00:31:37.680606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:36:11.465990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684653+0000","last_change":"2026-03-09T00:31:36.685537+0000","last_active":"2026-03-09T00:31:37.684653+0000","last_peered":"2026-03-09T00:31:37.684653+0000","last_clean":"2026-03-09T00:31:37.684653+0000","last_became_active":"2026-03-09T00:31:36.685357+0000","last_became_peered":"2026-03-09T00:31:36.685357+0000","last_unstale":"2026-03-09T00:31:37.684653+0000","last_undegraded":"2026-03-09T00:31:37.684653+0000","last_fullsized":"2026-03-09T00:31:37.684653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:02:13.433604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675272+0000","last_change":"2026-03-09T00:31:37.272711+0000","last_active":"2026-03-09T00:31:37.675272+0000","last_peered":"2026-03-09T00:31:37.675272+0000","last_clean":"2026-03-09T00:31:37.675272+0000","last_became_active":"2026-03-09T00:31:37.272276+0000","last_became_peered":"2026-03-09T00:31:37.272276+0000","last_unstale":"2026-03-09T00:31:37.675272+0000","last_undegraded":"2026-03-09T00:31:37.675272+0000","last_fullsized":"2026-03-09T00:31:37.675272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:46:57.536325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675296+0000","last_change":"2026-03-09T00:31:30.105056+0000","last_active":"2026-03-09T00:31:37.675296+0000","last_peered":"2026-03-09T00:31:37.675296+0000","last_clean":"2026-03-09T00:31:37.675296+0000","last_became_active":"2026-03-09T00:31:30.104915+0000","last_became_peered":"2026-03-09T00:31:30.104915+0000","last_unstale":"2026-03-09T00:31:37.675296+0000","last_undegraded":"2026-03-09T00:31:37.675296+0000","last_fullsized":"2026-03-09T00:31:37.675296+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:36:53.807749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"54'40","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.656772+0000","last_change":"2026-03-09T00:31:32.650328+0000","last_active":"2026-03-09T00:31:38.656772+0000","last_peered":"2026-03-09T00:31:38.656772+0000","last_clean":"2026-03-09T00:31:38.656772+0000","last_became_active":"2026-03-09T00:31:32.650204+0000","last_became_peered":"2026-03-09T00:31:32.650204+0000","last_unstale":"2026-03-09T00:31:38.656772+0000","last_undegraded":"2026-03-09T00:31:38.656772+0000","last_fullsized":"2026-03-09T00:31:38.656772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:04:42.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683731+0000","last_change":"2026-03-09T00:31:34.679976+0000","last_active":"2026-03-09T00:31:37.683731+0000","last_peered":"2026-03-09T00:31:37.683731+0000","last_clean":"2026-03-09T00:31:37.683731+0000","last_became_active":"2026-03-09T00:31:34.676207+0000","last_became_peered":"2026-03-09T00:31:34.676207+0000","last_unstale":"2026-03-09T00:31:37.683731+0000","last_undegraded":"2026-03-09T00:31:37.683731+0000","last_fullsized":"2026-03-09T00:31:37.683731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:03:48.617933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692330+0000","last_change":"2026-03-09T00:31:30.096075+0000","last_active":"2026-03-09T00:31:37.692330+0000","last_peered":"2026-03-09T00:31:37.692330+0000","last_clean":"2026-03-09T00:31:37.692330+0000","last_became_active":"2026-03-09T00:31:30.095902+0000","last_became_peered":"2026-03-09T00:31:30.095902+0000","last_unstale":"2026-03-09T00:31:37.692330+0000","last_undegraded":"2026-03-09T00:31:37.692330+0000","last_fullsized":"2026-03-09T00:31:37.692330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:34:13.985088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"54'21","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.518139+0000","last_change":"2026-03-09T00:31:32.649705+0000","last_active":"2026-03-09T00:31:38.518139+0000","last_peered":"2026-03-09T00:31:38.518139+0000","last_clean":"2026-03-09T00:31:38.518139+0000","last_became_active":"2026-03-09T00:31:32.649605+0000","last_became_peered":"2026-03-09T00:31:32.649605+0000","last_unstale":"2026-03-09T00:31:38.518139+0000","last_undegraded":"2026-03-09T00:31:38.518139+0000","last_fullsized":"2026-03-09T00:31:38.518139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:11:43.332368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692353+0000","last_change":"2026-03-09T00:31:34.692527+0000","last_active":"2026-03-09T00:31:37.692353+0000","last_peered":"2026-03-09T00:31:37.692353+0000","last_clean":"2026-03-09T00:31:37.692353+0000","last_became_active":"2026-03-09T00:31:34.692128+0000","last_became_peered":"2026-03-09T00:31:34.692128+0000","last_unstale":"2026-03-09T00:31:37.692353+0000","last_undegraded":"2026-03-09T00:31:37.692353+0000","last_fullsized":"2026-03-09T00:31:37.692353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:19:42.089978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685695+0000","last_change":"2026-03-09T00:31:36.687875+0000","last_active":"2026-03-09T00:31:37.685695+0000","last_peered":"2026-03-09T00:31:37.685695+0000","last_clean":"2026-03-09T00:31:37.685695+0000","last_became_active":"2026-03-09T00:31:36.687790+0000","last_became_peered":"2026-03-09T00:31:36.687790+0000","last_unstale":"2026-03-09T00:31:37.685695+0000","last_undegraded":"2026-03-09T00:31:37.685695+0000","last_fullsized":"2026-03-09T00:31:37.685695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:15:35.216899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692491+0000","last_change":"2026-03-09T00:31:30.097166+0000","last_active":"2026-03-09T00:31:37.692491+0000","last_peered":"2026-03-09T00:31:37.692491+0000","last_clean":"2026-03-09T00:31:37.692491+0000","last_became_active":"2026-03-09T00:31:30.096019+0000","last_became_peered":"2026-03-09T00:31:30.096019+0000","last_unstale":"2026-03-09T00:31:37.692491+0000","last_undegraded":"2026-03-09T00:31:37.692491+0000","last_fullsized":"2026-03-09T00:31:37.692491+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:08:35.182723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"54'11","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.489239+0000","last_change":"2026-03-09T00:31:32.655937+0000","last_active":"2026-03-09T00:31:38.489239+0000","last_peered":"2026-03-09T00:31:38.489239+0000","last_clean":"2026-03-09T00:31:38.489239+0000","last_became_active":"2026-03-09T00:31:32.655174+0000","last_became_peered":"2026-03-09T00:31:32.655174+0000","last_unstale":"2026-03-09T00:31:38.489239+0000","last_undegraded":"2026-03-09T00:31:38.489239+0000","last_fullsized":"2026-03-09T00:31:38.489239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:42:54.658632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665890+0000","last_change":"2026-03-09T00:31:34.673384+0000","last_active":"2026-03-09T00:31:37.665890+0000","last_peered":"2026-03-09T00:31:37.665890+0000","last_clean":"2026-03-09T00:31:37.665890+0000","last_became_active":"2026-03-09T00:31:34.673274+0000","last_became_peered":"2026-03-09T00:31:34.673274+0000","last_unstale":"2026-03-09T00:31:37.665890+0000","last_undegraded":"2026-03-09T00:31:37.665890+0000","last_fullsized":"2026-03-09T00:31:37.665890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:27:26.945131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692469+0000","last_change":"2026-03-09T00:31:36.699443+0000","last_active":"2026-03-09T00:31:37.692469+0000","last_peered":"2026-03-09T00:31:37.692469+0000","last_clean":"2026-03-09T00:31:37.692469+0000","last_became_active":"2026-03-09T00:31:36.699320+0000","last_became_peered":"2026-03-09T00:31:36.699320+0000","last_unstale":"2026-03-09T00:31:37.692469+0000","last_undegraded":"2026-03-09T00:31:37.692469+0000","last_fullsized":"2026-03-09T00:31:37.692469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:58:10.154598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684534+0000","last_change":"2026-03-09T00:31:37.270972+0000","last_active":"2026-03-09T00:31:37.684534+0000","last_peered":"2026-03-09T00:31:37.684534+0000","last_clean":"2026-03-09T00:31:37.684534+0000","last_became_active":"2026-03-09T00:31:37.270857+0000","last_became_peered":"2026-03-09T00:31:37.270857+0000","last_unstale":"2026-03-09T00:31:37.684534+0000","last_undegraded":"2026-03-09T00:31:37.684534+0000","last_fullsized":"2026-03-09T00:31:37.684534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:15:36.425906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685365+0000","last_change":"2026-03-09T00:31:30.095571+0000","last_active":"2026-03-09T00:31:37.685365+0000","last_peered":"2026-03-09T00:31:37.685365+0000","last_clean":"2026-03-09T00:31:37.685365+0000","last_became_active":"2026-03-09T00:31:30.094552+0000","last_became_peered":"2026-03-09T00:31:30.094552+0000","last_unstale":"2026-03-09T00:31:37.685365+0000","last_undegraded":"2026-03-09T00:31:37.685365+0000","last_fullsized":"2026-03-09T00:31:37.685365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:38:09.984384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"54'15","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.562109+0000","last_change":"2026-03-09T00:31:32.654669+0000","last_active":"2026-03-09T00:31:38.562109+0000","last_peered":"2026-03-09T00:31:38.562109+0000","last_clean":"2026-03-09T00:31:38.562109+0000","last_became_active":"2026-03-09T00:31:32.654584+0000","last_became_peered":"2026-03-09T00:31:32.654584+0000","last_unstale":"2026-03-09T00:31:38.562109+0000","last_undegraded":"2026-03-09T00:31:38.562109+0000","last_fullsized":"2026-03-09T00:31:38.562109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:02:41.253182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680468+0000","last_change":"2026-03-09T00:31:34.673322+0000","last_active":"2026-03-09T00:31:37.680468+0000","last_peered":"2026-03-09T00:31:37.680468+0000","last_clean":"2026-03-09T00:31:37.680468+0000","last_became_active":"2026-03-09T00:31:34.673203+0000","last_became_peered":"2026-03-09T00:31:34.673203+0000","last_unstale":"2026-03-09T00:31:37.680468+0000","last_undegraded":"2026-03-09T00:31:37.680468+0000","last_fullsized":"2026-03-09T00:31:37.680468+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:28:12.791122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675817+0000","last_change":"2026-03-09T00:31:37.272822+0000","last_active":"2026-03-09T00:31:37.675817+0000","last_peered":"2026-03-09T00:31:37.675817+0000","last_clean":"2026-03-09T00:31:37.675817+0000","last_became_active":"2026-03-09T00:31:37.272451+0000","last_became_peered":"2026-03-09T00:31:37.272451+0000","last_unstale":"2026-03-09T00:31:37.675817+0000","last_undegraded":"2026-03-09T00:31:37.675817+0000","last_fullsized":"2026-03-09T00:31:37.675817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:42:08.301629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683872+0000","last_change":"2026-03-09T00:31:30.102579+0000","last_active":"2026-03-09T00:31:37.683872+0000","last_peered":"2026-03-09T00:31:37.683872+0000","last_clean":"2026-03-09T00:31:37.683872+0000","last_became_active":"2026-03-09T00:31:30.102483+0000","last_became_peered":"2026-03-09T00:31:30.102483+0000","last_unstale":"2026-03-09T00:31:37.683872+0000","last_undegraded":"2026-03-09T00:31:37.683872+0000","last_fullsized":"2026-03-09T00:31:37.683872+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:55:12.895458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"54'20","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.659366+0000","last_change":"2026-03-09T00:31:32.658965+0000","last_active":"2026-03-09T00:31:38.659366+0000","last_peered":"2026-03-09T00:31:38.659366+0000","last_clean":"2026-03-09T00:31:38.659366+0000","last_became_active":"2026-03-09T00:31:32.658888+0000","last_became_peered":"2026-03-09T00:31:32.658888+0000","last_unstale":"2026-03-09T00:31:38.659366+0000","last_undegraded":"2026-03-09T00:31:38.659366+0000","last_fullsized":"2026-03-09T00:31:38.659366+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:51:06.103217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683808+0000","last_change":"2026-03-09T00:31:34.675027+0000","last_active":"2026-03-09T00:31:37.683808+0000","last_peered":"2026-03-09T00:31:37.683808+0000","last_clean":"2026-03-09T00:31:37.683808+0000","last_became_active":"2026-03-09T00:31:34.672944+0000","last_became_peered":"2026-03-09T00:31:34.672944+0000","last_unstale":"2026-03-09T00:31:37.683808+0000","last_undegraded":"2026-03-09T00:31:37.683808+0000","last_fullsized":"2026-03-09T00:31:37.683808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:25:43.013892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666524+0000","last_change":"2026-03-09T00:31:36.697774+0000","last_active":"2026-03-09T00:31:37.666524+0000","last_peered":"2026-03-09T00:31:37.666524+0000","last_clean":"2026-03-09T00:31:37.666524+0000","last_became_active":"2026-03-09T00:31:36.697586+0000","last_became_peered":"2026-03-09T00:31:36.697586+0000","last_unstale":"2026-03-09T00:31:37.666524+0000","last_undegraded":"2026-03-09T00:31:37.666524+0000","last_fullsized":"2026-03-09T00:31:37.666524+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:50:27.189681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"47'1","reported_seq":26,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681230+0000","last_change":"2026-03-09T00:31:30.092994+0000","last_active":"2026-03-09T00:31:37.681230+0000","last_peered":"2026-03-09T00:31:37.681230+0000","last_clean":"2026-03-09T00:31:37.681230+0000","last_became_active":"2026-03-09T00:31:30.092862+0000","last_became_peered":"2026-03-09T00:31:30.092862+0000","last_unstale":"2026-03-09T00:31:37.681230+0000","last_undegraded":"2026-03-09T00:31:37.681230+0000","last_fullsized":"2026-03-09T00:31:37.681230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:12:17.971431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"54'16","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.636296+0000","last_change":"2026-03-09T00:31:32.654772+0000","last_active":"2026-03-09T00:31:38.636296+0000","last_peered":"2026-03-09T00:31:38.636296+0000","last_clean":"2026-03-09T00:31:38.636296+0000","last_became_active":"2026-03-09T00:31:32.654678+0000","last_became_peered":"2026-03-09T00:31:32.654678+0000","last_unstale":"2026-03-09T00:31:38.636296+0000","last_undegraded":"2026-03-09T00:31:38.636296+0000","last_fullsized":"2026-03-09T00:31:38.636296+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:56:49.101742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"54'8","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.211027+0000","last_change":"2026-03-09T00:31:34.696609+0000","last_active":"2026-03-09T00:31:38.211027+0000","last_peered":"2026-03-09T00:31:38.211027+0000","last_clean":"2026-03-09T00:31:38.211027+0000","last_became_active":"2026-03-09T00:31:34.696510+0000","last_became_peered":"2026-03-09T00:31:34.696510+0000","last_unstale":"2026-03-09T00:31:38.211027+0000","last_undegraded":"2026-03-09T00:31:38.211027+0000","last_fullsized":"2026-03-09T00:31:38.211027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:38:56.660546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"54'15","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.669916+0000","last_change":"2026-03-09T00:31:32.656314+0000","last_active":"2026-03-09T00:31:38.669916+0000","last_peered":"2026-03-09T00:31:38.669916+0000","last_clean":"2026-03-09T00:31:38.669916+0000","last_became_active":"2026-03-09T00:31:32.653994+0000","last_became_peered":"2026-03-09T00:31:32.653994+0000","last_unstale":"2026-03-09T00:31:38.669916+0000","last_undegraded":"2026-03-09T00:31:38.669916+0000","last_fullsized":"2026-03-09T00:31:38.669916+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:38:46.038324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675066+0000","last_change":"2026-03-09T00:31:30.091575+0000","last_active":"2026-03-09T00:31:37.675066+0000","last_peered":"2026-03-09T00:31:37.675066+0000","last_clean":"2026-03-09T00:31:37.675066+0000","last_became_active":"2026-03-09T00:31:30.091394+0000","last_became_peered":"2026-03-09T00:31:30.091394+0000","last_unstale":"2026-03-09T00:31:37.675066+0000","last_undegraded":"2026-03-09T00:31:37.675066+0000","last_fullsized":"2026-03-09T00:31:37.675066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:38:29.796659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.226767+0000","last_change":"2026-03-09T00:31:34.704536+0000","last_active":"2026-03-09T00:31:38.226767+0000","last_peered":"2026-03-09T00:31:38.226767+0000","last_clean":"2026-03-09T00:31:38.226767+0000","last_became_active":"2026-03-09T00:31:34.704179+0000","last_became_peered":"2026-03-09T00:31:34.704179+0000","last_unstale":"2026-03-09T00:31:38.226767+0000","last_undegraded":"2026-03-09T00:31:38.226767+0000","last_fullsized":"2026-03-09T00:31:38.226767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:25:26.284441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692164+0000","last_change":"2026-03-09T00:31:36.695405+0000","last_active":"2026-03-09T00:31:37.692164+0000","last_peered":"2026-03-09T00:31:37.692164+0000","last_clean":"2026-03-09T00:31:37.692164+0000","last_became_active":"2026-03-09T00:31:36.695315+0000","last_became_peered":"2026-03-09T00:31:36.695315+0000","last_unstale":"2026-03-09T00:31:37.692164+0000","last_undegraded":"2026-03-09T00:31:37.692164+0000","last_fullsized":"2026-03-09T00:31:37.692164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:31:08.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"54'30","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.598343+0000","last_change":"2026-03-09T00:31:32.658807+0000","last_active":"2026-03-09T00:31:38.598343+0000","last_peered":"2026-03-09T00:31:38.598343+0000","last_clean":"2026-03-09T00:31:38.598343+0000","last_became_active":"2026-03-09T00:31:32.657398+0000","last_became_peered":"2026-03-09T00:31:32.657398+0000","last_unstale":"2026-03-09T00:31:38.598343+0000","last_undegraded":"2026-03-09T00:31:38.598343+0000","last_fullsized":"2026-03-09T00:31:38.598343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:38:07.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"47'1","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.936483+0000","last_change":"2026-03-09T00:31:30.089505+0000","last_active":"2026-03-09T00:31:37.936483+0000","last_peered":"2026-03-09T00:31:37.936483+0000","last_clean":"2026-03-09T00:31:37.936483+0000","last_became_active":"2026-03-09T00:31:30.089306+0000","last_became_peered":"2026-03-09T00:31:30.089306+0000","last_unstale":"2026-03-09T00:31:37.936483+0000","last_undegraded":"2026-03-09T00:31:37.936483+0000","last_fullsized":"2026-03-09T00:31:37.936483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:27:02.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683671+0000","last_change":"2026-03-09T00:31:34.673878+0000","last_active":"2026-03-09T00:31:37.683671+0000","last_peered":"2026-03-09T00:31:37.683671+0000","last_clean":"2026-03-09T00:31:37.683671+0000","last_became_active":"2026-03-09T00:31:34.673788+0000","last_became_peered":"2026-03-09T00:31:34.673788+0000","last_unstale":"2026-03-09T00:31:37.683671+0000","last_undegraded":"2026-03-09T00:31:37.683671+0000","last_fullsized":"2026-03-09T00:31:37.683671+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:48:10.024561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683699+0000","last_change":"2026-03-09T00:31:36.700550+0000","last_active":"2026-03-09T00:31:37.683699+0000","last_peered":"2026-03-09T00:31:37.683699+0000","last_clean":"2026-03-09T00:31:37.683699+0000","last_became_active":"2026-03-09T00:31:36.699023+0000","last_became_peered":"2026-03-09T00:31:36.699023+0000","last_unstale":"2026-03-09T00:31:37.683699+0000","last_undegraded":"2026-03-09T00:31:37.683699+0000","last_fullsized":"2026-03-09T00:31:37.683699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:01:32.829734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"54'20","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.639278+0000","last_change":"2026-03-09T00:31:32.653185+0000","last_active":"2026-03-09T00:31:38.639278+0000","last_peered":"2026-03-09T00:31:38.639278+0000","last_clean":"2026-03-09T00:31:38.639278+0000","last_became_active":"2026-03-09T00:31:32.652927+0000","last_became_peered":"2026-03-09T00:31:32.652927+0000","last_unstale":"2026-03-09T00:31:38.639278+0000","last_undegraded":"2026-03-09T00:31:38.639278+0000","last_fullsized":"2026-03-09T00:31:38.639278+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:40:54.725158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"47'1","reported_seq":26,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685470+0000","last_change":"2026-03-09T00:31:30.095693+0000","last_active":"2026-03-09T00:31:37.685470+0000","last_peered":"2026-03-09T00:31:37.685470+0000","last_clean":"2026-03-09T00:31:37.685470+0000","last_became_active":"2026-03-09T00:31:30.094707+0000","last_became_peered":"2026-03-09T00:31:30.094707+0000","last_unstale":"2026-03-09T00:31:37.685470+0000","last_undegraded":"2026-03-09T00:31:37.685470+0000","last_fullsized":"2026-03-09T00:31:37.685470+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:22:42.071062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.216011+0000","last_change":"2026-03-09T00:31:34.674046+0000","last_active":"2026-03-09T00:31:38.216011+0000","last_peered":"2026-03-09T00:31:38.216011+0000","last_clean":"2026-03-09T00:31:38.216011+0000","last_became_active":"2026-03-09T00:31:34.673910+0000","last_became_peered":"2026-03-09T00:31:34.673910+0000","last_unstale":"2026-03-09T00:31:38.216011+0000","last_undegraded":"2026-03-09T00:31:38.216011+0000","last_fullsized":"2026-03-09T00:31:38.216011+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:48:05.455661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665670+0000","last_change":"2026-03-09T00:31:37.271866+0000","last_active":"2026-03-09T00:31:37.665670+0000","last_peered":"2026-03-09T00:31:37.665670+0000","last_clean":"2026-03-09T00:31:37.665670+0000","last_became_active":"2026-03-09T00:31:37.271504+0000","last_became_peered":"2026-03-09T00:31:37.271504+0000","last_unstale":"2026-03-09T00:31:37.665670+0000","last_undegraded":"2026-03-09T00:31:37.665670+0000","last_fullsized":"2026-03-09T00:31:37.665670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:30:02.314724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"54'16","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.621174+0000","last_change":"2026-03-09T00:31:32.663831+0000","last_active":"2026-03-09T00:31:38.621174+0000","last_peered":"2026-03-09T00:31:38.621174+0000","last_clean":"2026-03-09T00:31:38.621174+0000","last_became_active":"2026-03-09T00:31:32.661264+0000","last_became_peered":"2026-03-09T00:31:32.661264+0000","last_unstale":"2026-03-09T00:31:38.621174+0000","last_undegraded":"2026-03-09T00:31:38.621174+0000","last_fullsized":"2026-03-09T00:31:38.621174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:58:34.342778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692688+0000","last_change":"2026-03-09T00:31:30.102188+0000","last_active":"2026-03-09T00:31:37.692688+0000","last_peered":"2026-03-09T00:31:37.692688+0000","last_clean":"2026-03-09T00:31:37.692688+0000","last_became_active":"2026-03-09T00:31:30.102083+0000","last_became_peered":"2026-03-09T00:31:30.102083+0000","last_unstale":"2026-03-09T00:31:37.692688+0000","last_undegraded":"2026-03-09T00:31:37.692688+0000","last_fullsized":"2026-03-09T00:31:37.692688+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:58:31.172967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.232085+0000","last_change":"2026-03-09T00:31:34.694378+0000","last_active":"2026-03-09T00:31:38.232085+0000","last_peered":"2026-03-09T00:31:38.232085+0000","last_clean":"2026-03-09T00:31:38.232085+0000","last_became_active":"2026-03-09T00:31:34.694292+0000","last_became_peered":"2026-03-09T00:31:34.694292+0000","last_unstale":"2026-03-09T00:31:38.232085+0000","last_undegraded":"2026-03-09T00:31:38.232085+0000","last_fullsized":"2026-03-09T00:31:38.232085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:55:12.162146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.686033+0000","last_change":"2026-03-09T00:31:36.703690+0000","last_active":"2026-03-09T00:31:37.686033+0000","last_peered":"2026-03-09T00:31:37.686033+0000","last_clean":"2026-03-09T00:31:37.686033+0000","last_became_active":"2026-03-09T00:31:36.703606+0000","last_became_peered":"2026-03-09T00:31:36.703606+0000","last_unstale":"2026-03-09T00:31:37.686033+0000","last_undegraded":"2026-03-09T00:31:37.686033+0000","last_fullsized":"2026-03-09T00:31:37.686033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:58:39.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"54'25","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.613864+0000","last_change":"2026-03-09T00:31:32.660353+0000","last_active":"2026-03-09T00:31:38.613864+0000","last_peered":"2026-03-09T00:31:38.613864+0000","last_clean":"2026-03-09T00:31:38.613864+0000","last_became_active":"2026-03-09T00:31:32.659922+0000","last_became_peered":"2026-03-09T00:31:32.659922+0000","last_unstale":"2026-03-09T00:31:38.613864+0000","last_undegraded":"2026-03-09T00:31:38.613864+0000","last_fullsized":"2026-03-09T00:31:38.613864+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:34:15.263588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681294+0000","last_change":"2026-03-09T00:31:30.102267+0000","last_active":"2026-03-09T00:31:37.681294+0000","last_peered":"2026-03-09T00:31:37.681294+0000","last_clean":"2026-03-09T00:31:37.681294+0000","last_became_active":"2026-03-09T00:31:30.102173+0000","last_became_peered":"2026-03-09T00:31:30.102173+0000","last_unstale":"2026-03-09T00:31:37.681294+0000","last_undegraded":"2026-03-09T00:31:37.681294+0000","last_fullsized":"2026-03-09T00:31:37.681294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:52:58.593714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.690391+0000","last_change":"2026-03-09T00:31:34.704989+0000","last_active":"2026-03-09T00:31:37.690391+0000","last_peered":"2026-03-09T00:31:37.690391+0000","last_clean":"2026-03-09T00:31:37.690391+0000","last_became_active":"2026-03-09T00:31:34.704806+0000","last_became_peered":"2026-03-09T00:31:34.704806+0000","last_unstale":"2026-03-09T00:31:37.690391+0000","last_undegraded":"2026-03-09T00:31:37.690391+0000","last_fullsized":"2026-03-09T00:31:37.690391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:08:11.585850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681281+0000","last_change":"2026-03-09T00:31:37.270544+0000","last_active":"2026-03-09T00:31:37.681281+0000","last_peered":"2026-03-09T00:31:37.681281+0000","last_clean":"2026-03-09T00:31:37.681281+0000","last_became_active":"2026-03-09T00:31:37.270385+0000","last_became_peered":"2026-03-09T00:31:37.270385+0000","last_unstale":"2026-03-09T00:31:37.681281+0000","last_undegraded":"2026-03-09T00:31:37.681281+0000","last_fullsized":"2026-03-09T00:31:37.681281+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:48:58.558407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"54'34","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.625663+0000","last_change":"2026-03-09T00:31:32.649477+0000","last_active":"2026-03-09T00:31:38.625663+0000","last_peered":"2026-03-09T00:31:38.625663+0000","last_clean":"2026-03-09T00:31:38.625663+0000","last_became_active":"2026-03-09T00:31:32.649363+0000","last_became_peered":"2026-03-09T00:31:32.649363+0000","last_unstale":"2026-03-09T00:31:38.625663+0000","last_undegraded":"2026-03-09T00:31:38.625663+0000","last_fullsized":"2026-03-09T00:31:38.625663+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:33:11.636267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684037+0000","last_change":"2026-03-09T00:31:30.091566+0000","last_active":"2026-03-09T00:31:37.684037+0000","last_peered":"2026-03-09T00:31:37.684037+0000","last_clean":"2026-03-09T00:31:37.684037+0000","last_became_active":"2026-03-09T00:31:30.091472+0000","last_became_peered":"2026-03-09T00:31:30.091472+0000","last_unstale":"2026-03-09T00:31:37.684037+0000","last_undegraded":"2026-03-09T00:31:37.684037+0000","last_fullsized":"2026-03-09T00:31:37.684037+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:09:02.054618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"49'2","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692646+0000","last_change":"2026-03-09T00:31:32.559606+0000","last_active":"2026-03-09T00:31:37.692646+0000","last_peered":"2026-03-09T00:31:37.692646+0000","last_clean":"2026-03-09T00:31:37.692646+0000","last_became_active":"2026-03-09T00:31:30.095985+0000","last_became_peered":"2026-03-09T00:31:30.095985+0000","last_unstale":"2026-03-09T00:31:37.692646+0000","last_undegraded":"2026-03-09T00:31:37.692646+0000","last_fullsized":"2026-03-09T00:31:37.692646+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:43:26.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000397616,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685629+0000","last_change":"2026-03-09T00:31:34.677419+0000","last_active":"2026-03-09T00:31:37.685629+0000","last_peered":"2026-03-09T00:31:37.685629+0000","last_clean":"2026-03-09T00:31:37.685629+0000","last_became_active":"2026-03-09T00:31:34.677341+0000","last_became_peered":"2026-03-09T00:31:34.677341+0000","last_unstale":"2026-03-09T00:31:37.685629+0000","last_undegraded":"2026-03-09T00:31:37.685629+0000","last_fullsized":"2026-03-09T00:31:37.685629+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:50:55.811425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674970+0000","last_change":"2026-03-09T00:31:36.680637+0000","last_active":"2026-03-09T00:31:37.674970+0000","last_peered":"2026-03-09T00:31:37.674970+0000","last_clean":"2026-03-09T00:31:37.674970+0000","last_became_active":"2026-03-09T00:31:36.680523+0000","last_became_peered":"2026-03-09T00:31:36.680523+0000","last_unstale":"2026-03-09T00:31:37.674970+0000","last_undegraded":"2026-03-09T00:31:37.674970+0000","last_fullsized":"2026-03-09T00:31:37.674970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:52:48.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"54'19","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.545041+0000","last_change":"2026-03-09T00:31:32.664907+0000","last_active":"2026-03-09T00:31:38.545041+0000","last_peered":"2026-03-09T00:31:38.545041+0000","last_clean":"2026-03-09T00:31:38.545041+0000","last_became_active":"2026-03-09T00:31:32.664411+0000","last_became_peered":"2026-03-09T00:31:32.664411+0000","last_unstale":"2026-03-09T00:31:38.545041+0000","last_undegraded":"2026-03-09T00:31:38.545041+0000","last_fullsized":"2026-03-09T00:31:38.545041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:17:06.736528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681318+0000","last_change":"2026-03-09T00:31:30.101738+0000","last_active":"2026-03-09T00:31:37.681318+0000","last_peered":"2026-03-09T00:31:37.681318+0000","last_clean":"2026-03-09T00:31:37.681318+0000","last_became_active":"2026-03-09T00:31:30.101651+0000","last_became_peered":"2026-03-09T00:31:30.101651+0000","last_unstale":"2026-03-09T00:31:37.681318+0000","last_undegraded":"2026-03-09T00:31:37.681318+0000","last_fullsized":"2026-03-09T00:31:37.681318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:26:47.208615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"47'1","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666459+0000","last_change":"2026-03-09T00:31:32.598176+0000","last_active":"2026-03-09T00:31:37.666459+0000","last_peered":"2026-03-09T00:31:37.666459+0000","last_clean":"2026-03-09T00:31:37.666459+0000","last_became_active":"2026-03-09T00:31:30.110427+0000","last_became_peered":"2026-03-09T00:31:30.110427+0000","last_unstale":"2026-03-09T00:31:37.666459+0000","last_undegraded":"2026-03-09T00:31:37.666459+0000","last_fullsized":"2026-03-09T00:31:37.666459+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:30:10.860551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242785,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666488+0000","last_change":"2026-03-09T00:31:34.702728+0000","last_active":"2026-03-09T00:31:37.666488+0000","last_peered":"2026-03-09T00:31:37.666488+0000","last_clean":"2026-03-09T00:31:37.666488+0000","last_became_active":"2026-03-09T00:31:34.702600+0000","last_became_peered":"2026-03-09T00:31:34.702600+0000","last_unstale":"2026-03-09T00:31:37.666488+0000","last_undegraded":"2026-03-09T00:31:37.666488+0000","last_fullsized":"2026-03-09T00:31:37.666488+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:56:00.997142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665846+0000","last_change":"2026-03-09T00:31:37.271934+0000","last_active":"2026-03-09T00:31:37.665846+0000","last_peered":"2026-03-09T00:31:37.665846+0000","last_clean":"2026-03-09T00:31:37.665846+0000","last_became_active":"2026-03-09T00:31:37.271641+0000","last_became_peered":"2026-03-09T00:31:37.271641+0000","last_unstale":"2026-03-09T00:31:37.665846+0000","last_undegraded":"2026-03-09T00:31:37.665846+0000","last_fullsized":"2026-03-09T00:31:37.665846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:24:46.341220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"54'12","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.559545+0000","last_change":"2026-03-09T00:31:32.655392+0000","last_active":"2026-03-09T00:31:38.559545+0000","last_peered":"2026-03-09T00:31:38.559545+0000","last_clean":"2026-03-09T00:31:38.559545+0000","last_became_active":"2026-03-09T00:31:32.655303+0000","last_became_peered":"2026-03-09T00:31:32.655303+0000","last_unstale":"2026-03-09T00:31:38.559545+0000","last_undegraded":"2026-03-09T00:31:38.559545+0000","last_fullsized":"2026-03-09T00:31:38.559545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:44:26.602847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685511+0000","last_change":"2026-03-09T00:31:30.096616+0000","last_active":"2026-03-09T00:31:37.685511+0000","last_peered":"2026-03-09T00:31:37.685511+0000","last_clean":"2026-03-09T00:31:37.685511+0000","last_became_active":"2026-03-09T00:31:30.095782+0000","last_became_peered":"2026-03-09T00:31:30.095782+0000","last_unstale":"2026-03-09T00:31:37.685511+0000","last_undegraded":"2026-03-09T00:31:37.685511+0000","last_fullsized":"2026-03-09T00:31:37.685511+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:42:58.383340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"54'5","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:40.533623+0000","last_change":"2026-03-09T00:31:32.643914+0000","last_active":"2026-03-09T00:31:40.533623+0000","last_peered":"2026-03-09T00:31:40.533623+0000","last_clean":"2026-03-09T00:31:40.533623+0000","last_became_active":"2026-03-09T00:31:30.100680+0000","last_became_peered":"2026-03-09T00:31:30.100680+0000","last_unstale":"2026-03-09T00:31:40.533623+0000","last_undegraded":"2026-03-09T00:31:40.533623+0000","last_fullsized":"2026-03-09T00:31:40.533623+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:57:48.150627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031795499999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692532+0000","last_change":"2026-03-09T00:31:34.692577+0000","last_active":"2026-03-09T00:31:37.692532+0000","last_peered":"2026-03-09T00:31:37.692532+0000","last_clean":"2026-03-09T00:31:37.692532+0000","last_became_active":"2026-03-09T00:31:34.692220+0000","last_became_peered":"2026-03-09T00:31:34.692220+0000","last_unstale":"2026-03-09T00:31:37.692532+0000","last_undegraded":"2026-03-09T00:31:37.692532+0000","last_fullsized":"2026-03-09T00:31:37.692532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:50:44.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680889+0000","last_change":"2026-03-09T00:31:36.704598+0000","last_active":"2026-03-09T00:31:37.680889+0000","last_peered":"2026-03-09T00:31:37.680889+0000","last_clean":"2026-03-09T00:31:37.680889+0000","last_became_active":"2026-03-09T00:31:36.704397+0000","last_became_peered":"2026-03-09T00:31:36.704397+0000","last_unstale":"2026-03-09T00:31:37.680889+0000","last_undegraded":"2026-03-09T00:31:37.680889+0000","last_fullsized":"2026-03-09T00:31:37.680889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:26:49.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"54'16","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.629189+0000","last_change":"2026-03-09T00:31:32.653994+0000","last_active":"2026-03-09T00:31:38.629189+0000","last_peered":"2026-03-09T00:31:38.629189+0000","last_clean":"2026-03-09T00:31:38.629189+0000","last_became_active":"2026-03-09T00:31:32.653893+0000","last_became_peered":"2026-03-09T00:31:32.653893+0000","last_unstale":"2026-03-09T00:31:38.629189+0000","last_undegraded":"2026-03-09T00:31:38.629189+0000","last_fullsized":"2026-03-09T00:31:38.629189+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:54:31.143371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675149+0000","last_change":"2026-03-09T00:31:30.096255+0000","last_active":"2026-03-09T00:31:37.675149+0000","last_peered":"2026-03-09T00:31:37.675149+0000","last_clean":"2026-03-09T00:31:37.675149+0000","last_became_active":"2026-03-09T00:31:30.096148+0000","last_became_peered":"2026-03-09T00:31:30.096148+0000","last_unstale":"2026-03-09T00:31:37.675149+0000","last_undegraded":"2026-03-09T00:31:37.675149+0000","last_fullsized":"2026-03-09T00:31:37.675149+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:36:35.701361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'32","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666257+0000","last_change":"2026-03-09T00:31:28.376350+0000","last_active":"2026-03-09T00:31:37.666257+0000","last_peered":"2026-03-09T00:31:37.666257+0000","last_clean":"2026-03-09T00:31:37.666257+0000","last_became_active":"2026-03-09T00:31:28.069968+0000","last_became_peered":"2026-03-09T00:31:28.069968+0000","last_unstale":"2026-03-09T00:31:37.666257+0000","last_undegraded":"2026-03-09T00:31:37.666257+0000","last_fullsized":"2026-03-09T00:31:37.666257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:30:36.901966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:30:36.901966+0000","last_clean_scrub_stamp":"2026-03-09T00:30:36.901966+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:12:18.916128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":459280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666232+0000","last_change":"2026-03-09T00:31:34.703381+0000","last_active":"2026-03-09T00:31:37.666232+0000","last_peered":"2026-03-09T00:31:37.666232+0000","last_clean":"2026-03-09T00:31:37.666232+0000","last_became_active":"2026-03-09T00:31:34.703272+0000","last_became_peered":"2026-03-09T00:31:34.703272+0000","last_unstale":"2026-03-09T00:31:37.666232+0000","last_undegraded":"2026-03-09T00:31:37.666232+0000","last_fullsized":"2026-03-09T00:31:37.666232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:55:53.094112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692282+0000","last_change":"2026-03-09T00:31:36.699390+0000","last_active":"2026-03-09T00:31:37.692282+0000","last_peered":"2026-03-09T00:31:37.692282+0000","last_clean":"2026-03-09T00:31:37.692282+0000","last_became_active":"2026-03-09T00:31:36.699215+0000","last_became_peered":"2026-03-09T00:31:36.699215+0000","last_unstale":"2026-03-09T00:31:37.692282+0000","last_undegraded":"2026-03-09T00:31:37.692282+0000","last_fullsized":"2026-03-09T00:31:37.692282+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:20:25.476330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"54'17","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.633215+0000","last_change":"2026-03-09T00:31:32.656041+0000","last_active":"2026-03-09T00:31:38.633215+0000","last_peered":"2026-03-09T00:31:38.633215+0000","last_clean":"2026-03-09T00:31:38.633215+0000","last_became_active":"2026-03-09T00:31:32.655707+0000","last_became_peered":"2026-03-09T00:31:32.655707+0000","last_unstale":"2026-03-09T00:31:38.633215+0000","last_undegraded":"2026-03-09T00:31:38.633215+0000","last_fullsized":"2026-03-09T00:31:38.633215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:14:32.331423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683956+0000","last_change":"2026-03-09T00:31:30.102766+0000","last_active":"2026-03-09T00:31:37.683956+0000","last_peered":"2026-03-09T00:31:37.683956+0000","last_clean":"2026-03-09T00:31:37.683956+0000","last_became_active":"2026-03-09T00:31:30.102680+0000","last_became_peered":"2026-03-09T00:31:30.102680+0000","last_unstale":"2026-03-09T00:31:37.683956+0000","last_undegraded":"2026-03-09T00:31:37.683956+0000","last_fullsized":"2026-03-09T00:31:37.683956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:18:08.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692907+0000","last_change":"2026-03-09T00:31:34.692392+0000","last_active":"2026-03-09T00:31:37.692907+0000","last_peered":"2026-03-09T00:31:37.692907+0000","last_clean":"2026-03-09T00:31:37.692907+0000","last_became_active":"2026-03-09T00:31:34.691917+0000","last_became_peered":"2026-03-09T00:31:34.691917+0000","last_unstale":"2026-03-09T00:31:37.692907+0000","last_undegraded":"2026-03-09T00:31:37.692907+0000","last_fullsized":"2026-03-09T00:31:37.692907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:15:06.133354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674693+0000","last_change":"2026-03-09T00:31:37.272588+0000","last_active":"2026-03-09T00:31:37.674693+0000","last_peered":"2026-03-09T00:31:37.674693+0000","last_clean":"2026-03-09T00:31:37.674693+0000","last_became_active":"2026-03-09T00:31:37.272082+0000","last_became_peered":"2026-03-09T00:31:37.272082+0000","last_unstale":"2026-03-09T00:31:37.674693+0000","last_undegraded":"2026-03-09T00:31:37.674693+0000","last_fullsized":"2026-03-09T00:31:37.674693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:55:00.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"54'17","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.630597+0000","last_change":"2026-03-09T00:31:32.655895+0000","last_active":"2026-03-09T00:31:38.630597+0000","last_peered":"2026-03-09T00:31:38.630597+0000","last_clean":"2026-03-09T00:31:38.630597+0000","last_became_active":"2026-03-09T00:31:32.655274+0000","last_became_peered":"2026-03-09T00:31:32.655274+0000","last_unstale":"2026-03-09T00:31:38.630597+0000","last_undegraded":"2026-03-09T00:31:38.630597+0000","last_fullsized":"2026-03-09T00:31:38.630597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:21:39.026437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.690012+0000","last_change":"2026-03-09T00:31:30.092192+0000","last_active":"2026-03-09T00:31:37.690012+0000","last_peered":"2026-03-09T00:31:37.690012+0000","last_clean":"2026-03-09T00:31:37.690012+0000","last_became_active":"2026-03-09T00:31:30.092104+0000","last_became_peered":"2026-03-09T00:31:30.092104+0000","last_unstale":"2026-03-09T00:31:37.690012+0000","last_undegraded":"2026-03-09T00:31:37.690012+0000","last_fullsized":"2026-03-09T00:31:37.690012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:45:30.815526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681018+0000","last_change":"2026-03-09T00:31:34.676824+0000","last_active":"2026-03-09T00:31:37.681018+0000","last_peered":"2026-03-09T00:31:37.681018+0000","last_clean":"2026-03-09T00:31:37.681018+0000","last_became_active":"2026-03-09T00:31:34.675954+0000","last_became_peered":"2026-03-09T00:31:34.675954+0000","last_unstale":"2026-03-09T00:31:37.681018+0000","last_undegraded":"2026-03-09T00:31:37.681018+0000","last_fullsized":"2026-03-09T00:31:37.681018+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:37:34.488636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666171+0000","last_change":"2026-03-09T00:31:36.702413+0000","last_active":"2026-03-09T00:31:37.666171+0000","last_peered":"2026-03-09T00:31:37.666171+0000","last_clean":"2026-03-09T00:31:37.666171+0000","last_became_active":"2026-03-09T00:31:36.702335+0000","last_became_peered":"2026-03-09T00:31:36.702335+0000","last_unstale":"2026-03-09T00:31:37.666171+0000","last_undegraded":"2026-03-09T00:31:37.666171+0000","last_fullsized":"2026-03-09T00:31:37.666171+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:01:01.346533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"54'10","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.575053+0000","last_change":"2026-03-09T00:31:32.653155+0000","last_active":"2026-03-09T00:31:38.575053+0000","last_peered":"2026-03-09T00:31:38.575053+0000","last_clean":"2026-03-09T00:31:38.575053+0000","last_became_active":"2026-03-09T00:31:32.652746+0000","last_became_peered":"2026-03-09T00:31:32.652746+0000","last_unstale":"2026-03-09T00:31:38.575053+0000","last_undegraded":"2026-03-09T00:31:38.575053+0000","last_fullsized":"2026-03-09T00:31:38.575053+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:28:55.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675025+0000","last_change":"2026-03-09T00:31:30.089571+0000","last_active":"2026-03-09T00:31:37.675025+0000","last_peered":"2026-03-09T00:31:37.675025+0000","last_clean":"2026-03-09T00:31:37.675025+0000","last_became_active":"2026-03-09T00:31:30.089406+0000","last_became_peered":"2026-03-09T00:31:30.089406+0000","last_unstale":"2026-03-09T00:31:37.675025+0000","last_undegraded":"2026-03-09T00:31:37.675025+0000","last_fullsized":"2026-03-09T00:31:37.675025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:32:21.358730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.227813+0000","last_change":"2026-03-09T00:31:34.702688+0000","last_active":"2026-03-09T00:31:38.227813+0000","last_peered":"2026-03-09T00:31:38.227813+0000","last_clean":"2026-03-09T00:31:38.227813+0000","last_became_active":"2026-03-09T00:31:34.702579+0000","last_became_peered":"2026-03-09T00:31:34.702579+0000","last_unstale":"2026-03-09T00:31:38.227813+0000","last_undegraded":"2026-03-09T00:31:38.227813+0000","last_fullsized":"2026-03-09T00:31:38.227813+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:42:15.165077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684084+0000","last_change":"2026-03-09T00:31:36.686524+0000","last_active":"2026-03-09T00:31:37.684084+0000","last_peered":"2026-03-09T00:31:37.684084+0000","last_clean":"2026-03-09T00:31:37.684084+0000","last_became_active":"2026-03-09T00:31:36.686288+0000","last_became_peered":"2026-03-09T00:31:36.686288+0000","last_unstale":"2026-03-09T00:31:37.684084+0000","last_undegraded":"2026-03-09T00:31:37.684084+0000","last_fullsized":"2026-03-09T00:31:37.684084+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:47:25.214236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"54'16","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.605954+0000","last_change":"2026-03-09T00:31:32.655051+0000","last_active":"2026-03-09T00:31:38.605954+0000","last_peered":"2026-03-09T00:31:38.605954+0000","last_clean":"2026-03-09T00:31:38.605954+0000","last_became_active":"2026-03-09T00:31:32.654974+0000","last_became_peered":"2026-03-09T00:31:32.654974+0000","last_unstale":"2026-03-09T00:31:38.605954+0000","last_undegraded":"2026-03-09T00:31:38.605954+0000","last_fullsized":"2026-03-09T00:31:38.605954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:58:46.876633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"47'1","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.927187+0000","last_change":"2026-03-09T00:31:30.096254+0000","last_active":"2026-03-09T00:31:37.927187+0000","last_peered":"2026-03-09T00:31:37.927187+0000","last_clean":"2026-03-09T00:31:37.927187+0000","last_became_active":"2026-03-09T00:31:30.095881+0000","last_became_peered":"2026-03-09T00:31:30.095881+0000","last_unstale":"2026-03-09T00:31:37.927187+0000","last_undegraded":"2026-03-09T00:31:37.927187+0000","last_fullsized":"2026-03-09T00:31:37.927187+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:45:11.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666608+0000","last_change":"2026-03-09T00:31:34.675371+0000","last_active":"2026-03-09T00:31:37.666608+0000","last_peered":"2026-03-09T00:31:37.666608+0000","last_clean":"2026-03-09T00:31:37.666608+0000","last_became_active":"2026-03-09T00:31:34.675250+0000","last_became_peered":"2026-03-09T00:31:34.675250+0000","last_unstale":"2026-03-09T00:31:37.666608+0000","last_undegraded":"2026-03-09T00:31:37.666608+0000","last_fullsized":"2026-03-09T00:31:37.666608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:29:52.362885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685927+0000","last_change":"2026-03-09T00:31:36.703622+0000","last_active":"2026-03-09T00:31:37.685927+0000","last_peered":"2026-03-09T00:31:37.685927+0000","last_clean":"2026-03-09T00:31:37.685927+0000","last_became_active":"2026-03-09T00:31:36.703460+0000","last_became_peered":"2026-03-09T00:31:36.703460+0000","last_unstale":"2026-03-09T00:31:37.685927+0000","last_undegraded":"2026-03-09T00:31:37.685927+0000","last_fullsized":"2026-03-09T00:31:37.685927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:43:15.125772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'25","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.665733+0000","last_change":"2026-03-09T00:31:32.655093+0000","last_active":"2026-03-09T00:31:38.665733+0000","last_peered":"2026-03-09T00:31:38.665733+0000","last_clean":"2026-03-09T00:31:38.665733+0000","last_became_active":"2026-03-09T00:31:32.655020+0000","last_became_peered":"2026-03-09T00:31:32.655020+0000","last_unstale":"2026-03-09T00:31:38.665733+0000","last_undegraded":"2026-03-09T00:31:38.665733+0000","last_fullsized":"2026-03-09T00:31:38.665733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:24:55.038174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666204+0000","last_change":"2026-03-09T00:31:30.101289+0000","last_active":"2026-03-09T00:31:37.666204+0000","last_peered":"2026-03-09T00:31:37.666204+0000","last_clean":"2026-03-09T00:31:37.666204+0000","last_became_active":"2026-03-09T00:31:30.101171+0000","last_became_peered":"2026-03-09T00:31:30.101171+0000","last_unstale":"2026-03-09T00:31:37.666204+0000","last_undegraded":"2026-03-09T00:31:37.666204+0000","last_fullsized":"2026-03-09T00:31:37.666204+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:36:25.626216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666650+0000","last_change":"2026-03-09T00:31:34.702807+0000","last_active":"2026-03-09T00:31:37.666650+0000","last_peered":"2026-03-09T00:31:37.666650+0000","last_clean":"2026-03-09T00:31:37.666650+0000","last_became_active":"2026-03-09T00:31:34.702700+0000","last_became_peered":"2026-03-09T00:31:34.702700+0000","last_unstale":"2026-03-09T00:31:37.666650+0000","last_undegraded":"2026-03-09T00:31:37.666650+0000","last_fullsized":"2026-03-09T00:31:37.666650+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:36:39.878159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666179+0000","last_change":"2026-03-09T00:31:36.699483+0000","last_active":"2026-03-09T00:31:37.666179+0000","last_peered":"2026-03-09T00:31:37.666179+0000","last_clean":"2026-03-09T00:31:37.666179+0000","last_became_active":"2026-03-09T00:31:36.699397+0000","last_became_peered":"2026-03-09T00:31:36.699397+0000","last_unstale":"2026-03-09T00:31:37.666179+0000","last_undegraded":"2026-03-09T00:31:37.666179+0000","last_fullsized":"2026-03-09T00:31:37.666179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:48:38.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"54'24","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.379368+0000","last_change":"2026-03-09T00:31:32.656075+0000","last_active":"2026-03-09T00:31:38.379368+0000","last_peered":"2026-03-09T00:31:38.379368+0000","last_clean":"2026-03-09T00:31:38.379368+0000","last_became_active":"2026-03-09T00:31:32.655388+0000","last_became_peered":"2026-03-09T00:31:32.655388+0000","last_unstale":"2026-03-09T00:31:38.379368+0000","last_undegraded":"2026-03-09T00:31:38.379368+0000","last_fullsized":"2026-03-09T00:31:38.379368+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:11:43.651895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666104+0000","last_change":"2026-03-09T00:31:30.093517+0000","last_active":"2026-03-09T00:31:37.666104+0000","last_peered":"2026-03-09T00:31:37.666104+0000","last_clean":"2026-03-09T00:31:37.666104+0000","last_became_active":"2026-03-09T00:31:30.093403+0000","last_became_peered":"2026-03-09T00:31:30.093403+0000","last_unstale":"2026-03-09T00:31:37.666104+0000","last_undegraded":"2026-03-09T00:31:37.666104+0000","last_fullsized":"2026-03-09T00:31:37.666104+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:28:17.437645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666564+0000","last_change":"2026-03-09T00:31:34.661935+0000","last_active":"2026-03-09T00:31:37.666564+0000","last_peered":"2026-03-09T00:31:37.666564+0000","last_clean":"2026-03-09T00:31:37.666564+0000","last_became_active":"2026-03-09T00:31:34.661860+0000","last_became_peered":"2026-03-09T00:31:34.661860+0000","last_unstale":"2026-03-09T00:31:37.666564+0000","last_undegraded":"2026-03-09T00:31:37.666564+0000","last_fullsized":"2026-03-09T00:31:37.666564+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:29:55.624632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674872+0000","last_change":"2026-03-09T00:31:36.674567+0000","last_active":"2026-03-09T00:31:37.674872+0000","last_peered":"2026-03-09T00:31:37.674872+0000","last_clean":"2026-03-09T00:31:37.674872+0000","last_became_active":"2026-03-09T00:31:36.672827+0000","last_became_peered":"2026-03-09T00:31:36.672827+0000","last_unstale":"2026-03-09T00:31:37.674872+0000","last_undegraded":"2026-03-09T00:31:37.674872+0000","last_fullsized":"2026-03-09T00:31:37.674872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:27:13.777293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"54'27","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.572022+0000","last_change":"2026-03-09T00:31:32.652325+0000","last_active":"2026-03-09T00:31:38.572022+0000","last_peered":"2026-03-09T00:31:38.572022+0000","last_clean":"2026-03-09T00:31:38.572022+0000","last_became_active":"2026-03-09T00:31:32.652118+0000","last_became_peered":"2026-03-09T00:31:32.652118+0000","last_unstale":"2026-03-09T00:31:38.572022+0000","last_undegraded":"2026-03-09T00:31:38.572022+0000","last_fullsized":"2026-03-09T00:31:38.572022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:53:58.503276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"47'2","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.029141+0000","last_change":"2026-03-09T00:31:30.093814+0000","last_active":"2026-03-09T00:31:38.029141+0000","last_peered":"2026-03-09T00:31:38.029141+0000","last_clean":"2026-03-09T00:31:38.029141+0000","last_became_active":"2026-03-09T00:31:30.093711+0000","last_became_peered":"2026-03-09T00:31:30.093711+0000","last_unstale":"2026-03-09T00:31:38.029141+0000","last_undegraded":"2026-03-09T00:31:38.029141+0000","last_fullsized":"2026-03-09T00:31:38.029141+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:29:28.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.239322+0000","last_change":"2026-03-09T00:31:34.677197+0000","last_active":"2026-03-09T00:31:38.239322+0000","last_peered":"2026-03-09T00:31:38.239322+0000","last_clean":"2026-03-09T00:31:38.239322+0000","last_became_active":"2026-03-09T00:31:34.677104+0000","last_became_peered":"2026-03-09T00:31:34.677104+0000","last_unstale":"2026-03-09T00:31:38.239322+0000","last_undegraded":"2026-03-09T00:31:38.239322+0000","last_fullsized":"2026-03-09T00:31:38.239322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:13:06.866814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692223+0000","last_change":"2026-03-09T00:31:37.272530+0000","last_active":"2026-03-09T00:31:37.692223+0000","last_peered":"2026-03-09T00:31:37.692223+0000","last_clean":"2026-03-09T00:31:37.692223+0000","last_became_active":"2026-03-09T00:31:37.272378+0000","last_became_peered":"2026-03-09T00:31:37.272378+0000","last_unstale":"2026-03-09T00:31:37.692223+0000","last_undegraded":"2026-03-09T00:31:37.692223+0000","last_fullsized":"2026-03-09T00:31:37.692223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:55:18.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.689978+0000","last_change":"2026-03-09T00:31:30.095475+0000","last_active":"2026-03-09T00:31:37.689978+0000","last_peered":"2026-03-09T00:31:37.689978+0000","last_clean":"2026-03-09T00:31:37.689978+0000","last_became_active":"2026-03-09T00:31:30.095371+0000","last_became_peered":"2026-03-09T00:31:30.095371+0000","last_unstale":"2026-03-09T00:31:37.689978+0000","last_undegraded":"2026-03-09T00:31:37.689978+0000","last_fullsized":"2026-03-09T00:31:37.689978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:38:32.157827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"54'12","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.593744+0000","last_change":"2026-03-09T00:31:32.662211+0000","last_active":"2026-03-09T00:31:38.593744+0000","last_peered":"2026-03-09T00:31:38.593744+0000","last_clean":"2026-03-09T00:31:38.593744+0000","last_became_active":"2026-03-09T00:31:32.658542+0000","last_became_peered":"2026-03-09T00:31:32.658542+0000","last_unstale":"2026-03-09T00:31:38.593744+0000","last_undegraded":"2026-03-09T00:31:38.593744+0000","last_fullsized":"2026-03-09T00:31:38.593744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:41:38.446874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692738+0000","last_change":"2026-03-09T00:31:34.692473+0000","last_active":"2026-03-09T00:31:37.692738+0000","last_peered":"2026-03-09T00:31:37.692738+0000","last_clean":"2026-03-09T00:31:37.692738+0000","last_became_active":"2026-03-09T00:31:34.692030+0000","last_became_peered":"2026-03-09T00:31:34.692030+0000","last_unstale":"2026-03-09T00:31:37.692738+0000","last_undegraded":"2026-03-09T00:31:37.692738+0000","last_fullsized":"2026-03-09T00:31:37.692738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:12:45.750834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666585+0000","last_change":"2026-03-09T00:31:37.271999+0000","last_active":"2026-03-09T00:31:37.666585+0000","last_peered":"2026-03-09T00:31:37.666585+0000","last_clean":"2026-03-09T00:31:37.666585+0000","last_became_active":"2026-03-09T00:31:37.271778+0000","last_became_peered":"2026-03-09T00:31:37.271778+0000","last_unstale":"2026-03-09T00:31:37.666585+0000","last_undegraded":"2026-03-09T00:31:37.666585+0000","last_fullsized":"2026-03-09T00:31:37.666585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:56:31.980476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"54'21","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.410678+0000","last_change":"2026-03-09T00:31:32.654408+0000","last_active":"2026-03-09T00:31:38.410678+0000","last_peered":"2026-03-09T00:31:38.410678+0000","last_clean":"2026-03-09T00:31:38.410678+0000","last_became_active":"2026-03-09T00:31:32.654318+0000","last_became_peered":"2026-03-09T00:31:32.654318+0000","last_unstale":"2026-03-09T00:31:38.410678+0000","last_undegraded":"2026-03-09T00:31:38.410678+0000","last_fullsized":"2026-03-09T00:31:38.410678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:05:50.459986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666031+0000","last_change":"2026-03-09T00:31:30.100912+0000","last_active":"2026-03-09T00:31:37.666031+0000","last_peered":"2026-03-09T00:31:37.666031+0000","last_clean":"2026-03-09T00:31:37.666031+0000","last_became_active":"2026-03-09T00:31:30.100573+0000","last_became_peered":"2026-03-09T00:31:30.100573+0000","last_unstale":"2026-03-09T00:31:37.666031+0000","last_undegraded":"2026-03-09T00:31:37.666031+0000","last_fullsized":"2026-03-09T00:31:37.666031+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:28:01.197676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674818+0000","last_change":"2026-03-09T00:31:34.663727+0000","last_active":"2026-03-09T00:31:37.674818+0000","last_peered":"2026-03-09T00:31:37.674818+0000","last_clean":"2026-03-09T00:31:37.674818+0000","last_became_active":"2026-03-09T00:31:34.663593+0000","last_became_peered":"2026-03-09T00:31:34.663593+0000","last_unstale":"2026-03-09T00:31:37.674818+0000","last_undegraded":"2026-03-09T00:31:37.674818+0000","last_fullsized":"2026-03-09T00:31:37.674818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:42:03.397621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666780+0000","last_change":"2026-03-09T00:31:36.687007+0000","last_active":"2026-03-09T00:31:37.666780+0000","last_peered":"2026-03-09T00:31:37.666780+0000","last_clean":"2026-03-09T00:31:37.666780+0000","last_became_active":"2026-03-09T00:31:36.686924+0000","last_became_peered":"2026-03-09T00:31:36.686924+0000","last_unstale":"2026-03-09T00:31:37.666780+0000","last_undegraded":"2026-03-09T00:31:37.666780+0000","last_fullsized":"2026-03-09T00:31:37.666780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:59:29.483250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"54'15","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.618784+0000","last_change":"2026-03-09T00:31:32.652400+0000","last_active":"2026-03-09T00:31:38.618784+0000","last_peered":"2026-03-09T00:31:38.618784+0000","last_clean":"2026-03-09T00:31:38.618784+0000","last_became_active":"2026-03-09T00:31:32.652240+0000","last_became_peered":"2026-03-09T00:31:32.652240+0000","last_unstale":"2026-03-09T00:31:38.618784+0000","last_undegraded":"2026-03-09T00:31:38.618784+0000","last_fullsized":"2026-03-09T00:31:38.618784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:57:07.741328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685446+0000","last_change":"2026-03-09T00:31:30.109146+0000","last_active":"2026-03-09T00:31:37.685446+0000","last_peered":"2026-03-09T00:31:37.685446+0000","last_clean":"2026-03-09T00:31:37.685446+0000","last_became_active":"2026-03-09T00:31:30.107942+0000","last_became_peered":"2026-03-09T00:31:30.107942+0000","last_unstale":"2026-03-09T00:31:37.685446+0000","last_undegraded":"2026-03-09T00:31:37.685446+0000","last_fullsized":"2026-03-09T00:31:37.685446+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:52:48.790873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.237489+0000","last_change":"2026-03-09T00:31:34.653388+0000","last_active":"2026-03-09T00:31:38.237489+0000","last_peered":"2026-03-09T00:31:38.237489+0000","last_clean":"2026-03-09T00:31:38.237489+0000","last_became_active":"2026-03-09T00:31:34.653303+0000","last_became_peered":"2026-03-09T00:31:34.653303+0000","last_unstale":"2026-03-09T00:31:38.237489+0000","last_undegraded":"2026-03-09T00:31:38.237489+0000","last_fullsized":"2026-03-09T00:31:38.237489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:20:59.897338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683657+0000","last_change":"2026-03-09T00:31:36.686582+0000","last_active":"2026-03-09T00:31:37.683657+0000","last_peered":"2026-03-09T00:31:37.683657+0000","last_clean":"2026-03-09T00:31:37.683657+0000","last_became_active":"2026-03-09T00:31:36.686412+0000","last_became_peered":"2026-03-09T00:31:36.686412+0000","last_unstale":"2026-03-09T00:31:37.683657+0000","last_undegraded":"2026-03-09T00:31:37.683657+0000","last_fullsized":"2026-03-09T00:31:37.683657+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:09:02.245841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"54'22","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.616039+0000","last_change":"2026-03-09T00:31:32.658700+0000","last_active":"2026-03-09T00:31:38.616039+0000","last_peered":"2026-03-09T00:31:38.616039+0000","last_clean":"2026-03-09T00:31:38.616039+0000","last_became_active":"2026-03-09T00:31:32.658368+0000","last_became_peered":"2026-03-09T00:31:32.658368+0000","last_unstale":"2026-03-09T00:31:38.616039+0000","last_undegraded":"2026-03-09T00:31:38.616039+0000","last_fullsized":"2026-03-09T00:31:38.616039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:19:54.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666639+0000","last_change":"2026-03-09T00:31:30.108316+0000","last_active":"2026-03-09T00:31:37.666639+0000","last_peered":"2026-03-09T00:31:37.666639+0000","last_clean":"2026-03-09T00:31:37.666639+0000","last_became_active":"2026-03-09T00:31:30.107779+0000","last_became_peered":"2026-03-09T00:31:30.107779+0000","last_unstale":"2026-03-09T00:31:37.666639+0000","last_undegraded":"2026-03-09T00:31:37.666639+0000","last_fullsized":"2026-03-09T00:31:37.666639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:41:26.844971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.219621+0000","last_change":"2026-03-09T00:31:34.692658+0000","last_active":"2026-03-09T00:31:38.219621+0000","last_peered":"2026-03-09T00:31:38.219621+0000","last_clean":"2026-03-09T00:31:38.219621+0000","last_became_active":"2026-03-09T00:31:34.691790+0000","last_became_peered":"2026-03-09T00:31:34.691790+0000","last_unstale":"2026-03-09T00:31:38.219621+0000","last_undegraded":"2026-03-09T00:31:38.219621+0000","last_fullsized":"2026-03-09T00:31:38.219621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:33:49.318260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685196+0000","last_change":"2026-03-09T00:31:36.704016+0000","last_active":"2026-03-09T00:31:37.685196+0000","last_peered":"2026-03-09T00:31:37.685196+0000","last_clean":"2026-03-09T00:31:37.685196+0000","last_became_active":"2026-03-09T00:31:36.703824+0000","last_became_peered":"2026-03-09T00:31:36.703824+0000","last_unstale":"2026-03-09T00:31:37.685196+0000","last_undegraded":"2026-03-09T00:31:37.685196+0000","last_fullsized":"2026-03-09T00:31:37.685196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:39:14.000264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"54'11","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.603551+0000","last_change":"2026-03-09T00:31:32.655995+0000","last_active":"2026-03-09T00:31:38.603551+0000","last_peered":"2026-03-09T00:31:38.603551+0000","last_clean":"2026-03-09T00:31:38.603551+0000","last_became_active":"2026-03-09T00:31:32.655838+0000","last_became_peered":"2026-03-09T00:31:32.655838+0000","last_unstale":"2026-03-09T00:31:38.603551+0000","last_undegraded":"2026-03-09T00:31:38.603551+0000","last_fullsized":"2026-03-09T00:31:38.603551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:45:12.328548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683876+0000","last_change":"2026-03-09T00:31:30.090085+0000","last_active":"2026-03-09T00:31:37.683876+0000","last_peered":"2026-03-09T00:31:37.683876+0000","last_clean":"2026-03-09T00:31:37.683876+0000","last_became_active":"2026-03-09T00:31:30.089103+0000","last_became_peered":"2026-03-09T00:31:30.089103+0000","last_unstale":"2026-03-09T00:31:37.683876+0000","last_undegraded":"2026-03-09T00:31:37.683876+0000","last_fullsized":"2026-03-09T00:31:37.683876+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:03:05.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680549+0000","last_change":"2026-03-09T00:31:34.693308+0000","last_active":"2026-03-09T00:31:37.680549+0000","last_peered":"2026-03-09T00:31:37.680549+0000","last_clean":"2026-03-09T00:31:37.680549+0000","last_became_active":"2026-03-09T00:31:34.693193+0000","last_became_peered":"2026-03-09T00:31:34.693193+0000","last_unstale":"2026-03-09T00:31:37.680549+0000","last_undegraded":"2026-03-09T00:31:37.680549+0000","last_fullsized":"2026-03-09T00:31:37.680549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:17:59.013760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674737+0000","last_change":"2026-03-09T00:31:36.698946+0000","last_active":"2026-03-09T00:31:37.674737+0000","last_peered":"2026-03-09T00:31:37.674737+0000","last_clean":"2026-03-09T00:31:37.674737+0000","last_became_active":"2026-03-09T00:31:36.698788+0000","last_became_peered":"2026-03-09T00:31:36.698788+0000","last_unstale":"2026-03-09T00:31:37.674737+0000","last_undegraded":"2026-03-09T00:31:37.674737+0000","last_fullsized":"2026-03-09T00:31:37.674737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:16:53.486598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"54'9","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.510509+0000","last_change":"2026-03-09T00:31:32.653333+0000","last_active":"2026-03-09T00:31:38.510509+0000","last_peered":"2026-03-09T00:31:38.510509+0000","last_clean":"2026-03-09T00:31:38.510509+0000","last_became_active":"2026-03-09T00:31:32.653241+0000","last_became_peered":"2026-03-09T00:31:32.653241+0000","last_unstale":"2026-03-09T00:31:38.510509+0000","last_undegraded":"2026-03-09T00:31:38.510509+0000","last_fullsized":"2026-03-09T00:31:38.510509+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:05:45.457022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665934+0000","last_change":"2026-03-09T00:31:30.099041+0000","last_active":"2026-03-09T00:31:37.665934+0000","last_peered":"2026-03-09T00:31:37.665934+0000","last_clean":"2026-03-09T00:31:37.665934+0000","last_became_active":"2026-03-09T00:31:30.098941+0000","last_became_peered":"2026-03-09T00:31:30.098941+0000","last_unstale":"2026-03-09T00:31:37.665934+0000","last_undegraded":"2026-03-09T00:31:37.665934+0000","last_fullsized":"2026-03-09T00:31:37.665934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:07:37.423005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675496+0000","last_change":"2026-03-09T00:31:34.663668+0000","last_active":"2026-03-09T00:31:37.675496+0000","last_peered":"2026-03-09T00:31:37.675496+0000","last_clean":"2026-03-09T00:31:37.675496+0000","last_became_active":"2026-03-09T00:31:34.663478+0000","last_became_peered":"2026-03-09T00:31:34.663478+0000","last_unstale":"2026-03-09T00:31:37.675496+0000","last_undegraded":"2026-03-09T00:31:37.675496+0000","last_fullsized":"2026-03-09T00:31:37.675496+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:34:24.956101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685298+0000","last_change":"2026-03-09T00:31:36.687636+0000","last_active":"2026-03-09T00:31:37.685298+0000","last_peered":"2026-03-09T00:31:37.685298+0000","last_clean":"2026-03-09T00:31:37.685298+0000","last_became_active":"2026-03-09T00:31:36.687552+0000","last_became_peered":"2026-03-09T00:31:36.687552+0000","last_unstale":"2026-03-09T00:31:37.685298+0000","last_undegraded":"2026-03-09T00:31:37.685298+0000","last_fullsized":"2026-03-09T00:31:37.685298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:47:10.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"54'17","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.645207+0000","last_change":"2026-03-09T00:31:32.658742+0000","last_active":"2026-03-09T00:31:38.645207+0000","last_peered":"2026-03-09T00:31:38.645207+0000","last_clean":"2026-03-09T00:31:38.645207+0000","last_became_active":"2026-03-09T00:31:32.658012+0000","last_became_peered":"2026-03-09T00:31:32.658012+0000","last_unstale":"2026-03-09T00:31:38.645207+0000","last_undegraded":"2026-03-09T00:31:38.645207+0000","last_fullsized":"2026-03-09T00:31:38.645207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:25:01.646925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692554+0000","last_change":"2026-03-09T00:31:30.100315+0000","last_active":"2026-03-09T00:31:37.692554+0000","last_peered":"2026-03-09T00:31:37.692554+0000","last_clean":"2026-03-09T00:31:37.692554+0000","last_became_active":"2026-03-09T00:31:30.100224+0000","last_became_peered":"2026-03-09T00:31:30.100224+0000","last_unstale":"2026-03-09T00:31:37.692554+0000","last_undegraded":"2026-03-09T00:31:37.692554+0000","last_fullsized":"2026-03-09T00:31:37.692554+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:43:04.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666426+0000","last_change":"2026-03-09T00:31:34.676956+0000","last_active":"2026-03-09T00:31:37.666426+0000","last_peered":"2026-03-09T00:31:37.666426+0000","last_clean":"2026-03-09T00:31:37.666426+0000","last_became_active":"2026-03-09T00:31:34.676886+0000","last_became_peered":"2026-03-09T00:31:34.676886+0000","last_unstale":"2026-03-09T00:31:37.666426+0000","last_undegraded":"2026-03-09T00:31:37.666426+0000","last_fullsized":"2026-03-09T00:31:37.666426+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:44:26.310705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675679+0000","last_change":"2026-03-09T00:31:37.270527+0000","last_active":"2026-03-09T00:31:37.675679+0000","last_peered":"2026-03-09T00:31:37.675679+0000","last_clean":"2026-03-09T00:31:37.675679+0000","last_became_active":"2026-03-09T00:31:37.270359+0000","last_became_peered":"2026-03-09T00:31:37.270359+0000","last_unstale":"2026-03-09T00:31:37.675679+0000","last_undegraded":"2026-03-09T00:31:37.675679+0000","last_fullsized":"2026-03-09T00:31:37.675679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:35:34.474926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"54'4","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.384940+0000","last_change":"2026-03-09T00:31:32.658629+0000","last_active":"2026-03-09T00:31:38.384940+0000","last_peered":"2026-03-09T00:31:38.384940+0000","last_clean":"2026-03-09T00:31:38.384940+0000","last_became_active":"2026-03-09T00:31:32.658236+0000","last_became_peered":"2026-03-09T00:31:32.658236+0000","last_unstale":"2026-03-09T00:31:38.384940+0000","last_undegraded":"2026-03-09T00:31:38.384940+0000","last_fullsized":"2026-03-09T00:31:38.384940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:50:35.606950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685389+0000","last_change":"2026-03-09T00:31:30.097550+0000","last_active":"2026-03-09T00:31:37.685389+0000","last_peered":"2026-03-09T00:31:37.685389+0000","last_clean":"2026-03-09T00:31:37.685389+0000","last_became_active":"2026-03-09T00:31:30.096936+0000","last_became_peered":"2026-03-09T00:31:30.096936+0000","last_unstale":"2026-03-09T00:31:37.685389+0000","last_undegraded":"2026-03-09T00:31:37.685389+0000","last_fullsized":"2026-03-09T00:31:37.685389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:59:14.467579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.690300+0000","last_change":"2026-03-09T00:31:34.697165+0000","last_active":"2026-03-09T00:31:37.690300+0000","last_peered":"2026-03-09T00:31:37.690300+0000","last_clean":"2026-03-09T00:31:37.690300+0000","last_became_active":"2026-03-09T00:31:34.697090+0000","last_became_peered":"2026-03-09T00:31:34.697090+0000","last_unstale":"2026-03-09T00:31:37.690300+0000","last_undegraded":"2026-03-09T00:31:37.690300+0000","last_fullsized":"2026-03-09T00:31:37.690300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:42:10.528571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665715+0000","last_change":"2026-03-09T00:31:36.697706+0000","last_active":"2026-03-09T00:31:37.665715+0000","last_peered":"2026-03-09T00:31:37.665715+0000","last_clean":"2026-03-09T00:31:37.665715+0000","last_became_active":"2026-03-09T00:31:36.697393+0000","last_became_peered":"2026-03-09T00:31:36.697393+0000","last_unstale":"2026-03-09T00:31:37.665715+0000","last_undegraded":"2026-03-09T00:31:37.665715+0000","last_fullsized":"2026-03-09T00:31:37.665715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:48:08.754265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681387+0000","last_change":"2026-03-09T00:31:36.682606+0000","last_active":"2026-03-09T00:31:37.681387+0000","last_peered":"2026-03-09T00:31:37.681387+0000","last_clean":"2026-03-09T00:31:37.681387+0000","last_became_active":"2026-03-09T00:31:36.681641+0000","last_became_peered":"2026-03-09T00:31:36.681641+0000","last_unstale":"2026-03-09T00:31:37.681387+0000","last_undegraded":"2026-03-09T00:31:37.681387+0000","last_fullsized":"2026-03-09T00:31:37.681387+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:47:21.827557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675089+0000","last_change":"2026-03-09T00:31:30.091631+0000","last_active":"2026-03-09T00:31:37.675089+0000","last_peered":"2026-03-09T00:31:37.675089+0000","last_clean":"2026-03-09T00:31:37.675089+0000","last_became_active":"2026-03-09T00:31:30.091505+0000","last_became_peered":"2026-03-09T00:31:30.091505+0000","last_unstale":"2026-03-09T00:31:37.675089+0000","last_undegraded":"2026-03-09T00:31:37.675089+0000","last_fullsized":"2026-03-09T00:31:37.675089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:27:40.153728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"54'17","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.648575+0000","last_change":"2026-03-09T00:31:32.654849+0000","last_active":"2026-03-09T00:31:38.648575+0000","last_peered":"2026-03-09T00:31:38.648575+0000","last_clean":"2026-03-09T00:31:38.648575+0000","last_became_active":"2026-03-09T00:31:32.654762+0000","last_became_peered":"2026-03-09T00:31:32.654762+0000","last_unstale":"2026-03-09T00:31:38.648575+0000","last_undegraded":"2026-03-09T00:31:38.648575+0000","last_fullsized":"2026-03-09T00:31:38.648575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:37:23.837632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685766+0000","last_change":"2026-03-09T00:31:34.679131+0000","last_active":"2026-03-09T00:31:37.685766+0000","last_peered":"2026-03-09T00:31:37.685766+0000","last_clean":"2026-03-09T00:31:37.685766+0000","last_became_active":"2026-03-09T00:31:34.679037+0000","last_became_peered":"2026-03-09T00:31:34.679037+0000","last_unstale":"2026-03-09T00:31:37.685766+0000","last_undegraded":"2026-03-09T00:31:37.685766+0000","last_fullsized":"2026-03-09T00:31:37.685766+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:31:52.805679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":986,"num_read_kb":711,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":589,"ondisk_log_size":589,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":459280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1388544,"data_stored":1377840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":43,"seq":184683593733,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27828,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939596,"statfs":{"total":21470642176,"available":21442146304,"internally_reserved":0,"allocated":1019904,"data_stored":665781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1585,"internal_metadata":27457999},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757255,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27808,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939616,"statfs":{"total":21470642176,"available":21442166784,"internally_reserved":0,"allocated":995328,"data_stored":665240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27457995},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953481,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27360,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940064,"statfs":{"total":21470642176,"available":21442625536,"internally_reserved":0,"allocated":536576,"data_stored":206319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117003,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27376,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940048,"statfs":{"total":21470642176,"available":21442609152,"internally_reserved":0,"allocated":557056,"data_stored":205572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247821,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27392,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940032,"statfs":{"total":21470642176,"available":21442592768,"internally_reserved":0,"allocated":573440,"data_stored":207287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27457996},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27344,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940080,"statfs":{"total":21470642176,"available":21442641920,"internally_reserved":0,"allocated":524288,"data_stored":205115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27416,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940008,"statfs":{"total":21470642176,"available":21442568192,"internally_reserved":0,"allocated":598016,"data_stored":206765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27832,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939592,"statfs":{"total":21470642176,"available":21442142208,"internally_reserved":0,"allocated":1024000,"data_stored":665490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-09T00:31:43.140 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph pg dump --format=json 2026-03-09T00:31:43.353 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:43.393 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:43 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2175550043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T00:31:43.393 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:43 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2175550043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 -- 192.168.123.109:0/1322480782 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 msgr2=0x7f44e4105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1322480782 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e4105320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009a30 tx=0x7f44cc02f220 comp rx=0 tx=0).stop 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 -- 192.168.123.109:0/1322480782 shutdown_connections 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1322480782 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e410a070 0x7f44e4111bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1322480782 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f44e41058f0 0x7f44e4109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1322480782 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e4105320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.475 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 -- 192.168.123.109:0/1322480782 >> 192.168.123.109:0/1322480782 conn(0x7f44e4100a20 msgr2=0x7f44e4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:43.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.476+0000 7f44eaab6640 1 -- 192.168.123.109:0/1322480782 shutdown_connections 2026-03-09T00:31:43.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.477+0000 7f44eaab6640 1 -- 192.168.123.109:0/1322480782 wait complete. 2026-03-09T00:31:43.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.477+0000 7f44eaab6640 1 Processor -- start 2026-03-09T00:31:43.476 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.477+0000 7f44eaab6640 1 -- start start 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.477+0000 7f44eaab6640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e41a26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44eaab6640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 0x7f44e41a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44dbfff640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 0x7f44e41a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44dbfff640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 0x7f44e41a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57424/0 (socket says 192.168.123.109:57424) 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44e882b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e41a26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44e882b640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e41a26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3300/0 says I am v2:192.168.123.109:59078/0 (socket says 192.168.123.109:59078) 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44eaab6640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f44e410a070 0x7f44e419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.477 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44eaab6640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f44e41145c0 con 0x7f44e4104f40 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44eaab6640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4114440 con 0x7f44e410a070 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44eaab6640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f44e4114740 con 0x7f44e41058f0 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.478+0000 7f44dbfff640 1 -- 192.168.123.109:0/1292404820 learned_addr learned my addr 192.168.123.109:0/1292404820 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44e902c640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f44e410a070 0x7f44e419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44dbfff640 1 -- 192.168.123.109:0/1292404820 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f44e410a070 msgr2=0x7f44e419c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44dbfff640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f44e410a070 0x7f44e419c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44dbfff640 1 -- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 msgr2=0x7f44e41a26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44dbfff640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e41a26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44dbfff640 1 -- 192.168.123.109:0/1292404820 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e419cfd0 con 0x7f44e41058f0 2026-03-09T00:31:43.478 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44dbfff640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 0x7f44e41a2c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44d400cab0 tx=0x7f44d400cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:43.479 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4013070 con 0x7f44e41058f0 2026-03-09T00:31:43.479 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.479+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f44d4007da0 con 0x7f44e41058f0 2026-03-09T00:31:43.479 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.480+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d400f450 con 0x7f44e41058f0 2026-03-09T00:31:43.479 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.480+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e419d2c0 con 0x7f44e41058f0 2026-03-09T00:31:43.480 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.480+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e41a95b0 con 0x7f44e41058f0 2026-03-09T00:31:43.480 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.481+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b0005180 con 0x7f44e41058f0 2026-03-09T00:31:43.484 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.484+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f44d4007930 con 0x7f44e41058f0 2026-03-09T00:31:43.484 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.485+0000 7f44d9ffb640 1 --2- 192.168.123.109:0/1292404820 >> v2:192.168.123.109:6800/82853931 conn(0x7f44b40776a0 0x7f44b4079b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.484 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.485+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 5922+0+0 (secure 0 0 0) 0x7f44d4099ec0 con 0x7f44e41058f0 2026-03-09T00:31:43.484 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.485+0000 7f44e882b640 1 --2- 192.168.123.109:0/1292404820 >> v2:192.168.123.109:6800/82853931 conn(0x7f44b40776a0 0x7f44b4079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:43.485 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.485+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f44d401d070 con 0x7f44e41058f0 2026-03-09T00:31:43.485 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.486+0000 7f44e882b640 1 --2- 192.168.123.109:0/1292404820 >> v2:192.168.123.109:6800/82853931 conn(0x7f44b40776a0 0x7f44b4079b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f44cc002410 tx=0x7f44cc03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:43.575 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.576+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 --> v2:192.168.123.109:6800/82853931 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44b0002bf0 con 0x7f44b40776a0 2026-03-09T00:31:43.581 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.582+0000 7f44d9ffb640 1 -- 192.168.123.109:0/1292404820 <== mgr.14150 v2:192.168.123.109:6800/82853931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+347445 (secure 0 0 0) 0x7f44b0002bf0 con 0x7f44b40776a0 2026-03-09T00:31:43.581 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:43.586 INFO:teuthology.orchestra.run.vm09.stderr:dumped all 2026-03-09T00:31:43.588 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.589+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 >> v2:192.168.123.109:6800/82853931 conn(0x7f44b40776a0 msgr2=0x7f44b4079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.588 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.589+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1292404820 >> v2:192.168.123.109:6800/82853931 conn(0x7f44b40776a0 0x7f44b4079b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f44cc002410 tx=0x7f44cc03a040 comp rx=0 tx=0).stop 2026-03-09T00:31:43.588 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.589+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 msgr2=0x7f44e41a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.589+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 0x7f44e41a2c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44d400cab0 tx=0x7f44d400cf80 comp rx=0 tx=0).stop 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 shutdown_connections 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1292404820 >> v2:192.168.123.109:6800/82853931 conn(0x7f44b40776a0 0x7f44b4079b60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f44e410a070 0x7f44e419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f44e41058f0 0x7f44e41a2c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 --2- 192.168.123.109:0/1292404820 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f44e4104f40 0x7f44e41a26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.589 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 >> 192.168.123.109:0/1292404820 conn(0x7f44e4100a20 msgr2=0x7f44e4101000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:43.590 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.590+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 shutdown_connections 2026-03-09T00:31:43.590 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.591+0000 7f44eaab6640 1 -- 192.168.123.109:0/1292404820 wait complete. 2026-03-09T00:31:43.654 INFO:teuthology.orchestra.run.vm09.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2026-03-09T00:31:42.780775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":465419,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":1064,"num_read_kb":775,"num_write":685,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":459280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":701,"ondisk_log_size":701,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":374,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":167739392,"kb_used":220356,"kb_used_data":5692,"kb_used_omap":12,"kb_used_meta":214515,"kb_avail":167519036,"statfs":{"total":171765137408,"available":171539492864,"internally_reserved":0,"allocated":5828608,"data_stored":3027569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12712,"internal_metadata":219663960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4518,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":1004,"num_read_kb":724,"num_write":617,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.130283"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685574+0000","last_change":"2026-03-09T00:31:30.103541+0000","last_active":"2026-03-09T00:31:37.685574+0000","last_peered":"2026-03-09T00:31:37.685574+0000","last_clean":"2026-03-09T00:31:37.685574+0000","last_became_active":"2026-03-09T00:31:30.103288+0000","last_became_peered":"2026-03-09T00:31:30.103288+0000","last_unstale":"2026-03-09T00:31:37.685574+0000","last_undegraded":"2026-03-09T00:31:37.685574+0000","last_fullsized":"2026-03-09T00:31:37.685574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:35:30.190775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"54'15","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.287191+0000","last_change":"2026-03-09T00:31:32.655627+0000","last_active":"2026-03-09T00:31:38.287191+0000","last_peered":"2026-03-09T00:31:38.287191+0000","last_clean":"2026-03-09T00:31:38.287191+0000","last_became_active":"2026-03-09T00:31:32.655058+0000","last_became_peered":"2026-03-09T00:31:32.655058+0000","last_unstale":"2026-03-09T00:31:38.287191+0000","last_undegraded":"2026-03-09T00:31:38.287191+0000","last_fullsized":"2026-03-09T00:31:38.287191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:53:42.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680606+0000","last_change":"2026-03-09T00:31:34.692952+0000","last_active":"2026-03-09T00:31:37.680606+0000","last_peered":"2026-03-09T00:31:37.680606+0000","last_clean":"2026-03-09T00:31:37.680606+0000","last_became_active":"2026-03-09T00:31:34.692810+0000","last_became_peered":"2026-03-09T00:31:34.692810+0000","last_unstale":"2026-03-09T00:31:37.680606+0000","last_undegraded":"2026-03-09T00:31:37.680606+0000","last_fullsized":"2026-03-09T00:31:37.680606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:36:11.465990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684653+0000","last_change":"2026-03-09T00:31:36.685537+0000","last_active":"2026-03-09T00:31:37.684653+0000","last_peered":"2026-03-09T00:31:37.684653+0000","last_clean":"2026-03-09T00:31:37.684653+0000","last_became_active":"2026-03-09T00:31:36.685357+0000","last_became_peered":"2026-03-09T00:31:36.685357+0000","last_unstale":"2026-03-09T00:31:37.684653+0000","last_undegraded":"2026-03-09T00:31:37.684653+0000","last_fullsized":"2026-03-09T00:31:37.684653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:02:13.433604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675272+0000","last_change":"2026-03-09T00:31:37.272711+0000","last_active":"2026-03-09T00:31:37.675272+0000","last_peered":"2026-03-09T00:31:37.675272+0000","last_clean":"2026-03-09T00:31:37.675272+0000","last_became_active":"2026-03-09T00:31:37.272276+0000","last_became_peered":"2026-03-09T00:31:37.272276+0000","last_unstale":"2026-03-09T00:31:37.675272+0000","last_undegraded":"2026-03-09T00:31:37.675272+0000","last_fullsized":"2026-03-09T00:31:37.675272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:46:57.536325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675296+0000","last_change":"2026-03-09T00:31:30.105056+0000","last_active":"2026-03-09T00:31:37.675296+0000","last_peered":"2026-03-09T00:31:37.675296+0000","last_clean":"2026-03-09T00:31:37.675296+0000","last_became_active":"2026-03-09T00:31:30.104915+0000","last_became_peered":"2026-03-09T00:31:30.104915+0000","last_unstale":"2026-03-09T00:31:37.675296+0000","last_undegraded":"2026-03-09T00:31:37.675296+0000","last_fullsized":"2026-03-09T00:31:37.675296+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:36:53.807749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"54'40","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.656772+0000","last_change":"2026-03-09T00:31:32.650328+0000","last_active":"2026-03-09T00:31:38.656772+0000","last_peered":"2026-03-09T00:31:38.656772+0000","last_clean":"2026-03-09T00:31:38.656772+0000","last_became_active":"2026-03-09T00:31:32.650204+0000","last_became_peered":"2026-03-09T00:31:32.650204+0000","last_unstale":"2026-03-09T00:31:38.656772+0000","last_undegraded":"2026-03-09T00:31:38.656772+0000","last_fullsized":"2026-03-09T00:31:38.656772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:04:42.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683731+0000","last_change":"2026-03-09T00:31:34.679976+0000","last_active":"2026-03-09T00:31:37.683731+0000","last_peered":"2026-03-09T00:31:37.683731+0000","last_clean":"2026-03-09T00:31:37.683731+0000","last_became_active":"2026-03-09T00:31:34.676207+0000","last_became_peered":"2026-03-09T00:31:34.676207+0000","last_unstale":"2026-03-09T00:31:37.683731+0000","last_undegraded":"2026-03-09T00:31:37.683731+0000","last_fullsized":"2026-03-09T00:31:37.683731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:03:48.617933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692330+0000","last_change":"2026-03-09T00:31:30.096075+0000","last_active":"2026-03-09T00:31:37.692330+0000","last_peered":"2026-03-09T00:31:37.692330+0000","last_clean":"2026-03-09T00:31:37.692330+0000","last_became_active":"2026-03-09T00:31:30.095902+0000","last_became_peered":"2026-03-09T00:31:30.095902+0000","last_unstale":"2026-03-09T00:31:37.692330+0000","last_undegraded":"2026-03-09T00:31:37.692330+0000","last_fullsized":"2026-03-09T00:31:37.692330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:34:13.985088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"54'21","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.518139+0000","last_change":"2026-03-09T00:31:32.649705+0000","last_active":"2026-03-09T00:31:38.518139+0000","last_peered":"2026-03-09T00:31:38.518139+0000","last_clean":"2026-03-09T00:31:38.518139+0000","last_became_active":"2026-03-09T00:31:32.649605+0000","last_became_peered":"2026-03-09T00:31:32.649605+0000","last_unstale":"2026-03-09T00:31:38.518139+0000","last_undegraded":"2026-03-09T00:31:38.518139+0000","last_fullsized":"2026-03-09T00:31:38.518139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:11:43.332368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692353+0000","last_change":"2026-03-09T00:31:34.692527+0000","last_active":"2026-03-09T00:31:37.692353+0000","last_peered":"2026-03-09T00:31:37.692353+0000","last_clean":"2026-03-09T00:31:37.692353+0000","last_became_active":"2026-03-09T00:31:34.692128+0000","last_became_peered":"2026-03-09T00:31:34.692128+0000","last_unstale":"2026-03-09T00:31:37.692353+0000","last_undegraded":"2026-03-09T00:31:37.692353+0000","last_fullsized":"2026-03-09T00:31:37.692353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:19:42.089978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685695+0000","last_change":"2026-03-09T00:31:36.687875+0000","last_active":"2026-03-09T00:31:37.685695+0000","last_peered":"2026-03-09T00:31:37.685695+0000","last_clean":"2026-03-09T00:31:37.685695+0000","last_became_active":"2026-03-09T00:31:36.687790+0000","last_became_peered":"2026-03-09T00:31:36.687790+0000","last_unstale":"2026-03-09T00:31:37.685695+0000","last_undegraded":"2026-03-09T00:31:37.685695+0000","last_fullsized":"2026-03-09T00:31:37.685695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:15:35.216899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692491+0000","last_change":"2026-03-09T00:31:30.097166+0000","last_active":"2026-03-09T00:31:37.692491+0000","last_peered":"2026-03-09T00:31:37.692491+0000","last_clean":"2026-03-09T00:31:37.692491+0000","last_became_active":"2026-03-09T00:31:30.096019+0000","last_became_peered":"2026-03-09T00:31:30.096019+0000","last_unstale":"2026-03-09T00:31:37.692491+0000","last_undegraded":"2026-03-09T00:31:37.692491+0000","last_fullsized":"2026-03-09T00:31:37.692491+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:08:35.182723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"54'11","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.489239+0000","last_change":"2026-03-09T00:31:32.655937+0000","last_active":"2026-03-09T00:31:38.489239+0000","last_peered":"2026-03-09T00:31:38.489239+0000","last_clean":"2026-03-09T00:31:38.489239+0000","last_became_active":"2026-03-09T00:31:32.655174+0000","last_became_peered":"2026-03-09T00:31:32.655174+0000","last_unstale":"2026-03-09T00:31:38.489239+0000","last_undegraded":"2026-03-09T00:31:38.489239+0000","last_fullsized":"2026-03-09T00:31:38.489239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:42:54.658632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665890+0000","last_change":"2026-03-09T00:31:34.673384+0000","last_active":"2026-03-09T00:31:37.665890+0000","last_peered":"2026-03-09T00:31:37.665890+0000","last_clean":"2026-03-09T00:31:37.665890+0000","last_became_active":"2026-03-09T00:31:34.673274+0000","last_became_peered":"2026-03-09T00:31:34.673274+0000","last_unstale":"2026-03-09T00:31:37.665890+0000","last_undegraded":"2026-03-09T00:31:37.665890+0000","last_fullsized":"2026-03-09T00:31:37.665890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:27:26.945131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692469+0000","last_change":"2026-03-09T00:31:36.699443+0000","last_active":"2026-03-09T00:31:37.692469+0000","last_peered":"2026-03-09T00:31:37.692469+0000","last_clean":"2026-03-09T00:31:37.692469+0000","last_became_active":"2026-03-09T00:31:36.699320+0000","last_became_peered":"2026-03-09T00:31:36.699320+0000","last_unstale":"2026-03-09T00:31:37.692469+0000","last_undegraded":"2026-03-09T00:31:37.692469+0000","last_fullsized":"2026-03-09T00:31:37.692469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:58:10.154598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684534+0000","last_change":"2026-03-09T00:31:37.270972+0000","last_active":"2026-03-09T00:31:37.684534+0000","last_peered":"2026-03-09T00:31:37.684534+0000","last_clean":"2026-03-09T00:31:37.684534+0000","last_became_active":"2026-03-09T00:31:37.270857+0000","last_became_peered":"2026-03-09T00:31:37.270857+0000","last_unstale":"2026-03-09T00:31:37.684534+0000","last_undegraded":"2026-03-09T00:31:37.684534+0000","last_fullsized":"2026-03-09T00:31:37.684534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:15:36.425906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685365+0000","last_change":"2026-03-09T00:31:30.095571+0000","last_active":"2026-03-09T00:31:37.685365+0000","last_peered":"2026-03-09T00:31:37.685365+0000","last_clean":"2026-03-09T00:31:37.685365+0000","last_became_active":"2026-03-09T00:31:30.094552+0000","last_became_peered":"2026-03-09T00:31:30.094552+0000","last_unstale":"2026-03-09T00:31:37.685365+0000","last_undegraded":"2026-03-09T00:31:37.685365+0000","last_fullsized":"2026-03-09T00:31:37.685365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:38:09.984384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"54'15","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.562109+0000","last_change":"2026-03-09T00:31:32.654669+0000","last_active":"2026-03-09T00:31:38.562109+0000","last_peered":"2026-03-09T00:31:38.562109+0000","last_clean":"2026-03-09T00:31:38.562109+0000","last_became_active":"2026-03-09T00:31:32.654584+0000","last_became_peered":"2026-03-09T00:31:32.654584+0000","last_unstale":"2026-03-09T00:31:38.562109+0000","last_undegraded":"2026-03-09T00:31:38.562109+0000","last_fullsized":"2026-03-09T00:31:38.562109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:02:41.253182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680468+0000","last_change":"2026-03-09T00:31:34.673322+0000","last_active":"2026-03-09T00:31:37.680468+0000","last_peered":"2026-03-09T00:31:37.680468+0000","last_clean":"2026-03-09T00:31:37.680468+0000","last_became_active":"2026-03-09T00:31:34.673203+0000","last_became_peered":"2026-03-09T00:31:34.673203+0000","last_unstale":"2026-03-09T00:31:37.680468+0000","last_undegraded":"2026-03-09T00:31:37.680468+0000","last_fullsized":"2026-03-09T00:31:37.680468+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:28:12.791122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675817+0000","last_change":"2026-03-09T00:31:37.272822+0000","last_active":"2026-03-09T00:31:37.675817+0000","last_peered":"2026-03-09T00:31:37.675817+0000","last_clean":"2026-03-09T00:31:37.675817+0000","last_became_active":"2026-03-09T00:31:37.272451+0000","last_became_peered":"2026-03-09T00:31:37.272451+0000","last_unstale":"2026-03-09T00:31:37.675817+0000","last_undegraded":"2026-03-09T00:31:37.675817+0000","last_fullsized":"2026-03-09T00:31:37.675817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:42:08.301629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683872+0000","last_change":"2026-03-09T00:31:30.102579+0000","last_active":"2026-03-09T00:31:37.683872+0000","last_peered":"2026-03-09T00:31:37.683872+0000","last_clean":"2026-03-09T00:31:37.683872+0000","last_became_active":"2026-03-09T00:31:30.102483+0000","last_became_peered":"2026-03-09T00:31:30.102483+0000","last_unstale":"2026-03-09T00:31:37.683872+0000","last_undegraded":"2026-03-09T00:31:37.683872+0000","last_fullsized":"2026-03-09T00:31:37.683872+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:55:12.895458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"54'20","reported_seq":58,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.659366+0000","last_change":"2026-03-09T00:31:32.658965+0000","last_active":"2026-03-09T00:31:38.659366+0000","last_peered":"2026-03-09T00:31:38.659366+0000","last_clean":"2026-03-09T00:31:38.659366+0000","last_became_active":"2026-03-09T00:31:32.658888+0000","last_became_peered":"2026-03-09T00:31:32.658888+0000","last_unstale":"2026-03-09T00:31:38.659366+0000","last_undegraded":"2026-03-09T00:31:38.659366+0000","last_fullsized":"2026-03-09T00:31:38.659366+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:51:06.103217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683808+0000","last_change":"2026-03-09T00:31:34.675027+0000","last_active":"2026-03-09T00:31:37.683808+0000","last_peered":"2026-03-09T00:31:37.683808+0000","last_clean":"2026-03-09T00:31:37.683808+0000","last_became_active":"2026-03-09T00:31:34.672944+0000","last_became_peered":"2026-03-09T00:31:34.672944+0000","last_unstale":"2026-03-09T00:31:37.683808+0000","last_undegraded":"2026-03-09T00:31:37.683808+0000","last_fullsized":"2026-03-09T00:31:37.683808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:25:43.013892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666524+0000","last_change":"2026-03-09T00:31:36.697774+0000","last_active":"2026-03-09T00:31:37.666524+0000","last_peered":"2026-03-09T00:31:37.666524+0000","last_clean":"2026-03-09T00:31:37.666524+0000","last_became_active":"2026-03-09T00:31:36.697586+0000","last_became_peered":"2026-03-09T00:31:36.697586+0000","last_unstale":"2026-03-09T00:31:37.666524+0000","last_undegraded":"2026-03-09T00:31:37.666524+0000","last_fullsized":"2026-03-09T00:31:37.666524+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:50:27.189681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"47'1","reported_seq":26,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681230+0000","last_change":"2026-03-09T00:31:30.092994+0000","last_active":"2026-03-09T00:31:37.681230+0000","last_peered":"2026-03-09T00:31:37.681230+0000","last_clean":"2026-03-09T00:31:37.681230+0000","last_became_active":"2026-03-09T00:31:30.092862+0000","last_became_peered":"2026-03-09T00:31:30.092862+0000","last_unstale":"2026-03-09T00:31:37.681230+0000","last_undegraded":"2026-03-09T00:31:37.681230+0000","last_fullsized":"2026-03-09T00:31:37.681230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:12:17.971431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"54'16","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.636296+0000","last_change":"2026-03-09T00:31:32.654772+0000","last_active":"2026-03-09T00:31:38.636296+0000","last_peered":"2026-03-09T00:31:38.636296+0000","last_clean":"2026-03-09T00:31:38.636296+0000","last_became_active":"2026-03-09T00:31:32.654678+0000","last_became_peered":"2026-03-09T00:31:32.654678+0000","last_unstale":"2026-03-09T00:31:38.636296+0000","last_undegraded":"2026-03-09T00:31:38.636296+0000","last_fullsized":"2026-03-09T00:31:38.636296+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:56:49.101742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"54'8","reported_seq":34,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.211027+0000","last_change":"2026-03-09T00:31:34.696609+0000","last_active":"2026-03-09T00:31:38.211027+0000","last_peered":"2026-03-09T00:31:38.211027+0000","last_clean":"2026-03-09T00:31:38.211027+0000","last_became_active":"2026-03-09T00:31:34.696510+0000","last_became_peered":"2026-03-09T00:31:34.696510+0000","last_unstale":"2026-03-09T00:31:38.211027+0000","last_undegraded":"2026-03-09T00:31:38.211027+0000","last_fullsized":"2026-03-09T00:31:38.211027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:38:56.660546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"54'15","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.669916+0000","last_change":"2026-03-09T00:31:32.656314+0000","last_active":"2026-03-09T00:31:38.669916+0000","last_peered":"2026-03-09T00:31:38.669916+0000","last_clean":"2026-03-09T00:31:38.669916+0000","last_became_active":"2026-03-09T00:31:32.653994+0000","last_became_peered":"2026-03-09T00:31:32.653994+0000","last_unstale":"2026-03-09T00:31:38.669916+0000","last_undegraded":"2026-03-09T00:31:38.669916+0000","last_fullsized":"2026-03-09T00:31:38.669916+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:38:46.038324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675066+0000","last_change":"2026-03-09T00:31:30.091575+0000","last_active":"2026-03-09T00:31:37.675066+0000","last_peered":"2026-03-09T00:31:37.675066+0000","last_clean":"2026-03-09T00:31:37.675066+0000","last_became_active":"2026-03-09T00:31:30.091394+0000","last_became_peered":"2026-03-09T00:31:30.091394+0000","last_unstale":"2026-03-09T00:31:37.675066+0000","last_undegraded":"2026-03-09T00:31:37.675066+0000","last_fullsized":"2026-03-09T00:31:37.675066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:38:29.796659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.226767+0000","last_change":"2026-03-09T00:31:34.704536+0000","last_active":"2026-03-09T00:31:38.226767+0000","last_peered":"2026-03-09T00:31:38.226767+0000","last_clean":"2026-03-09T00:31:38.226767+0000","last_became_active":"2026-03-09T00:31:34.704179+0000","last_became_peered":"2026-03-09T00:31:34.704179+0000","last_unstale":"2026-03-09T00:31:38.226767+0000","last_undegraded":"2026-03-09T00:31:38.226767+0000","last_fullsized":"2026-03-09T00:31:38.226767+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:25:26.284441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692164+0000","last_change":"2026-03-09T00:31:36.695405+0000","last_active":"2026-03-09T00:31:37.692164+0000","last_peered":"2026-03-09T00:31:37.692164+0000","last_clean":"2026-03-09T00:31:37.692164+0000","last_became_active":"2026-03-09T00:31:36.695315+0000","last_became_peered":"2026-03-09T00:31:36.695315+0000","last_unstale":"2026-03-09T00:31:37.692164+0000","last_undegraded":"2026-03-09T00:31:37.692164+0000","last_fullsized":"2026-03-09T00:31:37.692164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:31:08.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"54'30","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.598343+0000","last_change":"2026-03-09T00:31:32.658807+0000","last_active":"2026-03-09T00:31:38.598343+0000","last_peered":"2026-03-09T00:31:38.598343+0000","last_clean":"2026-03-09T00:31:38.598343+0000","last_became_active":"2026-03-09T00:31:32.657398+0000","last_became_peered":"2026-03-09T00:31:32.657398+0000","last_unstale":"2026-03-09T00:31:38.598343+0000","last_undegraded":"2026-03-09T00:31:38.598343+0000","last_fullsized":"2026-03-09T00:31:38.598343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:38:07.180272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"47'1","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.936483+0000","last_change":"2026-03-09T00:31:30.089505+0000","last_active":"2026-03-09T00:31:37.936483+0000","last_peered":"2026-03-09T00:31:37.936483+0000","last_clean":"2026-03-09T00:31:37.936483+0000","last_became_active":"2026-03-09T00:31:30.089306+0000","last_became_peered":"2026-03-09T00:31:30.089306+0000","last_unstale":"2026-03-09T00:31:37.936483+0000","last_undegraded":"2026-03-09T00:31:37.936483+0000","last_fullsized":"2026-03-09T00:31:37.936483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:27:02.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683671+0000","last_change":"2026-03-09T00:31:34.673878+0000","last_active":"2026-03-09T00:31:37.683671+0000","last_peered":"2026-03-09T00:31:37.683671+0000","last_clean":"2026-03-09T00:31:37.683671+0000","last_became_active":"2026-03-09T00:31:34.673788+0000","last_became_peered":"2026-03-09T00:31:34.673788+0000","last_unstale":"2026-03-09T00:31:37.683671+0000","last_undegraded":"2026-03-09T00:31:37.683671+0000","last_fullsized":"2026-03-09T00:31:37.683671+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:48:10.024561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683699+0000","last_change":"2026-03-09T00:31:36.700550+0000","last_active":"2026-03-09T00:31:37.683699+0000","last_peered":"2026-03-09T00:31:37.683699+0000","last_clean":"2026-03-09T00:31:37.683699+0000","last_became_active":"2026-03-09T00:31:36.699023+0000","last_became_peered":"2026-03-09T00:31:36.699023+0000","last_unstale":"2026-03-09T00:31:37.683699+0000","last_undegraded":"2026-03-09T00:31:37.683699+0000","last_fullsized":"2026-03-09T00:31:37.683699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:01:32.829734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"54'20","reported_seq":54,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.639278+0000","last_change":"2026-03-09T00:31:32.653185+0000","last_active":"2026-03-09T00:31:38.639278+0000","last_peered":"2026-03-09T00:31:38.639278+0000","last_clean":"2026-03-09T00:31:38.639278+0000","last_became_active":"2026-03-09T00:31:32.652927+0000","last_became_peered":"2026-03-09T00:31:32.652927+0000","last_unstale":"2026-03-09T00:31:38.639278+0000","last_undegraded":"2026-03-09T00:31:38.639278+0000","last_fullsized":"2026-03-09T00:31:38.639278+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:40:54.725158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"47'1","reported_seq":26,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685470+0000","last_change":"2026-03-09T00:31:30.095693+0000","last_active":"2026-03-09T00:31:37.685470+0000","last_peered":"2026-03-09T00:31:37.685470+0000","last_clean":"2026-03-09T00:31:37.685470+0000","last_became_active":"2026-03-09T00:31:30.094707+0000","last_became_peered":"2026-03-09T00:31:30.094707+0000","last_unstale":"2026-03-09T00:31:37.685470+0000","last_undegraded":"2026-03-09T00:31:37.685470+0000","last_fullsized":"2026-03-09T00:31:37.685470+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:22:42.071062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.216011+0000","last_change":"2026-03-09T00:31:34.674046+0000","last_active":"2026-03-09T00:31:38.216011+0000","last_peered":"2026-03-09T00:31:38.216011+0000","last_clean":"2026-03-09T00:31:38.216011+0000","last_became_active":"2026-03-09T00:31:34.673910+0000","last_became_peered":"2026-03-09T00:31:34.673910+0000","last_unstale":"2026-03-09T00:31:38.216011+0000","last_undegraded":"2026-03-09T00:31:38.216011+0000","last_fullsized":"2026-03-09T00:31:38.216011+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:48:05.455661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665670+0000","last_change":"2026-03-09T00:31:37.271866+0000","last_active":"2026-03-09T00:31:37.665670+0000","last_peered":"2026-03-09T00:31:37.665670+0000","last_clean":"2026-03-09T00:31:37.665670+0000","last_became_active":"2026-03-09T00:31:37.271504+0000","last_became_peered":"2026-03-09T00:31:37.271504+0000","last_unstale":"2026-03-09T00:31:37.665670+0000","last_undegraded":"2026-03-09T00:31:37.665670+0000","last_fullsized":"2026-03-09T00:31:37.665670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:30:02.314724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"54'16","reported_seq":48,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.621174+0000","last_change":"2026-03-09T00:31:32.663831+0000","last_active":"2026-03-09T00:31:38.621174+0000","last_peered":"2026-03-09T00:31:38.621174+0000","last_clean":"2026-03-09T00:31:38.621174+0000","last_became_active":"2026-03-09T00:31:32.661264+0000","last_became_peered":"2026-03-09T00:31:32.661264+0000","last_unstale":"2026-03-09T00:31:38.621174+0000","last_undegraded":"2026-03-09T00:31:38.621174+0000","last_fullsized":"2026-03-09T00:31:38.621174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:58:34.342778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692688+0000","last_change":"2026-03-09T00:31:30.102188+0000","last_active":"2026-03-09T00:31:37.692688+0000","last_peered":"2026-03-09T00:31:37.692688+0000","last_clean":"2026-03-09T00:31:37.692688+0000","last_became_active":"2026-03-09T00:31:30.102083+0000","last_became_peered":"2026-03-09T00:31:30.102083+0000","last_unstale":"2026-03-09T00:31:37.692688+0000","last_undegraded":"2026-03-09T00:31:37.692688+0000","last_fullsized":"2026-03-09T00:31:37.692688+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:58:31.172967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.232085+0000","last_change":"2026-03-09T00:31:34.694378+0000","last_active":"2026-03-09T00:31:38.232085+0000","last_peered":"2026-03-09T00:31:38.232085+0000","last_clean":"2026-03-09T00:31:38.232085+0000","last_became_active":"2026-03-09T00:31:34.694292+0000","last_became_peered":"2026-03-09T00:31:34.694292+0000","last_unstale":"2026-03-09T00:31:38.232085+0000","last_undegraded":"2026-03-09T00:31:38.232085+0000","last_fullsized":"2026-03-09T00:31:38.232085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:55:12.162146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.686033+0000","last_change":"2026-03-09T00:31:36.703690+0000","last_active":"2026-03-09T00:31:37.686033+0000","last_peered":"2026-03-09T00:31:37.686033+0000","last_clean":"2026-03-09T00:31:37.686033+0000","last_became_active":"2026-03-09T00:31:36.703606+0000","last_became_peered":"2026-03-09T00:31:36.703606+0000","last_unstale":"2026-03-09T00:31:37.686033+0000","last_undegraded":"2026-03-09T00:31:37.686033+0000","last_fullsized":"2026-03-09T00:31:37.686033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:58:39.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"54'25","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.613864+0000","last_change":"2026-03-09T00:31:32.660353+0000","last_active":"2026-03-09T00:31:38.613864+0000","last_peered":"2026-03-09T00:31:38.613864+0000","last_clean":"2026-03-09T00:31:38.613864+0000","last_became_active":"2026-03-09T00:31:32.659922+0000","last_became_peered":"2026-03-09T00:31:32.659922+0000","last_unstale":"2026-03-09T00:31:38.613864+0000","last_undegraded":"2026-03-09T00:31:38.613864+0000","last_fullsized":"2026-03-09T00:31:38.613864+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:34:15.263588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681294+0000","last_change":"2026-03-09T00:31:30.102267+0000","last_active":"2026-03-09T00:31:37.681294+0000","last_peered":"2026-03-09T00:31:37.681294+0000","last_clean":"2026-03-09T00:31:37.681294+0000","last_became_active":"2026-03-09T00:31:30.102173+0000","last_became_peered":"2026-03-09T00:31:30.102173+0000","last_unstale":"2026-03-09T00:31:37.681294+0000","last_undegraded":"2026-03-09T00:31:37.681294+0000","last_fullsized":"2026-03-09T00:31:37.681294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:52:58.593714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.690391+0000","last_change":"2026-03-09T00:31:34.704989+0000","last_active":"2026-03-09T00:31:37.690391+0000","last_peered":"2026-03-09T00:31:37.690391+0000","last_clean":"2026-03-09T00:31:37.690391+0000","last_became_active":"2026-03-09T00:31:34.704806+0000","last_became_peered":"2026-03-09T00:31:34.704806+0000","last_unstale":"2026-03-09T00:31:37.690391+0000","last_undegraded":"2026-03-09T00:31:37.690391+0000","last_fullsized":"2026-03-09T00:31:37.690391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:08:11.585850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681281+0000","last_change":"2026-03-09T00:31:37.270544+0000","last_active":"2026-03-09T00:31:37.681281+0000","last_peered":"2026-03-09T00:31:37.681281+0000","last_clean":"2026-03-09T00:31:37.681281+0000","last_became_active":"2026-03-09T00:31:37.270385+0000","last_became_peered":"2026-03-09T00:31:37.270385+0000","last_unstale":"2026-03-09T00:31:37.681281+0000","last_undegraded":"2026-03-09T00:31:37.681281+0000","last_fullsized":"2026-03-09T00:31:37.681281+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:48:58.558407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"54'34","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.625663+0000","last_change":"2026-03-09T00:31:32.649477+0000","last_active":"2026-03-09T00:31:38.625663+0000","last_peered":"2026-03-09T00:31:38.625663+0000","last_clean":"2026-03-09T00:31:38.625663+0000","last_became_active":"2026-03-09T00:31:32.649363+0000","last_became_peered":"2026-03-09T00:31:32.649363+0000","last_unstale":"2026-03-09T00:31:38.625663+0000","last_undegraded":"2026-03-09T00:31:38.625663+0000","last_fullsized":"2026-03-09T00:31:38.625663+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:33:11.636267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684037+0000","last_change":"2026-03-09T00:31:30.091566+0000","last_active":"2026-03-09T00:31:37.684037+0000","last_peered":"2026-03-09T00:31:37.684037+0000","last_clean":"2026-03-09T00:31:37.684037+0000","last_became_active":"2026-03-09T00:31:30.091472+0000","last_became_peered":"2026-03-09T00:31:30.091472+0000","last_unstale":"2026-03-09T00:31:37.684037+0000","last_undegraded":"2026-03-09T00:31:37.684037+0000","last_fullsized":"2026-03-09T00:31:37.684037+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:09:02.054618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"49'2","reported_seq":32,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692646+0000","last_change":"2026-03-09T00:31:32.559606+0000","last_active":"2026-03-09T00:31:37.692646+0000","last_peered":"2026-03-09T00:31:37.692646+0000","last_clean":"2026-03-09T00:31:37.692646+0000","last_became_active":"2026-03-09T00:31:30.095985+0000","last_became_peered":"2026-03-09T00:31:30.095985+0000","last_unstale":"2026-03-09T00:31:37.692646+0000","last_undegraded":"2026-03-09T00:31:37.692646+0000","last_fullsized":"2026-03-09T00:31:37.692646+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:43:26.943183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000397616,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685629+0000","last_change":"2026-03-09T00:31:34.677419+0000","last_active":"2026-03-09T00:31:37.685629+0000","last_peered":"2026-03-09T00:31:37.685629+0000","last_clean":"2026-03-09T00:31:37.685629+0000","last_became_active":"2026-03-09T00:31:34.677341+0000","last_became_peered":"2026-03-09T00:31:34.677341+0000","last_unstale":"2026-03-09T00:31:37.685629+0000","last_undegraded":"2026-03-09T00:31:37.685629+0000","last_fullsized":"2026-03-09T00:31:37.685629+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:50:55.811425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674970+0000","last_change":"2026-03-09T00:31:36.680637+0000","last_active":"2026-03-09T00:31:37.674970+0000","last_peered":"2026-03-09T00:31:37.674970+0000","last_clean":"2026-03-09T00:31:37.674970+0000","last_became_active":"2026-03-09T00:31:36.680523+0000","last_became_peered":"2026-03-09T00:31:36.680523+0000","last_unstale":"2026-03-09T00:31:37.674970+0000","last_undegraded":"2026-03-09T00:31:37.674970+0000","last_fullsized":"2026-03-09T00:31:37.674970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:52:48.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"54'19","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.545041+0000","last_change":"2026-03-09T00:31:32.664907+0000","last_active":"2026-03-09T00:31:38.545041+0000","last_peered":"2026-03-09T00:31:38.545041+0000","last_clean":"2026-03-09T00:31:38.545041+0000","last_became_active":"2026-03-09T00:31:32.664411+0000","last_became_peered":"2026-03-09T00:31:32.664411+0000","last_unstale":"2026-03-09T00:31:38.545041+0000","last_undegraded":"2026-03-09T00:31:38.545041+0000","last_fullsized":"2026-03-09T00:31:38.545041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:17:06.736528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681318+0000","last_change":"2026-03-09T00:31:30.101738+0000","last_active":"2026-03-09T00:31:37.681318+0000","last_peered":"2026-03-09T00:31:37.681318+0000","last_clean":"2026-03-09T00:31:37.681318+0000","last_became_active":"2026-03-09T00:31:30.101651+0000","last_became_peered":"2026-03-09T00:31:30.101651+0000","last_unstale":"2026-03-09T00:31:37.681318+0000","last_undegraded":"2026-03-09T00:31:37.681318+0000","last_fullsized":"2026-03-09T00:31:37.681318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:26:47.208615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"47'1","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666459+0000","last_change":"2026-03-09T00:31:32.598176+0000","last_active":"2026-03-09T00:31:37.666459+0000","last_peered":"2026-03-09T00:31:37.666459+0000","last_clean":"2026-03-09T00:31:37.666459+0000","last_became_active":"2026-03-09T00:31:30.110427+0000","last_became_peered":"2026-03-09T00:31:30.110427+0000","last_unstale":"2026-03-09T00:31:37.666459+0000","last_undegraded":"2026-03-09T00:31:37.666459+0000","last_fullsized":"2026-03-09T00:31:37.666459+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:30:10.860551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242785,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666488+0000","last_change":"2026-03-09T00:31:34.702728+0000","last_active":"2026-03-09T00:31:37.666488+0000","last_peered":"2026-03-09T00:31:37.666488+0000","last_clean":"2026-03-09T00:31:37.666488+0000","last_became_active":"2026-03-09T00:31:34.702600+0000","last_became_peered":"2026-03-09T00:31:34.702600+0000","last_unstale":"2026-03-09T00:31:37.666488+0000","last_undegraded":"2026-03-09T00:31:37.666488+0000","last_fullsized":"2026-03-09T00:31:37.666488+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:56:00.997142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665846+0000","last_change":"2026-03-09T00:31:37.271934+0000","last_active":"2026-03-09T00:31:37.665846+0000","last_peered":"2026-03-09T00:31:37.665846+0000","last_clean":"2026-03-09T00:31:37.665846+0000","last_became_active":"2026-03-09T00:31:37.271641+0000","last_became_peered":"2026-03-09T00:31:37.271641+0000","last_unstale":"2026-03-09T00:31:37.665846+0000","last_undegraded":"2026-03-09T00:31:37.665846+0000","last_fullsized":"2026-03-09T00:31:37.665846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:24:46.341220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"54'12","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.559545+0000","last_change":"2026-03-09T00:31:32.655392+0000","last_active":"2026-03-09T00:31:38.559545+0000","last_peered":"2026-03-09T00:31:38.559545+0000","last_clean":"2026-03-09T00:31:38.559545+0000","last_became_active":"2026-03-09T00:31:32.655303+0000","last_became_peered":"2026-03-09T00:31:32.655303+0000","last_unstale":"2026-03-09T00:31:38.559545+0000","last_undegraded":"2026-03-09T00:31:38.559545+0000","last_fullsized":"2026-03-09T00:31:38.559545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:44:26.602847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685511+0000","last_change":"2026-03-09T00:31:30.096616+0000","last_active":"2026-03-09T00:31:37.685511+0000","last_peered":"2026-03-09T00:31:37.685511+0000","last_clean":"2026-03-09T00:31:37.685511+0000","last_became_active":"2026-03-09T00:31:30.095782+0000","last_became_peered":"2026-03-09T00:31:30.095782+0000","last_unstale":"2026-03-09T00:31:37.685511+0000","last_undegraded":"2026-03-09T00:31:37.685511+0000","last_fullsized":"2026-03-09T00:31:37.685511+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:42:58.383340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"54'5","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:40.533623+0000","last_change":"2026-03-09T00:31:32.643914+0000","last_active":"2026-03-09T00:31:40.533623+0000","last_peered":"2026-03-09T00:31:40.533623+0000","last_clean":"2026-03-09T00:31:40.533623+0000","last_became_active":"2026-03-09T00:31:30.100680+0000","last_became_peered":"2026-03-09T00:31:30.100680+0000","last_unstale":"2026-03-09T00:31:40.533623+0000","last_undegraded":"2026-03-09T00:31:40.533623+0000","last_fullsized":"2026-03-09T00:31:40.533623+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:57:48.150627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031795499999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692532+0000","last_change":"2026-03-09T00:31:34.692577+0000","last_active":"2026-03-09T00:31:37.692532+0000","last_peered":"2026-03-09T00:31:37.692532+0000","last_clean":"2026-03-09T00:31:37.692532+0000","last_became_active":"2026-03-09T00:31:34.692220+0000","last_became_peered":"2026-03-09T00:31:34.692220+0000","last_unstale":"2026-03-09T00:31:37.692532+0000","last_undegraded":"2026-03-09T00:31:37.692532+0000","last_fullsized":"2026-03-09T00:31:37.692532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:50:44.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680889+0000","last_change":"2026-03-09T00:31:36.704598+0000","last_active":"2026-03-09T00:31:37.680889+0000","last_peered":"2026-03-09T00:31:37.680889+0000","last_clean":"2026-03-09T00:31:37.680889+0000","last_became_active":"2026-03-09T00:31:36.704397+0000","last_became_peered":"2026-03-09T00:31:36.704397+0000","last_unstale":"2026-03-09T00:31:37.680889+0000","last_undegraded":"2026-03-09T00:31:37.680889+0000","last_fullsized":"2026-03-09T00:31:37.680889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:26:49.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"54'16","reported_seq":46,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.629189+0000","last_change":"2026-03-09T00:31:32.653994+0000","last_active":"2026-03-09T00:31:38.629189+0000","last_peered":"2026-03-09T00:31:38.629189+0000","last_clean":"2026-03-09T00:31:38.629189+0000","last_became_active":"2026-03-09T00:31:32.653893+0000","last_became_peered":"2026-03-09T00:31:32.653893+0000","last_unstale":"2026-03-09T00:31:38.629189+0000","last_undegraded":"2026-03-09T00:31:38.629189+0000","last_fullsized":"2026-03-09T00:31:38.629189+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:54:31.143371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675149+0000","last_change":"2026-03-09T00:31:30.096255+0000","last_active":"2026-03-09T00:31:37.675149+0000","last_peered":"2026-03-09T00:31:37.675149+0000","last_clean":"2026-03-09T00:31:37.675149+0000","last_became_active":"2026-03-09T00:31:30.096148+0000","last_became_peered":"2026-03-09T00:31:30.096148+0000","last_unstale":"2026-03-09T00:31:37.675149+0000","last_undegraded":"2026-03-09T00:31:37.675149+0000","last_fullsized":"2026-03-09T00:31:37.675149+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:36:35.701361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'32","reported_seq":35,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666257+0000","last_change":"2026-03-09T00:31:28.376350+0000","last_active":"2026-03-09T00:31:37.666257+0000","last_peered":"2026-03-09T00:31:37.666257+0000","last_clean":"2026-03-09T00:31:37.666257+0000","last_became_active":"2026-03-09T00:31:28.069968+0000","last_became_peered":"2026-03-09T00:31:28.069968+0000","last_unstale":"2026-03-09T00:31:37.666257+0000","last_undegraded":"2026-03-09T00:31:37.666257+0000","last_fullsized":"2026-03-09T00:31:37.666257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:30:36.901966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:30:36.901966+0000","last_clean_scrub_stamp":"2026-03-09T00:30:36.901966+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:12:18.916128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":459280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666232+0000","last_change":"2026-03-09T00:31:34.703381+0000","last_active":"2026-03-09T00:31:37.666232+0000","last_peered":"2026-03-09T00:31:37.666232+0000","last_clean":"2026-03-09T00:31:37.666232+0000","last_became_active":"2026-03-09T00:31:34.703272+0000","last_became_peered":"2026-03-09T00:31:34.703272+0000","last_unstale":"2026-03-09T00:31:37.666232+0000","last_undegraded":"2026-03-09T00:31:37.666232+0000","last_fullsized":"2026-03-09T00:31:37.666232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:55:53.094112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692282+0000","last_change":"2026-03-09T00:31:36.699390+0000","last_active":"2026-03-09T00:31:37.692282+0000","last_peered":"2026-03-09T00:31:37.692282+0000","last_clean":"2026-03-09T00:31:37.692282+0000","last_became_active":"2026-03-09T00:31:36.699215+0000","last_became_peered":"2026-03-09T00:31:36.699215+0000","last_unstale":"2026-03-09T00:31:37.692282+0000","last_undegraded":"2026-03-09T00:31:37.692282+0000","last_fullsized":"2026-03-09T00:31:37.692282+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:20:25.476330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"54'17","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.633215+0000","last_change":"2026-03-09T00:31:32.656041+0000","last_active":"2026-03-09T00:31:38.633215+0000","last_peered":"2026-03-09T00:31:38.633215+0000","last_clean":"2026-03-09T00:31:38.633215+0000","last_became_active":"2026-03-09T00:31:32.655707+0000","last_became_peered":"2026-03-09T00:31:32.655707+0000","last_unstale":"2026-03-09T00:31:38.633215+0000","last_undegraded":"2026-03-09T00:31:38.633215+0000","last_fullsized":"2026-03-09T00:31:38.633215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:14:32.331423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683956+0000","last_change":"2026-03-09T00:31:30.102766+0000","last_active":"2026-03-09T00:31:37.683956+0000","last_peered":"2026-03-09T00:31:37.683956+0000","last_clean":"2026-03-09T00:31:37.683956+0000","last_became_active":"2026-03-09T00:31:30.102680+0000","last_became_peered":"2026-03-09T00:31:30.102680+0000","last_unstale":"2026-03-09T00:31:37.683956+0000","last_undegraded":"2026-03-09T00:31:37.683956+0000","last_fullsized":"2026-03-09T00:31:37.683956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:18:08.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692907+0000","last_change":"2026-03-09T00:31:34.692392+0000","last_active":"2026-03-09T00:31:37.692907+0000","last_peered":"2026-03-09T00:31:37.692907+0000","last_clean":"2026-03-09T00:31:37.692907+0000","last_became_active":"2026-03-09T00:31:34.691917+0000","last_became_peered":"2026-03-09T00:31:34.691917+0000","last_unstale":"2026-03-09T00:31:37.692907+0000","last_undegraded":"2026-03-09T00:31:37.692907+0000","last_fullsized":"2026-03-09T00:31:37.692907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:15:06.133354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674693+0000","last_change":"2026-03-09T00:31:37.272588+0000","last_active":"2026-03-09T00:31:37.674693+0000","last_peered":"2026-03-09T00:31:37.674693+0000","last_clean":"2026-03-09T00:31:37.674693+0000","last_became_active":"2026-03-09T00:31:37.272082+0000","last_became_peered":"2026-03-09T00:31:37.272082+0000","last_unstale":"2026-03-09T00:31:37.674693+0000","last_undegraded":"2026-03-09T00:31:37.674693+0000","last_fullsized":"2026-03-09T00:31:37.674693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:55:00.571126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"54'17","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.630597+0000","last_change":"2026-03-09T00:31:32.655895+0000","last_active":"2026-03-09T00:31:38.630597+0000","last_peered":"2026-03-09T00:31:38.630597+0000","last_clean":"2026-03-09T00:31:38.630597+0000","last_became_active":"2026-03-09T00:31:32.655274+0000","last_became_peered":"2026-03-09T00:31:32.655274+0000","last_unstale":"2026-03-09T00:31:38.630597+0000","last_undegraded":"2026-03-09T00:31:38.630597+0000","last_fullsized":"2026-03-09T00:31:38.630597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:21:39.026437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.690012+0000","last_change":"2026-03-09T00:31:30.092192+0000","last_active":"2026-03-09T00:31:37.690012+0000","last_peered":"2026-03-09T00:31:37.690012+0000","last_clean":"2026-03-09T00:31:37.690012+0000","last_became_active":"2026-03-09T00:31:30.092104+0000","last_became_peered":"2026-03-09T00:31:30.092104+0000","last_unstale":"2026-03-09T00:31:37.690012+0000","last_undegraded":"2026-03-09T00:31:37.690012+0000","last_fullsized":"2026-03-09T00:31:37.690012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:45:30.815526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681018+0000","last_change":"2026-03-09T00:31:34.676824+0000","last_active":"2026-03-09T00:31:37.681018+0000","last_peered":"2026-03-09T00:31:37.681018+0000","last_clean":"2026-03-09T00:31:37.681018+0000","last_became_active":"2026-03-09T00:31:34.675954+0000","last_became_peered":"2026-03-09T00:31:34.675954+0000","last_unstale":"2026-03-09T00:31:37.681018+0000","last_undegraded":"2026-03-09T00:31:37.681018+0000","last_fullsized":"2026-03-09T00:31:37.681018+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:37:34.488636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666171+0000","last_change":"2026-03-09T00:31:36.702413+0000","last_active":"2026-03-09T00:31:37.666171+0000","last_peered":"2026-03-09T00:31:37.666171+0000","last_clean":"2026-03-09T00:31:37.666171+0000","last_became_active":"2026-03-09T00:31:36.702335+0000","last_became_peered":"2026-03-09T00:31:36.702335+0000","last_unstale":"2026-03-09T00:31:37.666171+0000","last_undegraded":"2026-03-09T00:31:37.666171+0000","last_fullsized":"2026-03-09T00:31:37.666171+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:01:01.346533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"54'10","reported_seq":36,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.575053+0000","last_change":"2026-03-09T00:31:32.653155+0000","last_active":"2026-03-09T00:31:38.575053+0000","last_peered":"2026-03-09T00:31:38.575053+0000","last_clean":"2026-03-09T00:31:38.575053+0000","last_became_active":"2026-03-09T00:31:32.652746+0000","last_became_peered":"2026-03-09T00:31:32.652746+0000","last_unstale":"2026-03-09T00:31:38.575053+0000","last_undegraded":"2026-03-09T00:31:38.575053+0000","last_fullsized":"2026-03-09T00:31:38.575053+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:28:55.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675025+0000","last_change":"2026-03-09T00:31:30.089571+0000","last_active":"2026-03-09T00:31:37.675025+0000","last_peered":"2026-03-09T00:31:37.675025+0000","last_clean":"2026-03-09T00:31:37.675025+0000","last_became_active":"2026-03-09T00:31:30.089406+0000","last_became_peered":"2026-03-09T00:31:30.089406+0000","last_unstale":"2026-03-09T00:31:37.675025+0000","last_undegraded":"2026-03-09T00:31:37.675025+0000","last_fullsized":"2026-03-09T00:31:37.675025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:32:21.358730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.227813+0000","last_change":"2026-03-09T00:31:34.702688+0000","last_active":"2026-03-09T00:31:38.227813+0000","last_peered":"2026-03-09T00:31:38.227813+0000","last_clean":"2026-03-09T00:31:38.227813+0000","last_became_active":"2026-03-09T00:31:34.702579+0000","last_became_peered":"2026-03-09T00:31:34.702579+0000","last_unstale":"2026-03-09T00:31:38.227813+0000","last_undegraded":"2026-03-09T00:31:38.227813+0000","last_fullsized":"2026-03-09T00:31:38.227813+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:42:15.165077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.684084+0000","last_change":"2026-03-09T00:31:36.686524+0000","last_active":"2026-03-09T00:31:37.684084+0000","last_peered":"2026-03-09T00:31:37.684084+0000","last_clean":"2026-03-09T00:31:37.684084+0000","last_became_active":"2026-03-09T00:31:36.686288+0000","last_became_peered":"2026-03-09T00:31:36.686288+0000","last_unstale":"2026-03-09T00:31:37.684084+0000","last_undegraded":"2026-03-09T00:31:37.684084+0000","last_fullsized":"2026-03-09T00:31:37.684084+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:47:25.214236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"54'16","reported_seq":50,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.605954+0000","last_change":"2026-03-09T00:31:32.655051+0000","last_active":"2026-03-09T00:31:38.605954+0000","last_peered":"2026-03-09T00:31:38.605954+0000","last_clean":"2026-03-09T00:31:38.605954+0000","last_became_active":"2026-03-09T00:31:32.654974+0000","last_became_peered":"2026-03-09T00:31:32.654974+0000","last_unstale":"2026-03-09T00:31:38.605954+0000","last_undegraded":"2026-03-09T00:31:38.605954+0000","last_fullsized":"2026-03-09T00:31:38.605954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:58:46.876633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"47'1","reported_seq":31,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.927187+0000","last_change":"2026-03-09T00:31:30.096254+0000","last_active":"2026-03-09T00:31:37.927187+0000","last_peered":"2026-03-09T00:31:37.927187+0000","last_clean":"2026-03-09T00:31:37.927187+0000","last_became_active":"2026-03-09T00:31:30.095881+0000","last_became_peered":"2026-03-09T00:31:30.095881+0000","last_unstale":"2026-03-09T00:31:37.927187+0000","last_undegraded":"2026-03-09T00:31:37.927187+0000","last_fullsized":"2026-03-09T00:31:37.927187+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:45:11.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666608+0000","last_change":"2026-03-09T00:31:34.675371+0000","last_active":"2026-03-09T00:31:37.666608+0000","last_peered":"2026-03-09T00:31:37.666608+0000","last_clean":"2026-03-09T00:31:37.666608+0000","last_became_active":"2026-03-09T00:31:34.675250+0000","last_became_peered":"2026-03-09T00:31:34.675250+0000","last_unstale":"2026-03-09T00:31:37.666608+0000","last_undegraded":"2026-03-09T00:31:37.666608+0000","last_fullsized":"2026-03-09T00:31:37.666608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:29:52.362885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685927+0000","last_change":"2026-03-09T00:31:36.703622+0000","last_active":"2026-03-09T00:31:37.685927+0000","last_peered":"2026-03-09T00:31:37.685927+0000","last_clean":"2026-03-09T00:31:37.685927+0000","last_became_active":"2026-03-09T00:31:36.703460+0000","last_became_peered":"2026-03-09T00:31:36.703460+0000","last_unstale":"2026-03-09T00:31:37.685927+0000","last_undegraded":"2026-03-09T00:31:37.685927+0000","last_fullsized":"2026-03-09T00:31:37.685927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:43:15.125772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'25","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.665733+0000","last_change":"2026-03-09T00:31:32.655093+0000","last_active":"2026-03-09T00:31:38.665733+0000","last_peered":"2026-03-09T00:31:38.665733+0000","last_clean":"2026-03-09T00:31:38.665733+0000","last_became_active":"2026-03-09T00:31:32.655020+0000","last_became_peered":"2026-03-09T00:31:32.655020+0000","last_unstale":"2026-03-09T00:31:38.665733+0000","last_undegraded":"2026-03-09T00:31:38.665733+0000","last_fullsized":"2026-03-09T00:31:38.665733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:24:55.038174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666204+0000","last_change":"2026-03-09T00:31:30.101289+0000","last_active":"2026-03-09T00:31:37.666204+0000","last_peered":"2026-03-09T00:31:37.666204+0000","last_clean":"2026-03-09T00:31:37.666204+0000","last_became_active":"2026-03-09T00:31:30.101171+0000","last_became_peered":"2026-03-09T00:31:30.101171+0000","last_unstale":"2026-03-09T00:31:37.666204+0000","last_undegraded":"2026-03-09T00:31:37.666204+0000","last_fullsized":"2026-03-09T00:31:37.666204+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:36:25.626216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666650+0000","last_change":"2026-03-09T00:31:34.702807+0000","last_active":"2026-03-09T00:31:37.666650+0000","last_peered":"2026-03-09T00:31:37.666650+0000","last_clean":"2026-03-09T00:31:37.666650+0000","last_became_active":"2026-03-09T00:31:34.702700+0000","last_became_peered":"2026-03-09T00:31:34.702700+0000","last_unstale":"2026-03-09T00:31:37.666650+0000","last_undegraded":"2026-03-09T00:31:37.666650+0000","last_fullsized":"2026-03-09T00:31:37.666650+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:36:39.878159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666179+0000","last_change":"2026-03-09T00:31:36.699483+0000","last_active":"2026-03-09T00:31:37.666179+0000","last_peered":"2026-03-09T00:31:37.666179+0000","last_clean":"2026-03-09T00:31:37.666179+0000","last_became_active":"2026-03-09T00:31:36.699397+0000","last_became_peered":"2026-03-09T00:31:36.699397+0000","last_unstale":"2026-03-09T00:31:37.666179+0000","last_undegraded":"2026-03-09T00:31:37.666179+0000","last_fullsized":"2026-03-09T00:31:37.666179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:48:38.167926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"54'24","reported_seq":68,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.379368+0000","last_change":"2026-03-09T00:31:32.656075+0000","last_active":"2026-03-09T00:31:38.379368+0000","last_peered":"2026-03-09T00:31:38.379368+0000","last_clean":"2026-03-09T00:31:38.379368+0000","last_became_active":"2026-03-09T00:31:32.655388+0000","last_became_peered":"2026-03-09T00:31:32.655388+0000","last_unstale":"2026-03-09T00:31:38.379368+0000","last_undegraded":"2026-03-09T00:31:38.379368+0000","last_fullsized":"2026-03-09T00:31:38.379368+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:11:43.651895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666104+0000","last_change":"2026-03-09T00:31:30.093517+0000","last_active":"2026-03-09T00:31:37.666104+0000","last_peered":"2026-03-09T00:31:37.666104+0000","last_clean":"2026-03-09T00:31:37.666104+0000","last_became_active":"2026-03-09T00:31:30.093403+0000","last_became_peered":"2026-03-09T00:31:30.093403+0000","last_unstale":"2026-03-09T00:31:37.666104+0000","last_undegraded":"2026-03-09T00:31:37.666104+0000","last_fullsized":"2026-03-09T00:31:37.666104+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:28:17.437645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666564+0000","last_change":"2026-03-09T00:31:34.661935+0000","last_active":"2026-03-09T00:31:37.666564+0000","last_peered":"2026-03-09T00:31:37.666564+0000","last_clean":"2026-03-09T00:31:37.666564+0000","last_became_active":"2026-03-09T00:31:34.661860+0000","last_became_peered":"2026-03-09T00:31:34.661860+0000","last_unstale":"2026-03-09T00:31:37.666564+0000","last_undegraded":"2026-03-09T00:31:37.666564+0000","last_fullsized":"2026-03-09T00:31:37.666564+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:29:55.624632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674872+0000","last_change":"2026-03-09T00:31:36.674567+0000","last_active":"2026-03-09T00:31:37.674872+0000","last_peered":"2026-03-09T00:31:37.674872+0000","last_clean":"2026-03-09T00:31:37.674872+0000","last_became_active":"2026-03-09T00:31:36.672827+0000","last_became_peered":"2026-03-09T00:31:36.672827+0000","last_unstale":"2026-03-09T00:31:37.674872+0000","last_undegraded":"2026-03-09T00:31:37.674872+0000","last_fullsized":"2026-03-09T00:31:37.674872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:27:13.777293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"54'27","reported_seq":70,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.572022+0000","last_change":"2026-03-09T00:31:32.652325+0000","last_active":"2026-03-09T00:31:38.572022+0000","last_peered":"2026-03-09T00:31:38.572022+0000","last_clean":"2026-03-09T00:31:38.572022+0000","last_became_active":"2026-03-09T00:31:32.652118+0000","last_became_peered":"2026-03-09T00:31:32.652118+0000","last_unstale":"2026-03-09T00:31:38.572022+0000","last_undegraded":"2026-03-09T00:31:38.572022+0000","last_fullsized":"2026-03-09T00:31:38.572022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:53:58.503276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"47'2","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.029141+0000","last_change":"2026-03-09T00:31:30.093814+0000","last_active":"2026-03-09T00:31:38.029141+0000","last_peered":"2026-03-09T00:31:38.029141+0000","last_clean":"2026-03-09T00:31:38.029141+0000","last_became_active":"2026-03-09T00:31:30.093711+0000","last_became_peered":"2026-03-09T00:31:30.093711+0000","last_unstale":"2026-03-09T00:31:38.029141+0000","last_undegraded":"2026-03-09T00:31:38.029141+0000","last_fullsized":"2026-03-09T00:31:38.029141+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:29:28.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.239322+0000","last_change":"2026-03-09T00:31:34.677197+0000","last_active":"2026-03-09T00:31:38.239322+0000","last_peered":"2026-03-09T00:31:38.239322+0000","last_clean":"2026-03-09T00:31:38.239322+0000","last_became_active":"2026-03-09T00:31:34.677104+0000","last_became_peered":"2026-03-09T00:31:34.677104+0000","last_unstale":"2026-03-09T00:31:38.239322+0000","last_undegraded":"2026-03-09T00:31:38.239322+0000","last_fullsized":"2026-03-09T00:31:38.239322+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:13:06.866814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692223+0000","last_change":"2026-03-09T00:31:37.272530+0000","last_active":"2026-03-09T00:31:37.692223+0000","last_peered":"2026-03-09T00:31:37.692223+0000","last_clean":"2026-03-09T00:31:37.692223+0000","last_became_active":"2026-03-09T00:31:37.272378+0000","last_became_peered":"2026-03-09T00:31:37.272378+0000","last_unstale":"2026-03-09T00:31:37.692223+0000","last_undegraded":"2026-03-09T00:31:37.692223+0000","last_fullsized":"2026-03-09T00:31:37.692223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:55:18.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.689978+0000","last_change":"2026-03-09T00:31:30.095475+0000","last_active":"2026-03-09T00:31:37.689978+0000","last_peered":"2026-03-09T00:31:37.689978+0000","last_clean":"2026-03-09T00:31:37.689978+0000","last_became_active":"2026-03-09T00:31:30.095371+0000","last_became_peered":"2026-03-09T00:31:30.095371+0000","last_unstale":"2026-03-09T00:31:37.689978+0000","last_undegraded":"2026-03-09T00:31:37.689978+0000","last_fullsized":"2026-03-09T00:31:37.689978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:38:32.157827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"54'12","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.593744+0000","last_change":"2026-03-09T00:31:32.662211+0000","last_active":"2026-03-09T00:31:38.593744+0000","last_peered":"2026-03-09T00:31:38.593744+0000","last_clean":"2026-03-09T00:31:38.593744+0000","last_became_active":"2026-03-09T00:31:32.658542+0000","last_became_peered":"2026-03-09T00:31:32.658542+0000","last_unstale":"2026-03-09T00:31:38.593744+0000","last_undegraded":"2026-03-09T00:31:38.593744+0000","last_fullsized":"2026-03-09T00:31:38.593744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:41:38.446874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692738+0000","last_change":"2026-03-09T00:31:34.692473+0000","last_active":"2026-03-09T00:31:37.692738+0000","last_peered":"2026-03-09T00:31:37.692738+0000","last_clean":"2026-03-09T00:31:37.692738+0000","last_became_active":"2026-03-09T00:31:34.692030+0000","last_became_peered":"2026-03-09T00:31:34.692030+0000","last_unstale":"2026-03-09T00:31:37.692738+0000","last_undegraded":"2026-03-09T00:31:37.692738+0000","last_fullsized":"2026-03-09T00:31:37.692738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:12:45.750834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666585+0000","last_change":"2026-03-09T00:31:37.271999+0000","last_active":"2026-03-09T00:31:37.666585+0000","last_peered":"2026-03-09T00:31:37.666585+0000","last_clean":"2026-03-09T00:31:37.666585+0000","last_became_active":"2026-03-09T00:31:37.271778+0000","last_became_peered":"2026-03-09T00:31:37.271778+0000","last_unstale":"2026-03-09T00:31:37.666585+0000","last_undegraded":"2026-03-09T00:31:37.666585+0000","last_fullsized":"2026-03-09T00:31:37.666585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:56:31.980476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"54'21","reported_seq":61,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.410678+0000","last_change":"2026-03-09T00:31:32.654408+0000","last_active":"2026-03-09T00:31:38.410678+0000","last_peered":"2026-03-09T00:31:38.410678+0000","last_clean":"2026-03-09T00:31:38.410678+0000","last_became_active":"2026-03-09T00:31:32.654318+0000","last_became_peered":"2026-03-09T00:31:32.654318+0000","last_unstale":"2026-03-09T00:31:38.410678+0000","last_undegraded":"2026-03-09T00:31:38.410678+0000","last_fullsized":"2026-03-09T00:31:38.410678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:05:50.459986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666031+0000","last_change":"2026-03-09T00:31:30.100912+0000","last_active":"2026-03-09T00:31:37.666031+0000","last_peered":"2026-03-09T00:31:37.666031+0000","last_clean":"2026-03-09T00:31:37.666031+0000","last_became_active":"2026-03-09T00:31:30.100573+0000","last_became_peered":"2026-03-09T00:31:30.100573+0000","last_unstale":"2026-03-09T00:31:37.666031+0000","last_undegraded":"2026-03-09T00:31:37.666031+0000","last_fullsized":"2026-03-09T00:31:37.666031+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T12:28:01.197676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674818+0000","last_change":"2026-03-09T00:31:34.663727+0000","last_active":"2026-03-09T00:31:37.674818+0000","last_peered":"2026-03-09T00:31:37.674818+0000","last_clean":"2026-03-09T00:31:37.674818+0000","last_became_active":"2026-03-09T00:31:34.663593+0000","last_became_peered":"2026-03-09T00:31:34.663593+0000","last_unstale":"2026-03-09T00:31:37.674818+0000","last_undegraded":"2026-03-09T00:31:37.674818+0000","last_fullsized":"2026-03-09T00:31:37.674818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:42:03.397621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666780+0000","last_change":"2026-03-09T00:31:36.687007+0000","last_active":"2026-03-09T00:31:37.666780+0000","last_peered":"2026-03-09T00:31:37.666780+0000","last_clean":"2026-03-09T00:31:37.666780+0000","last_became_active":"2026-03-09T00:31:36.686924+0000","last_became_peered":"2026-03-09T00:31:36.686924+0000","last_unstale":"2026-03-09T00:31:37.666780+0000","last_undegraded":"2026-03-09T00:31:37.666780+0000","last_fullsized":"2026-03-09T00:31:37.666780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:59:29.483250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"54'15","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.618784+0000","last_change":"2026-03-09T00:31:32.652400+0000","last_active":"2026-03-09T00:31:38.618784+0000","last_peered":"2026-03-09T00:31:38.618784+0000","last_clean":"2026-03-09T00:31:38.618784+0000","last_became_active":"2026-03-09T00:31:32.652240+0000","last_became_peered":"2026-03-09T00:31:32.652240+0000","last_unstale":"2026-03-09T00:31:38.618784+0000","last_undegraded":"2026-03-09T00:31:38.618784+0000","last_fullsized":"2026-03-09T00:31:38.618784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:57:07.741328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685446+0000","last_change":"2026-03-09T00:31:30.109146+0000","last_active":"2026-03-09T00:31:37.685446+0000","last_peered":"2026-03-09T00:31:37.685446+0000","last_clean":"2026-03-09T00:31:37.685446+0000","last_became_active":"2026-03-09T00:31:30.107942+0000","last_became_peered":"2026-03-09T00:31:30.107942+0000","last_unstale":"2026-03-09T00:31:37.685446+0000","last_undegraded":"2026-03-09T00:31:37.685446+0000","last_fullsized":"2026-03-09T00:31:37.685446+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:52:48.790873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.237489+0000","last_change":"2026-03-09T00:31:34.653388+0000","last_active":"2026-03-09T00:31:38.237489+0000","last_peered":"2026-03-09T00:31:38.237489+0000","last_clean":"2026-03-09T00:31:38.237489+0000","last_became_active":"2026-03-09T00:31:34.653303+0000","last_became_peered":"2026-03-09T00:31:34.653303+0000","last_unstale":"2026-03-09T00:31:38.237489+0000","last_undegraded":"2026-03-09T00:31:38.237489+0000","last_fullsized":"2026-03-09T00:31:38.237489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T09:20:59.897338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683657+0000","last_change":"2026-03-09T00:31:36.686582+0000","last_active":"2026-03-09T00:31:37.683657+0000","last_peered":"2026-03-09T00:31:37.683657+0000","last_clean":"2026-03-09T00:31:37.683657+0000","last_became_active":"2026-03-09T00:31:36.686412+0000","last_became_peered":"2026-03-09T00:31:36.686412+0000","last_unstale":"2026-03-09T00:31:37.683657+0000","last_undegraded":"2026-03-09T00:31:37.683657+0000","last_fullsized":"2026-03-09T00:31:37.683657+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T02:09:02.245841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"54'22","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.616039+0000","last_change":"2026-03-09T00:31:32.658700+0000","last_active":"2026-03-09T00:31:38.616039+0000","last_peered":"2026-03-09T00:31:38.616039+0000","last_clean":"2026-03-09T00:31:38.616039+0000","last_became_active":"2026-03-09T00:31:32.658368+0000","last_became_peered":"2026-03-09T00:31:32.658368+0000","last_unstale":"2026-03-09T00:31:38.616039+0000","last_undegraded":"2026-03-09T00:31:38.616039+0000","last_fullsized":"2026-03-09T00:31:38.616039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:19:54.853391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666639+0000","last_change":"2026-03-09T00:31:30.108316+0000","last_active":"2026-03-09T00:31:37.666639+0000","last_peered":"2026-03-09T00:31:37.666639+0000","last_clean":"2026-03-09T00:31:37.666639+0000","last_became_active":"2026-03-09T00:31:30.107779+0000","last_became_peered":"2026-03-09T00:31:30.107779+0000","last_unstale":"2026-03-09T00:31:37.666639+0000","last_undegraded":"2026-03-09T00:31:37.666639+0000","last_fullsized":"2026-03-09T00:31:37.666639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:41:26.844971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"54'8","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.219621+0000","last_change":"2026-03-09T00:31:34.692658+0000","last_active":"2026-03-09T00:31:38.219621+0000","last_peered":"2026-03-09T00:31:38.219621+0000","last_clean":"2026-03-09T00:31:38.219621+0000","last_became_active":"2026-03-09T00:31:34.691790+0000","last_became_peered":"2026-03-09T00:31:34.691790+0000","last_unstale":"2026-03-09T00:31:38.219621+0000","last_undegraded":"2026-03-09T00:31:38.219621+0000","last_fullsized":"2026-03-09T00:31:38.219621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:33:49.318260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685196+0000","last_change":"2026-03-09T00:31:36.704016+0000","last_active":"2026-03-09T00:31:37.685196+0000","last_peered":"2026-03-09T00:31:37.685196+0000","last_clean":"2026-03-09T00:31:37.685196+0000","last_became_active":"2026-03-09T00:31:36.703824+0000","last_became_peered":"2026-03-09T00:31:36.703824+0000","last_unstale":"2026-03-09T00:31:37.685196+0000","last_undegraded":"2026-03-09T00:31:37.685196+0000","last_fullsized":"2026-03-09T00:31:37.685196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:39:14.000264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"54'11","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.603551+0000","last_change":"2026-03-09T00:31:32.655995+0000","last_active":"2026-03-09T00:31:38.603551+0000","last_peered":"2026-03-09T00:31:38.603551+0000","last_clean":"2026-03-09T00:31:38.603551+0000","last_became_active":"2026-03-09T00:31:32.655838+0000","last_became_peered":"2026-03-09T00:31:32.655838+0000","last_unstale":"2026-03-09T00:31:38.603551+0000","last_undegraded":"2026-03-09T00:31:38.603551+0000","last_fullsized":"2026-03-09T00:31:38.603551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T05:45:12.328548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.683876+0000","last_change":"2026-03-09T00:31:30.090085+0000","last_active":"2026-03-09T00:31:37.683876+0000","last_peered":"2026-03-09T00:31:37.683876+0000","last_clean":"2026-03-09T00:31:37.683876+0000","last_became_active":"2026-03-09T00:31:30.089103+0000","last_became_peered":"2026-03-09T00:31:30.089103+0000","last_unstale":"2026-03-09T00:31:37.683876+0000","last_undegraded":"2026-03-09T00:31:37.683876+0000","last_fullsized":"2026-03-09T00:31:37.683876+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T06:03:05.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.680549+0000","last_change":"2026-03-09T00:31:34.693308+0000","last_active":"2026-03-09T00:31:37.680549+0000","last_peered":"2026-03-09T00:31:37.680549+0000","last_clean":"2026-03-09T00:31:37.680549+0000","last_became_active":"2026-03-09T00:31:34.693193+0000","last_became_peered":"2026-03-09T00:31:34.693193+0000","last_unstale":"2026-03-09T00:31:37.680549+0000","last_undegraded":"2026-03-09T00:31:37.680549+0000","last_fullsized":"2026-03-09T00:31:37.680549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:17:59.013760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.674737+0000","last_change":"2026-03-09T00:31:36.698946+0000","last_active":"2026-03-09T00:31:37.674737+0000","last_peered":"2026-03-09T00:31:37.674737+0000","last_clean":"2026-03-09T00:31:37.674737+0000","last_became_active":"2026-03-09T00:31:36.698788+0000","last_became_peered":"2026-03-09T00:31:36.698788+0000","last_unstale":"2026-03-09T00:31:37.674737+0000","last_undegraded":"2026-03-09T00:31:37.674737+0000","last_fullsized":"2026-03-09T00:31:37.674737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:16:53.486598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"54'9","reported_seq":37,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.510509+0000","last_change":"2026-03-09T00:31:32.653333+0000","last_active":"2026-03-09T00:31:38.510509+0000","last_peered":"2026-03-09T00:31:38.510509+0000","last_clean":"2026-03-09T00:31:38.510509+0000","last_became_active":"2026-03-09T00:31:32.653241+0000","last_became_peered":"2026-03-09T00:31:32.653241+0000","last_unstale":"2026-03-09T00:31:38.510509+0000","last_undegraded":"2026-03-09T00:31:38.510509+0000","last_fullsized":"2026-03-09T00:31:38.510509+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:05:45.457022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665934+0000","last_change":"2026-03-09T00:31:30.099041+0000","last_active":"2026-03-09T00:31:37.665934+0000","last_peered":"2026-03-09T00:31:37.665934+0000","last_clean":"2026-03-09T00:31:37.665934+0000","last_became_active":"2026-03-09T00:31:30.098941+0000","last_became_peered":"2026-03-09T00:31:30.098941+0000","last_unstale":"2026-03-09T00:31:37.665934+0000","last_undegraded":"2026-03-09T00:31:37.665934+0000","last_fullsized":"2026-03-09T00:31:37.665934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:07:37.423005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675496+0000","last_change":"2026-03-09T00:31:34.663668+0000","last_active":"2026-03-09T00:31:37.675496+0000","last_peered":"2026-03-09T00:31:37.675496+0000","last_clean":"2026-03-09T00:31:37.675496+0000","last_became_active":"2026-03-09T00:31:34.663478+0000","last_became_peered":"2026-03-09T00:31:34.663478+0000","last_unstale":"2026-03-09T00:31:37.675496+0000","last_undegraded":"2026-03-09T00:31:37.675496+0000","last_fullsized":"2026-03-09T00:31:37.675496+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:34:24.956101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685298+0000","last_change":"2026-03-09T00:31:36.687636+0000","last_active":"2026-03-09T00:31:37.685298+0000","last_peered":"2026-03-09T00:31:37.685298+0000","last_clean":"2026-03-09T00:31:37.685298+0000","last_became_active":"2026-03-09T00:31:36.687552+0000","last_became_peered":"2026-03-09T00:31:36.687552+0000","last_unstale":"2026-03-09T00:31:37.685298+0000","last_undegraded":"2026-03-09T00:31:37.685298+0000","last_fullsized":"2026-03-09T00:31:37.685298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T00:47:10.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"54'17","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.645207+0000","last_change":"2026-03-09T00:31:32.658742+0000","last_active":"2026-03-09T00:31:38.645207+0000","last_peered":"2026-03-09T00:31:38.645207+0000","last_clean":"2026-03-09T00:31:38.645207+0000","last_became_active":"2026-03-09T00:31:32.658012+0000","last_became_peered":"2026-03-09T00:31:32.658012+0000","last_unstale":"2026-03-09T00:31:38.645207+0000","last_undegraded":"2026-03-09T00:31:38.645207+0000","last_fullsized":"2026-03-09T00:31:38.645207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:25:01.646925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.692554+0000","last_change":"2026-03-09T00:31:30.100315+0000","last_active":"2026-03-09T00:31:37.692554+0000","last_peered":"2026-03-09T00:31:37.692554+0000","last_clean":"2026-03-09T00:31:37.692554+0000","last_became_active":"2026-03-09T00:31:30.100224+0000","last_became_peered":"2026-03-09T00:31:30.100224+0000","last_unstale":"2026-03-09T00:31:37.692554+0000","last_undegraded":"2026-03-09T00:31:37.692554+0000","last_fullsized":"2026-03-09T00:31:37.692554+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T10:43:04.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.666426+0000","last_change":"2026-03-09T00:31:34.676956+0000","last_active":"2026-03-09T00:31:37.666426+0000","last_peered":"2026-03-09T00:31:37.666426+0000","last_clean":"2026-03-09T00:31:37.666426+0000","last_became_active":"2026-03-09T00:31:34.676886+0000","last_became_peered":"2026-03-09T00:31:34.676886+0000","last_unstale":"2026-03-09T00:31:37.666426+0000","last_undegraded":"2026-03-09T00:31:37.666426+0000","last_fullsized":"2026-03-09T00:31:37.666426+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:44:26.310705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675679+0000","last_change":"2026-03-09T00:31:37.270527+0000","last_active":"2026-03-09T00:31:37.675679+0000","last_peered":"2026-03-09T00:31:37.675679+0000","last_clean":"2026-03-09T00:31:37.675679+0000","last_became_active":"2026-03-09T00:31:37.270359+0000","last_became_peered":"2026-03-09T00:31:37.270359+0000","last_unstale":"2026-03-09T00:31:37.675679+0000","last_undegraded":"2026-03-09T00:31:37.675679+0000","last_fullsized":"2026-03-09T00:31:37.675679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:35:34.474926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"54'4","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.384940+0000","last_change":"2026-03-09T00:31:32.658629+0000","last_active":"2026-03-09T00:31:38.384940+0000","last_peered":"2026-03-09T00:31:38.384940+0000","last_clean":"2026-03-09T00:31:38.384940+0000","last_became_active":"2026-03-09T00:31:32.658236+0000","last_became_peered":"2026-03-09T00:31:32.658236+0000","last_unstale":"2026-03-09T00:31:38.384940+0000","last_undegraded":"2026-03-09T00:31:38.384940+0000","last_fullsized":"2026-03-09T00:31:38.384940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T11:50:35.606950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685389+0000","last_change":"2026-03-09T00:31:30.097550+0000","last_active":"2026-03-09T00:31:37.685389+0000","last_peered":"2026-03-09T00:31:37.685389+0000","last_clean":"2026-03-09T00:31:37.685389+0000","last_became_active":"2026-03-09T00:31:30.096936+0000","last_became_peered":"2026-03-09T00:31:30.096936+0000","last_unstale":"2026-03-09T00:31:37.685389+0000","last_undegraded":"2026-03-09T00:31:37.685389+0000","last_fullsized":"2026-03-09T00:31:37.685389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:59:14.467579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.690300+0000","last_change":"2026-03-09T00:31:34.697165+0000","last_active":"2026-03-09T00:31:37.690300+0000","last_peered":"2026-03-09T00:31:37.690300+0000","last_clean":"2026-03-09T00:31:37.690300+0000","last_became_active":"2026-03-09T00:31:34.697090+0000","last_became_peered":"2026-03-09T00:31:34.697090+0000","last_unstale":"2026-03-09T00:31:37.690300+0000","last_undegraded":"2026-03-09T00:31:37.690300+0000","last_fullsized":"2026-03-09T00:31:37.690300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:42:10.528571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.665715+0000","last_change":"2026-03-09T00:31:36.697706+0000","last_active":"2026-03-09T00:31:37.665715+0000","last_peered":"2026-03-09T00:31:37.665715+0000","last_clean":"2026-03-09T00:31:37.665715+0000","last_became_active":"2026-03-09T00:31:36.697393+0000","last_became_peered":"2026-03-09T00:31:36.697393+0000","last_unstale":"2026-03-09T00:31:37.665715+0000","last_undegraded":"2026-03-09T00:31:37.665715+0000","last_fullsized":"2026-03-09T00:31:37.665715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:48:08.754265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.681387+0000","last_change":"2026-03-09T00:31:36.682606+0000","last_active":"2026-03-09T00:31:37.681387+0000","last_peered":"2026-03-09T00:31:37.681387+0000","last_clean":"2026-03-09T00:31:37.681387+0000","last_became_active":"2026-03-09T00:31:36.681641+0000","last_became_peered":"2026-03-09T00:31:36.681641+0000","last_unstale":"2026-03-09T00:31:37.681387+0000","last_undegraded":"2026-03-09T00:31:37.681387+0000","last_fullsized":"2026-03-09T00:31:37.681387+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:35.646591+0000","last_clean_scrub_stamp":"2026-03-09T00:31:35.646591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T07:47:21.827557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.675089+0000","last_change":"2026-03-09T00:31:30.091631+0000","last_active":"2026-03-09T00:31:37.675089+0000","last_peered":"2026-03-09T00:31:37.675089+0000","last_clean":"2026-03-09T00:31:37.675089+0000","last_became_active":"2026-03-09T00:31:30.091505+0000","last_became_peered":"2026-03-09T00:31:30.091505+0000","last_unstale":"2026-03-09T00:31:37.675089+0000","last_undegraded":"2026-03-09T00:31:37.675089+0000","last_fullsized":"2026-03-09T00:31:37.675089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:29.065287+0000","last_clean_scrub_stamp":"2026-03-09T00:31:29.065287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T04:27:40.153728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"54'17","reported_seq":52,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:38.648575+0000","last_change":"2026-03-09T00:31:32.654849+0000","last_active":"2026-03-09T00:31:38.648575+0000","last_peered":"2026-03-09T00:31:38.648575+0000","last_clean":"2026-03-09T00:31:38.648575+0000","last_became_active":"2026-03-09T00:31:32.654762+0000","last_became_peered":"2026-03-09T00:31:32.654762+0000","last_unstale":"2026-03-09T00:31:38.648575+0000","last_undegraded":"2026-03-09T00:31:38.648575+0000","last_fullsized":"2026-03-09T00:31:38.648575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:31.076634+0000","last_clean_scrub_stamp":"2026-03-09T00:31:31.076634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T08:37:23.837632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-03-09T00:31:37.685766+0000","last_change":"2026-03-09T00:31:34.679131+0000","last_active":"2026-03-09T00:31:37.685766+0000","last_peered":"2026-03-09T00:31:37.685766+0000","last_clean":"2026-03-09T00:31:37.685766+0000","last_became_active":"2026-03-09T00:31:34.679037+0000","last_became_peered":"2026-03-09T00:31:34.679037+0000","last_unstale":"2026-03-09T00:31:37.685766+0000","last_undegraded":"2026-03-09T00:31:37.685766+0000","last_fullsized":"2026-03-09T00:31:37.685766+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:33.641421+0000","last_clean_scrub_stamp":"2026-03-09T00:31:33.641421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:31:52.805679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":986,"num_read_kb":711,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":589,"ondisk_log_size":589,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":459280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1388544,"data_stored":1377840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":43,"seq":184683593733,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27828,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939596,"statfs":{"total":21470642176,"available":21442146304,"internally_reserved":0,"allocated":1019904,"data_stored":665781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1585,"internal_metadata":27457999},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757255,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27808,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939616,"statfs":{"total":21470642176,"available":21442166784,"internally_reserved":0,"allocated":995328,"data_stored":665240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27457995},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953481,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27360,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940064,"statfs":{"total":21470642176,"available":21442625536,"internally_reserved":0,"allocated":536576,"data_stored":206319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117003,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27376,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940048,"statfs":{"total":21470642176,"available":21442609152,"internally_reserved":0,"allocated":557056,"data_stored":205572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247821,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27392,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940032,"statfs":{"total":21470642176,"available":21442592768,"internally_reserved":0,"allocated":573440,"data_stored":207287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27457996},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27344,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940080,"statfs":{"total":21470642176,"available":21442641920,"internally_reserved":0,"allocated":524288,"data_stored":205115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27416,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940008,"statfs":{"total":21470642176,"available":21442568192,"internally_reserved":0,"allocated":598016,"data_stored":206765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27832,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939592,"statfs":{"total":21470642176,"available":21442142208,"internally_reserved":0,"allocated":1024000,"data_stored":665490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-09T00:31:43.656 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-03-09T00:31:43.656 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-03-09T00:31:43.656 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-03-09T00:31:43.656 DEBUG:teuthology.orchestra.run.vm09:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid c172d940-1b4e-11f1-be3e-fb1b568ebce1 -- ceph health --format=json 2026-03-09T00:31:43.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:43 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2175550043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T00:31:43.874 INFO:teuthology.orchestra.run.vm09.stderr:Inferring config /var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/mon.a/config 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 -- 192.168.123.109:0/790103203 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e4104f40 msgr2=0x7f16e4105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 --2- 192.168.123.109:0/790103203 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e4104f40 0x7f16e4105320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009a30 tx=0x7f16d402f220 comp rx=0 tx=0).stop 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 -- 192.168.123.109:0/790103203 shutdown_connections 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 --2- 192.168.123.109:0/790103203 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f16e410a070 0x7f16e4111bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 --2- 192.168.123.109:0/790103203 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f16e41058f0 0x7f16e4109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 --2- 192.168.123.109:0/790103203 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e4104f40 0x7f16e4105320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.993+0000 7f16eb33e640 1 -- 192.168.123.109:0/790103203 >> 192.168.123.109:0/790103203 conn(0x7f16e41009e0 msgr2=0x7f16e4102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.994+0000 7f16eb33e640 1 -- 192.168.123.109:0/790103203 shutdown_connections 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.994+0000 7f16eb33e640 1 -- 192.168.123.109:0/790103203 wait complete. 2026-03-09T00:31:43.993 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.994+0000 7f16eb33e640 1 Processor -- start 2026-03-09T00:31:43.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 -- start start 2026-03-09T00:31:43.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 --2- >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f16e4104f40 0x7f16e410e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 --2- >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f16e41058f0 0x7f16e410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.994 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 0x7f16e41110c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 -- --> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4114570 con 0x7f16e4104f40 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 -- --> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41143f0 con 0x7f16e41058f0 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16eb33e640 1 -- --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_getmap magic: 0 -- 0x7f16e41146f0 con 0x7f16e410a070 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 0x7f16e41110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 --2- >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 0x7f16e41110c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.123.109:3301/0 says I am v2:192.168.123.109:57444/0 (socket says 192.168.123.109:57444) 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 -- 192.168.123.109:0/2783883132 learned_addr learned my addr 192.168.123.109:0/2783883132 (peer_addr_for_me v2:192.168.123.109:0/0) 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e88b2640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f16e41058f0 0x7f16e410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 -- 192.168.123.109:0/2783883132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f16e41058f0 msgr2=0x7f16e410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f16e41058f0 0x7f16e410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 -- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f16e4104f40 msgr2=0x7f16e410e810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f16e4104f40 0x7f16e410e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:43.995 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 -- 192.168.123.109:0/2783883132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e41117f0 con 0x7f16e410a070 2026-03-09T00:31:43.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.995+0000 7f16e98b4640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 0x7f16e41110c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16e0004820 tx=0x7f16e000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:43.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.996+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00090d0 con 0x7f16e410a070 2026-03-09T00:31:43.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.996+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 2 ==== config(25 keys) ==== 1029+0+0 (secure 0 0 0) 0x7f16e0009270 con 0x7f16e410a070 2026-03-09T00:31:43.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.996+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00136d0 con 0x7f16e410a070 2026-03-09T00:31:43.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.997+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e4111a80 con 0x7f16e410a070 2026-03-09T00:31:43.996 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.997+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e41a31c0 con 0x7f16e410a070 2026-03-09T00:31:43.997 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:43.997+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ac005180 con 0x7f16e410a070 2026-03-09T00:31:44.000 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.001+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 4 ==== mgrmap(e 16) ==== 100051+0+0 (secure 0 0 0) 0x7f16e0012070 con 0x7f16e410a070 2026-03-09T00:31:44.001 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.002+0000 7f16d27fc640 1 --2- 192.168.123.109:0/2783883132 >> v2:192.168.123.109:6800/82853931 conn(0x7f16c00776b0 0x7f16c0079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-03-09T00:31:44.001 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.002+0000 7f16e90b3640 1 --2- 192.168.123.109:0/2783883132 >> v2:192.168.123.109:6800/82853931 conn(0x7f16c00776b0 0x7f16c0079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-03-09T00:31:44.001 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.002+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 5 ==== osd_map(55..55 src has 1..55) ==== 5922+0+0 (secure 0 0 0) 0x7f16e0099110 con 0x7f16e410a070 2026-03-09T00:31:44.002 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.002+0000 7f16e90b3640 1 --2- 192.168.123.109:0/2783883132 >> v2:192.168.123.109:6800/82853931 conn(0x7f16c00776b0 0x7f16c0079b70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009950 tx=0x7f16d40023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-03-09T00:31:44.002 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.003+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f16e0010070 con 0x7f16e410a070 2026-03-09T00:31:44.114 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.115+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 --> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f16ac005740 con 0x7f16e410a070 2026-03-09T00:31:44.115 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.115+0000 7f16d27fc640 1 -- 192.168.123.109:0/2783883132 <== mon.2 v2:192.168.123.109:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f16e0062420 con 0x7f16e410a070 2026-03-09T00:31:44.115 INFO:teuthology.orchestra.run.vm09.stdout: 2026-03-09T00:31:44.115 INFO:teuthology.orchestra.run.vm09.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-03-09T00:31:44.117 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.118+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 >> v2:192.168.123.109:6800/82853931 conn(0x7f16c00776b0 msgr2=0x7f16c0079b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:44.117 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.118+0000 7f16eb33e640 1 --2- 192.168.123.109:0/2783883132 >> v2:192.168.123.109:6800/82853931 conn(0x7f16c00776b0 0x7f16c0079b70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009950 tx=0x7f16d40023d0 comp rx=0 tx=0).stop 2026-03-09T00:31:44.117 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.118+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 msgr2=0x7f16e41110c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.118+0000 7f16eb33e640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 0x7f16e41110c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16e0004820 tx=0x7f16e000d4a0 comp rx=0 tx=0).stop 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 shutdown_connections 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 --2- 192.168.123.109:0/2783883132 >> v2:192.168.123.109:6800/82853931 conn(0x7f16c00776b0 0x7f16c0079b70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3301/0,v1:192.168.123.109:6790/0] conn(0x7f16e410a070 0x7f16e41110c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.111:3300/0,v1:192.168.123.111:6789/0] conn(0x7f16e41058f0 0x7f16e410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 --2- 192.168.123.109:0/2783883132 >> [v2:192.168.123.109:3300/0,v1:192.168.123.109:6789/0] conn(0x7f16e4104f40 0x7f16e410e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 >> 192.168.123.109:0/2783883132 conn(0x7f16e41009e0 msgr2=0x7f16e41010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 shutdown_connections 2026-03-09T00:31:44.118 INFO:teuthology.orchestra.run.vm09.stderr:2026-03-09T00:31:44.119+0000 7f16eb33e640 1 -- 192.168.123.109:0/2783883132 wait complete. 2026-03-09T00:31:44.184 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-03-09T00:31:44.184 INFO:tasks.cephadm:Setup complete, yielding 2026-03-09T00:31:44.184 INFO:teuthology.run_tasks:Running task workunit... 2026-03-09T00:31:44.188 INFO:tasks.workunit:Pulling workunits from ref 569c3e99c9b32a51b4eaf08731c728f4513ed589 2026-03-09T00:31:44.188 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-03-09T00:31:44.188 DEBUG:teuthology.orchestra.run.vm09:> stat -- /home/ubuntu/cephtest/mnt.0 2026-03-09T00:31:44.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:31:44.204 INFO:teuthology.orchestra.run.vm09.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-03-09T00:31:44.204 DEBUG:teuthology.orchestra.run.vm09:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-03-09T00:31:44.258 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-03-09T00:31:44.258 DEBUG:teuthology.orchestra.run.vm09:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-03-09T00:31:44.312 INFO:tasks.workunit:timeout=3h 2026-03-09T00:31:44.312 INFO:tasks.workunit:cleanup=True 2026-03-09T00:31:44.313 DEBUG:teuthology.orchestra.run.vm09:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/kshtsk/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 569c3e99c9b32a51b4eaf08731c728f4513ed589 2026-03-09T00:31:44.367 INFO:tasks.workunit.client.0.vm09.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[49458]: pgmap v110: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 102 KiB/s rd, 5.3 KiB/s wr, 227 op/s 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[49458]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[49458]: from='client.24464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[49458]: osdmap e55: 8 total, 8 up, 8 in 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[49458]: from='client.? 192.168.123.109:0/2783883132' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[56118]: pgmap v110: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 102 KiB/s rd, 5.3 KiB/s wr, 227 op/s 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[56118]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[56118]: from='client.24464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[56118]: osdmap e55: 8 total, 8 up, 8 in 2026-03-09T00:31:44.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:44 vm09 ceph-mon[56118]: from='client.? 192.168.123.109:0/2783883132' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T00:31:44.553 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:44 vm11 ceph-mon[53379]: pgmap v110: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 102 KiB/s rd, 5.3 KiB/s wr, 227 op/s 2026-03-09T00:31:44.553 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:44 vm11 ceph-mon[53379]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:44.554 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:44 vm11 ceph-mon[53379]: from='client.24464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:44.554 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:44 vm11 ceph-mon[53379]: osdmap e55: 8 total, 8 up, 8 in 2026-03-09T00:31:44.554 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:44 vm11 ceph-mon[53379]: from='client.? 192.168.123.109:0/2783883132' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T00:31:44.554 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 systemd[1]: Starting Ceph prometheus.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 podman[78134]: 2026-03-09 00:31:44.555267935 +0000 UTC m=+0.018924363 container create 6cb7dc1741fd70b7b903da6d2e8378ec4b59e2cf1378b13fd334c6f29542fbaa (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 podman[78134]: 2026-03-09 00:31:44.583329823 +0000 UTC m=+0.046986251 container init 6cb7dc1741fd70b7b903da6d2e8378ec4b59e2cf1378b13fd334c6f29542fbaa (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 podman[78134]: 2026-03-09 00:31:44.585632551 +0000 UTC m=+0.049288980 container start 6cb7dc1741fd70b7b903da6d2e8378ec4b59e2cf1378b13fd334c6f29542fbaa (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 bash[78134]: 6cb7dc1741fd70b7b903da6d2e8378ec4b59e2cf1378b13fd334c6f29542fbaa 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 podman[78134]: 2026-03-09 00:31:44.54820052 +0000 UTC m=+0.011856948 image pull 1d3b7f56885b6dd623f1785be963aa9c195f86bc256ea454e8d02a7980b79c53 quay.io/prometheus/prometheus:v2.51.0 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 systemd[1]: Started Ceph prometheus.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.617Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.617Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.617Z caller=main.go:623 level=info host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 vm11 (none))" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.617Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.617Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.623Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.624Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.624Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.624Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.625Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.625Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.363µs 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.625Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.625Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.625Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=17.493µs wal_replay_duration=137.688µs wbl_replay_duration=130ns total_replay_duration=240.55µs 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.627Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.627Z caller=main.go:1153 level=info msg="TSDB started" 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.627Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.635Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=8.062106ms db_storage=671ns remote_storage=941ns web_handler=140ns query_engine=541ns scrape=953.235µs scrape_sd=48.581µs notify=662ns notify_sd=421ns rules=6.81445ms tracing=3.657µs 2026-03-09T00:31:44.950 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.635Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2026-03-09T00:31:44.951 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:31:44 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:31:44.635Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:45 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ignoring --setuser ceph since I am not root 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:45 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ignoring --setgroup ceph since I am not root 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:45 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:45.748+0000 7fe9e01f9140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:45 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:45.789+0000 7fe9e01f9140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-09T00:31:45.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:45 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-09T00:31:45.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:45 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' 2026-03-09T00:31:45.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:45 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: ignoring --setuser ceph since I am not root 2026-03-09T00:31:45.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:45 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: ignoring --setgroup ceph since I am not root 2026-03-09T00:31:45.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:45 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:45.752+0000 7f05357f0140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:31:45.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:45 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:45.794+0000 7f05357f0140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:31:46.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:46.169+0000 7fe9e01f9140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:31:46.450 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:46.184+0000 7f05357f0140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:31:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:46 vm09 ceph-mon[49458]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-09T00:31:46.930 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:46 vm09 ceph-mon[49458]: mgrmap e17: y(active, since 2m), standbys: x 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:46.494+0000 7fe9e01f9140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: from numpy import show_config as show_numpy_config 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:46.582+0000 7fe9e01f9140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:46.619+0000 7fe9e01f9140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:46 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:46.693+0000 7fe9e01f9140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:46 vm09 ceph-mon[56118]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-09T00:31:46.931 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:46 vm09 ceph-mon[56118]: mgrmap e17: y(active, since 2m), standbys: x 2026-03-09T00:31:46.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:46 vm11 ceph-mon[53379]: from='mgr.14150 192.168.123.109:0/1429247171' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-09T00:31:46.949 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:46 vm11 ceph-mon[53379]: mgrmap e17: y(active, since 2m), standbys: x 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:46.502+0000 7f05357f0140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: from numpy import show_config as show_numpy_config 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:46.598+0000 7f05357f0140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:46.635+0000 7f05357f0140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:31:46.950 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:46 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:46.706+0000 7f05357f0140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:31:47.450 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.194+0000 7f05357f0140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:31:47.450 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.303+0000 7f05357f0140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:31:47.450 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.346+0000 7f05357f0140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:31:47.450 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.381+0000 7f05357f0140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:31:47.450 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.419+0000 7f05357f0140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:31:47.455 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.191+0000 7fe9e01f9140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:31:47.455 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.304+0000 7fe9e01f9140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:31:47.456 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.343+0000 7fe9e01f9140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:31:47.456 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.379+0000 7fe9e01f9140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:31:47.456 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.419+0000 7fe9e01f9140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:31:47.456 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.455+0000 7fe9e01f9140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:31:47.870 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.455+0000 7f05357f0140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:31:47.870 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.615+0000 7f05357f0140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:31:47.870 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.663+0000 7f05357f0140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:31:47.890 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.623+0000 7fe9e01f9140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:31:47.890 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.673+0000 7fe9e01f9140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:31:47.890 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:47 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:47.890+0000 7fe9e01f9140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:31:48.138 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:47 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:47.870+0000 7f05357f0140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:31:48.176 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.176+0000 7fe9e01f9140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:31:48.402 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.138+0000 7f05357f0140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:31:48.402 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.176+0000 7f05357f0140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:31:48.402 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.216+0000 7f05357f0140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:31:48.402 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.293+0000 7f05357f0140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:31:48.402 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.329+0000 7f05357f0140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:31:48.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.214+0000 7fe9e01f9140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:31:48.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.255+0000 7fe9e01f9140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:31:48.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.335+0000 7fe9e01f9140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:31:48.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.372+0000 7fe9e01f9140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:31:48.679 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.403+0000 7f05357f0140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:31:48.679 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.508+0000 7f05357f0140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:31:48.679 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.640+0000 7f05357f0140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:31:48.704 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.448+0000 7fe9e01f9140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:31:48.704 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.559+0000 7fe9e01f9140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:31:48.705 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.704+0000 7fe9e01f9140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:48 vm11 ceph-mon[53379]: Standby manager daemon x restarted 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:48 vm11 ceph-mon[53379]: Standby manager daemon x started 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:48 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:48 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:48 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:48 vm11 ceph-mon[53379]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.680+0000 7f05357f0140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: [09/Mar/2026:00:31:48] ENGINE Bus STARTING 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: CherryPy Checker: 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: The Application mounted at '' has an empty config. 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: [09/Mar/2026:00:31:48] ENGINE Serving on http://:::9283 2026-03-09T00:31:48.934 INFO:journalctl@ceph.mgr.x.vm11.stdout:Mar 09 00:31:48 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-x[54919]: [09/Mar/2026:00:31:48] ENGINE Bus STARTED 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[49458]: Standby manager daemon x restarted 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[49458]: Standby manager daemon x started 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[49458]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[56118]: Standby manager daemon x restarted 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[56118]: Standby manager daemon x started 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T00:31:48.957 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:48 vm09 ceph-mon[56118]: from='mgr.? 192.168.123.111:0/2560319231' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T00:31:48.958 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:48.747+0000 7fe9e01f9140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:31:48.958 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:48] ENGINE Bus STARTING 2026-03-09T00:31:48.958 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: CherryPy Checker: 2026-03-09T00:31:48.958 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: The Application mounted at '' has an empty config. 2026-03-09T00:31:48.958 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: 2026-03-09T00:31:49.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:48] ENGINE Serving on http://:::9283 2026-03-09T00:31:49.430 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:48 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:48] ENGINE Bus STARTED 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: mgrmap e18: y(active, since 2m), standbys: x 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: Active manager daemon y restarted 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: Activating manager daemon y 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: osdmap e56: 8 total, 8 up, 8 in 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: mgrmap e19: y(active, starting, since 0.0332403s), standbys: x 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:31:49.817 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: Manager daemon y is now available 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:49 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:31:49.818 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:49 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug there is no tcmu-runner data available 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: mgrmap e18: y(active, since 2m), standbys: x 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: Active manager daemon y restarted 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: Activating manager daemon y 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: osdmap e56: 8 total, 8 up, 8 in 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: mgrmap e19: y(active, starting, since 0.0332403s), standbys: x 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:31:50.049 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: Manager daemon y is now available 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: mgrmap e18: y(active, since 2m), standbys: x 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: Active manager daemon y restarted 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: Activating manager daemon y 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: osdmap e56: 8 total, 8 up, 8 in 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: mgrmap e19: y(active, starting, since 0.0332403s), standbys: x 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: Manager daemon y is now available 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:31:50.050 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:49 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: mgrmap e20: y(active, since 1.05323s), standbys: x 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: [09/Mar/2026:00:31:49] ENGINE Bus STARTING 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: [09/Mar/2026:00:31:50] ENGINE Serving on http://192.168.123.109:8765 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: [09/Mar/2026:00:31:50] ENGINE Serving on https://192.168.123.109:7150 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: [09/Mar/2026:00:31:50] ENGINE Bus STARTED 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: [09/Mar/2026:00:31:50] ENGINE Client ('192.168.123.109', 35846) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: mgrmap e20: y(active, since 1.05323s), standbys: x 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: [09/Mar/2026:00:31:49] ENGINE Bus STARTING 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: [09/Mar/2026:00:31:50] ENGINE Serving on http://192.168.123.109:8765 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: [09/Mar/2026:00:31:50] ENGINE Serving on https://192.168.123.109:7150 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: [09/Mar/2026:00:31:50] ENGINE Bus STARTED 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: [09/Mar/2026:00:31:50] ENGINE Client ('192.168.123.109', 35846) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:50 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: mgrmap e20: y(active, since 1.05323s), standbys: x 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: [09/Mar/2026:00:31:49] ENGINE Bus STARTING 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: [09/Mar/2026:00:31:50] ENGINE Serving on http://192.168.123.109:8765 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: [09/Mar/2026:00:31:50] ENGINE Serving on https://192.168.123.109:7150 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: [09/Mar/2026:00:31:50] ENGINE Bus STARTED 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: [09/Mar/2026:00:31:50] ENGINE Client ('192.168.123.109', 35846) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm11", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:51.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:50 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: pgmap v4: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm11:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm09:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: mgrmap e21: y(active, since 2s), standbys: x 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[49458]: Deploying daemon alertmanager.a on vm09 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: pgmap v4: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:52.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm11:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm09:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: mgrmap e21: y(active, since 2s), standbys: x 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:51 vm09 ceph-mon[56118]: Deploying daemon alertmanager.a on vm09 2026-03-09T00:31:52.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: pgmap v4: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:52.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:52.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm09", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm09:/etc/ceph/ceph.conf 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm11:/etc/ceph/ceph.conf 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.conf 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm11:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm11:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm09:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: mgrmap e21: y(active, since 2s), standbys: x 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Updating vm09:/var/lib/ceph/c172d940-1b4e-11f1-be3e-fb1b568ebce1/config/ceph.client.admin.keyring 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:52.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:51 vm11 ceph-mon[53379]: Deploying daemon alertmanager.a on vm09 2026-03-09T00:31:54.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:54 vm09 ceph-mon[49458]: pgmap v5: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:54.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:54 vm09 ceph-mon[49458]: mgrmap e22: y(active, since 4s), standbys: x 2026-03-09T00:31:54.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:54 vm09 ceph-mon[56118]: pgmap v5: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:54.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:54 vm09 ceph-mon[56118]: mgrmap e22: y(active, since 4s), standbys: x 2026-03-09T00:31:54.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:54 vm11 ceph-mon[53379]: pgmap v5: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:54.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:54 vm11 ceph-mon[53379]: mgrmap e22: y(active, since 4s), standbys: x 2026-03-09T00:31:55.802 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:31:55 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[84597]: ts=2026-03-09T00:31:55.720Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2026-03-09T00:31:56.102 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:55 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:55] ENGINE Bus STOPPING 2026-03-09T00:31:56.102 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:56 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:56] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-03-09T00:31:56.102 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:56 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:56] ENGINE Bus STOPPED 2026-03-09T00:31:56.102 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:56 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:56] ENGINE Bus STARTING 2026-03-09T00:31:56.102 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:56 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:56] ENGINE Serving on http://:::9283 2026-03-09T00:31:56.102 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:56 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:31:56] ENGINE Bus STARTED 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: pgmap v6: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-09T00:31:56.386 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.388 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: pgmap v6: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:56.388 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.388 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.388 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.388 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.388 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.389 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.389 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-09T00:31:56.389 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:56 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: pgmap v6: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-09T00:31:56.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:56 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:57 vm09 ceph-mon[56118]: Regenerating cephadm self-signed grafana TLS certificates 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:57 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:57 vm09 ceph-mon[56118]: Deploying daemon grafana.a on vm11 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:31:57 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ::ffff:192.168.123.111 - - [09/Mar/2026:00:31:57] "GET /metrics HTTP/1.1" 503 1621 "" "Prometheus/2.51.0" 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:57 vm09 ceph-mon[49458]: Regenerating cephadm self-signed grafana TLS certificates 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:57 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-09T00:31:57.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:57 vm09 ceph-mon[49458]: Deploying daemon grafana.a on vm11 2026-03-09T00:31:57.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:57 vm11 ceph-mon[53379]: Regenerating cephadm self-signed grafana TLS certificates 2026-03-09T00:31:57.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:57 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-09T00:31:57.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:57 vm11 ceph-mon[53379]: Deploying daemon grafana.a on vm11 2026-03-09T00:31:58.180 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:31:57 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[84597]: ts=2026-03-09T00:31:57.689Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000375735s 2026-03-09T00:31:58.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:31:58 vm09 ceph-mon[56118]: pgmap v7: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2026-03-09T00:31:58.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:31:58 vm09 ceph-mon[49458]: pgmap v7: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2026-03-09T00:31:58.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:31:58 vm11 ceph-mon[53379]: pgmap v7: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2026-03-09T00:32:00.144 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:00 vm11 ceph-mon[53379]: pgmap v8: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2026-03-09T00:32:00.145 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:00 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:00.145 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:31:59 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug there is no tcmu-runner data available 2026-03-09T00:32:00.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:00 vm09 ceph-mon[49458]: pgmap v8: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2026-03-09T00:32:00.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:00 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:00.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:00 vm09 ceph-mon[56118]: pgmap v8: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2026-03-09T00:32:00.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:00 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:01.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:01 vm09 ceph-mon[56118]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:01.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:01 vm09 ceph-mon[49458]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:01.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:01 vm11 ceph-mon[53379]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:02.146 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 systemd[1]: Starting Ceph grafana.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:32:02.397 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:02 vm11 ceph-mon[53379]: pgmap v9: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2026-03-09T00:32:02.401 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 podman[79653]: 2026-03-09 00:32:02.147412973 +0000 UTC m=+0.017622089 container create 69a93f7bca3db947fce4b65ef848a15ef59ac6bd866b1008b3ec97c2850c0bc0 (image=quay.io/ceph/grafana:10.4.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a, maintainer=Grafana Labs ) 2026-03-09T00:32:02.401 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 podman[79653]: 2026-03-09 00:32:02.189686753 +0000 UTC m=+0.059895869 container init 69a93f7bca3db947fce4b65ef848a15ef59ac6bd866b1008b3ec97c2850c0bc0 (image=quay.io/ceph/grafana:10.4.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a, maintainer=Grafana Labs ) 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 podman[79653]: 2026-03-09 00:32:02.19276829 +0000 UTC m=+0.062977406 container start 69a93f7bca3db947fce4b65ef848a15ef59ac6bd866b1008b3ec97c2850c0bc0 (image=quay.io/ceph/grafana:10.4.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a, maintainer=Grafana Labs ) 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 bash[79653]: 69a93f7bca3db947fce4b65ef848a15ef59ac6bd866b1008b3ec97c2850c0bc0 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 podman[79653]: 2026-03-09 00:32:02.140114294 +0000 UTC m=+0.010323400 image pull c8b91775d855b99270fc5d22f3c6737e8cca01ef4c25c8b0362295e0746fa39b quay.io/ceph/grafana:10.4.0 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 systemd[1]: Started Ceph grafana.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.287821349Z level=info msg="Starting Grafana" version=10.4.0 commit=03f502a94d17f7dc4e6c34acdf8428aedd986e4c branch=HEAD compiled=2026-03-09T00:32:02Z 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288068763Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288072259Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288074263Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288075966Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288077569Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288079112Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288080695Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288082509Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288084232Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288085715Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288087267Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.28808883Z level=info msg=Target target=[all] 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288091876Z level=info msg="Path Home" path=/usr/share/grafana 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288093529Z level=info msg="Path Data" path=/var/lib/grafana 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288095012Z level=info msg="Path Logs" path=/var/log/grafana 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288096484Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.288097998Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=settings t=2026-03-09T00:32:02.28809949Z level=info msg="App mode production" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=sqlstore t=2026-03-09T00:32:02.288226518Z level=info msg="Connecting to DB" dbtype=sqlite3 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=sqlstore t=2026-03-09T00:32:02.2883989Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.288688262Z level=info msg="Starting DB migrations" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.289345973Z level=info msg="Executing migration" id="create migration_log table" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.289955383Z level=info msg="Migration successfully executed" id="create migration_log table" duration=609.24µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.290658569Z level=info msg="Executing migration" id="create user table" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.291010648Z level=info msg="Migration successfully executed" id="create user table" duration=352.249µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.29157803Z level=info msg="Executing migration" id="add unique index user.login" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.291930378Z level=info msg="Migration successfully executed" id="add unique index user.login" duration=352.309µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.292436036Z level=info msg="Executing migration" id="add unique index user.email" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.29276447Z level=info msg="Migration successfully executed" id="add unique index user.email" duration=328.344µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.293298719Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.293645458Z level=info msg="Migration successfully executed" id="drop index UQE_user_login - v1" duration=345.958µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.294121359Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.294434896Z level=info msg="Migration successfully executed" id="drop index UQE_user_email - v1" duration=313.577µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.29485962Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.295764084Z level=info msg="Migration successfully executed" id="Rename table user to user_v1 - v1" duration=904.774µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.296210899Z level=info msg="Executing migration" id="create user table v2" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.296534394Z level=info msg="Migration successfully executed" id="create user table v2" duration=323.505µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.296925066Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.297239224Z level=info msg="Migration successfully executed" id="create index UQE_user_login - v2" duration=314.007µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.297624254Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.297945626Z level=info msg="Migration successfully executed" id="create index UQE_user_email - v2" duration=321.21µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.298449128Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.29862614Z level=info msg="Migration successfully executed" id="copy data_source v1 to v2" duration=177.002µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.299007062Z level=info msg="Executing migration" id="Drop old table user_v1" 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.299246721Z level=info msg="Migration successfully executed" id="Drop old table user_v1" duration=238.647µs 2026-03-09T00:32:02.402 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.299624407Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.300066455Z level=info msg="Migration successfully executed" id="Add column help_flags1 to user table" duration=441.808µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.300473777Z level=info msg="Executing migration" id="Update user table charset" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.300484858Z level=info msg="Migration successfully executed" id="Update user table charset" duration=10.319µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.300941953Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.301362681Z level=info msg="Migration successfully executed" id="Add last_seen_at column to user" duration=422.151µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.301771054Z level=info msg="Executing migration" id="Add missing user data" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.301884447Z level=info msg="Migration successfully executed" id="Add missing user data" duration=113.292µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.302408006Z level=info msg="Executing migration" id="Add is_disabled column to user" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.302846526Z level=info msg="Migration successfully executed" id="Add is_disabled column to user" duration=438.691µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.303236127Z level=info msg="Executing migration" id="Add index user.login/user.email" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.303582965Z level=info msg="Migration successfully executed" id="Add index user.login/user.email" duration=346.679µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.303977914Z level=info msg="Executing migration" id="Add is_service_account column to user" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.304411897Z level=info msg="Migration successfully executed" id="Add is_service_account column to user" duration=434.143µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.304801336Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.307569917Z level=info msg="Migration successfully executed" id="Update is_service_account column to nullable" duration=2.768161ms 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.307985464Z level=info msg="Executing migration" id="Add uid column to user" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.308468888Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=482.082µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.308912017Z level=info msg="Executing migration" id="Update uid column values for users" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.30901428Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=101.24µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.309434415Z level=info msg="Executing migration" id="Add unique index user_uid" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.30975249Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=317.975µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.310323178Z level=info msg="Executing migration" id="create temp user table v1-7" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.310648638Z level=info msg="Migration successfully executed" id="create temp user table v1-7" duration=325.45µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.311385096Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.311748065Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v1-7" duration=363.049µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.312300129Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.312634735Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v1-7" duration=334.536µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.313195484Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.313515272Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v1-7" duration=319.729µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.314070361Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.314412531Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v1-7" duration=342.35µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.314998106Z level=info msg="Executing migration" id="Update temp_user table charset" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.315008746Z level=info msg="Migration successfully executed" id="Update temp_user table charset" duration=10.95µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.315488976Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.315875239Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_email - v1" duration=386.262µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.316283723Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.316599364Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_org_id - v1" duration=315.581µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.317009442Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.317325252Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_code - v1" duration=315.822µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.3177303Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.318056671Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_status - v1" duration=326.141µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.318441501Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.319528074Z level=info msg="Migration successfully executed" id="Rename table temp_user to temp_user_tmp_qwerty - v1" duration=1.086203ms 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.319993876Z level=info msg="Executing migration" id="create temp_user v2" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.32032732Z level=info msg="Migration successfully executed" id="create temp_user v2" duration=333.435µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.32072279Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.321163004Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v2" duration=439.915µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.321553154Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.321896476Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v2" duration=343.001µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.322289812Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.322610493Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v2" duration=320.772µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.322983341Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.323302808Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v2" duration=319.628µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.323818793Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.324002136Z level=info msg="Migration successfully executed" id="copy temp_user v1 to v2" duration=183.122µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.324390595Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.324631645Z level=info msg="Migration successfully executed" id="drop temp_user_tmp_qwerty" duration=241.051µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.324941505Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.325125379Z level=info msg="Migration successfully executed" id="Set created for temp users that will otherwise prematurely expire" duration=183.855µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.325553971Z level=info msg="Executing migration" id="create star table" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.325840528Z level=info msg="Migration successfully executed" id="create star table" duration=286.417µs 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.326219967Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2026-03-09T00:32:02.403 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.326548843Z level=info msg="Migration successfully executed" id="add unique index star.user_id_dashboard_id" duration=328.766µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.32706043Z level=info msg="Executing migration" id="create org table v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.327365321Z level=info msg="Migration successfully executed" id="create org table v1" duration=303.468µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.327839819Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.32816669Z level=info msg="Migration successfully executed" id="create index UQE_org_name - v1" duration=326.872µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.328624827Z level=info msg="Executing migration" id="create org_user table v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.328938455Z level=info msg="Migration successfully executed" id="create org_user table v1" duration=313.888µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.329412261Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.329755514Z level=info msg="Migration successfully executed" id="create index IDX_org_user_org_id - v1" duration=343.162µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.330256061Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.33061338Z level=info msg="Migration successfully executed" id="create index UQE_org_user_org_id_user_id - v1" duration=357.078µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.331077818Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.331415229Z level=info msg="Migration successfully executed" id="create index IDX_org_user_user_id - v1" duration=337.431µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.331893976Z level=info msg="Executing migration" id="Update org table charset" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.331905287Z level=info msg="Migration successfully executed" id="Update org table charset" duration=11.622µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.332416213Z level=info msg="Executing migration" id="Update org_user table charset" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.33242528Z level=info msg="Migration successfully executed" id="Update org_user table charset" duration=9.477µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.332760898Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.332867217Z level=info msg="Migration successfully executed" id="Migrate all Read Only Viewers to Viewers" duration=106.229µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.333317209Z level=info msg="Executing migration" id="create dashboard table" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.333637539Z level=info msg="Migration successfully executed" id="create dashboard table" duration=320.209µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.33415112Z level=info msg="Executing migration" id="add index dashboard.account_id" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.334540377Z level=info msg="Migration successfully executed" id="add index dashboard.account_id" duration=389.198µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.335251128Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.335608296Z level=info msg="Migration successfully executed" id="add unique index dashboard_account_id_slug" duration=357.288µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.336126336Z level=info msg="Executing migration" id="create dashboard_tag table" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.33640617Z level=info msg="Migration successfully executed" id="create dashboard_tag table" duration=279.694µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.336920963Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.337268012Z level=info msg="Migration successfully executed" id="add unique index dashboard_tag.dasboard_id_term" duration=346.949µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.337753151Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.338185439Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" duration=431.778µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.338591469Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.340491093Z level=info msg="Migration successfully executed" id="Rename table dashboard to dashboard_v1 - v1" duration=1.899314ms 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.340954622Z level=info msg="Executing migration" id="create dashboard v2" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.341326888Z level=info msg="Migration successfully executed" id="create dashboard v2" duration=372.137µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.341732307Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.34208128Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_org_id - v2" duration=348.783µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.342586275Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.342956097Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_org_id_slug - v2" duration=370.523µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.343473285Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.343646919Z level=info msg="Migration successfully executed" id="copy dashboard v1 to v2" duration=173.565µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.344054723Z level=info msg="Executing migration" id="drop table dashboard_v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.344472264Z level=info msg="Migration successfully executed" id="drop table dashboard_v1" duration=417.541µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.344905334Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.3449299Z level=info msg="Migration successfully executed" id="alter dashboard.data to mediumtext v1" duration=25.026µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.345407755Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.34605708Z level=info msg="Migration successfully executed" id="Add column updated_by in dashboard - v2" duration=649.084µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.346442511Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.347074244Z level=info msg="Migration successfully executed" id="Add column created_by in dashboard - v2" duration=631.633µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.347459445Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.348064145Z level=info msg="Migration successfully executed" id="Add column gnetId in dashboard" duration=604.601µs 2026-03-09T00:32:02.404 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.348478312Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.348858052Z level=info msg="Migration successfully executed" id="Add index for gnetId in dashboard" duration=378.618µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.349268419Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.349874363Z level=info msg="Migration successfully executed" id="Add column plugin_id in dashboard" duration=605.934µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.350280053Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.350623034Z level=info msg="Migration successfully executed" id="Add index for plugin_id in dashboard" duration=342.971µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.351026008Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.351356466Z level=info msg="Migration successfully executed" id="Add index for dashboard_id in dashboard_tag" duration=330.639µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.351879536Z level=info msg="Executing migration" id="Update dashboard table charset" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.351889164Z level=info msg="Migration successfully executed" id="Update dashboard table charset" duration=10.379µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.356678717Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.356698114Z level=info msg="Migration successfully executed" id="Update dashboard_tag table charset" duration=42.84µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.357175346Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.35793079Z level=info msg="Migration successfully executed" id="Add column folder_id in dashboard" duration=752.719µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.358311623Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.358980094Z level=info msg="Migration successfully executed" id="Add column isFolder in dashboard" duration=668.471µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.359979504Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.360723957Z level=info msg="Migration successfully executed" id="Add column has_acl in dashboard" duration=741.918µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.361271161Z level=info msg="Executing migration" id="Add column uid in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.362039829Z level=info msg="Migration successfully executed" id="Add column uid in dashboard" duration=768.738µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.362509168Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.362667004Z level=info msg="Migration successfully executed" id="Update uid column values in dashboard" duration=158.266µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.363173701Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.363573319Z level=info msg="Migration successfully executed" id="Add unique index dashboard_org_id_uid" duration=399.338µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.364207827Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.364581666Z level=info msg="Migration successfully executed" id="Remove unique index org_id_slug" duration=373.87µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.365039283Z level=info msg="Executing migration" id="Update dashboard title length" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.365104946Z level=info msg="Migration successfully executed" id="Update dashboard title length" duration=66.135µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.365595734Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.365985643Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_title_folder_id" duration=389.769µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.366445824Z level=info msg="Executing migration" id="create dashboard_provisioning" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.366788206Z level=info msg="Migration successfully executed" id="create dashboard_provisioning" duration=342.251µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.367366999Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.369078602Z level=info msg="Migration successfully executed" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" duration=1.711413ms 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.369543872Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.36995904Z level=info msg="Migration successfully executed" id="create dashboard_provisioning v2" duration=415.018µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.370511533Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.370918425Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id - v2" duration=406.701µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.371453767Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.371826124Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" duration=372.306µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.372374138Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.372579213Z level=info msg="Migration successfully executed" id="copy dashboard_provisioning v1 to v2" duration=205.894µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.373058009Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.373375022Z level=info msg="Migration successfully executed" id="drop dashboard_provisioning_tmp_qwerty" duration=317.003µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.373891408Z level=info msg="Executing migration" id="Add check_sum column" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.374773159Z level=info msg="Migration successfully executed" id="Add check_sum column" duration=881.599µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.375355388Z level=info msg="Executing migration" id="Add index for dashboard_title" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.375798899Z level=info msg="Migration successfully executed" id="Add index for dashboard_title" duration=444.172µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.376316948Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.376474392Z level=info msg="Migration successfully executed" id="delete tags for deleted dashboards" duration=157.385µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.3769651Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.377116684Z level=info msg="Migration successfully executed" id="delete stars for deleted dashboards" duration=151.754µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.377628482Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.378102599Z level=info msg="Migration successfully executed" id="Add index for dashboard_is_folder" duration=474.147µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.378652258Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.379441275Z level=info msg="Migration successfully executed" id="Add isPublic for dashboard" duration=788.917µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.37994713Z level=info msg="Executing migration" id="create data_source table" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.38037911Z level=info msg="Migration successfully executed" id="create data_source table" duration=431.989µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.381067738Z level=info msg="Executing migration" id="add index data_source.account_id" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.381451757Z level=info msg="Migration successfully executed" id="add index data_source.account_id" duration=383.919µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.38218538Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.382557596Z level=info msg="Migration successfully executed" id="add unique index data_source.account_id_name" duration=372.166µs 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.383097846Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2026-03-09T00:32:02.405 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.383508166Z level=info msg="Migration successfully executed" id="drop index IDX_data_source_account_id - v1" duration=410.219µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.383960822Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.38431807Z level=info msg="Migration successfully executed" id="drop index UQE_data_source_account_id_name - v1" duration=357.219µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.384801014Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.386613156Z level=info msg="Migration successfully executed" id="Rename table data_source to data_source_v1 - v1" duration=1.811842ms 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.387117439Z level=info msg="Executing migration" id="create data_source table v2" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.387519882Z level=info msg="Migration successfully executed" id="create data_source table v2" duration=402.141µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.388001764Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.388456766Z level=info msg="Migration successfully executed" id="create index IDX_data_source_org_id - v2" duration=454.74µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.388922798Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.389302818Z level=info msg="Migration successfully executed" id="create index UQE_data_source_org_id_name - v2" duration=380.031µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.38986451Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.390141608Z level=info msg="Migration successfully executed" id="Drop old table data_source_v1 #2" duration=277.269µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.390659918Z level=info msg="Executing migration" id="Add column with_credentials" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.39146743Z level=info msg="Migration successfully executed" id="Add column with_credentials" duration=807.331µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.39193786Z level=info msg="Executing migration" id="Add secure json data column" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.392703523Z level=info msg="Migration successfully executed" id="Add secure json data column" duration=764.321µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.393177129Z level=info msg="Executing migration" id="Update data_source table charset" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.39320936Z level=info msg="Migration successfully executed" id="Update data_source table charset" duration=32.401µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.393693094Z level=info msg="Executing migration" id="Update initial version to 1" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.393811947Z level=info msg="Migration successfully executed" id="Update initial version to 1" duration=118.833µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.394300972Z level=info msg="Executing migration" id="Add read_only data column" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.395108894Z level=info msg="Migration successfully executed" id="Add read_only data column" duration=807.771µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.395535293Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.395655758Z level=info msg="Migration successfully executed" id="Migrate logging ds to loki ds" duration=120.555µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.396150734Z level=info msg="Executing migration" id="Update json_data with nulls" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.396265278Z level=info msg="Migration successfully executed" id="Update json_data with nulls" duration=115.006µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.396735999Z level=info msg="Executing migration" id="Add uid column" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.397550393Z level=info msg="Migration successfully executed" id="Add uid column" duration=814.685µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.397998612Z level=info msg="Executing migration" id="Update uid value" 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.39811529Z level=info msg="Migration successfully executed" id="Update uid value" duration=116.718µs 2026-03-09T00:32:02.406 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.398592003Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2026-03-09T00:32:02.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:02 vm09 ceph-mon[56118]: pgmap v9: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2026-03-09T00:32:02.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:02 vm09 ceph-mon[49458]: pgmap v9: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.399031115Z level=info msg="Migration successfully executed" id="Add unique index datasource_org_id_uid" duration=439.061µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.399459135Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.399986131Z level=info msg="Migration successfully executed" id="add unique index datasource_org_id_is_default" duration=527.026µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.400536882Z level=info msg="Executing migration" id="create api_key table" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.400945827Z level=info msg="Migration successfully executed" id="create api_key table" duration=408.845µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.401496898Z level=info msg="Executing migration" id="add index api_key.account_id" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.401881489Z level=info msg="Migration successfully executed" id="add index api_key.account_id" duration=384.571µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.402407683Z level=info msg="Executing migration" id="add index api_key.key" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.402774299Z level=info msg="Migration successfully executed" id="add index api_key.key" duration=366.566µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.403379401Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.403783488Z level=info msg="Migration successfully executed" id="add index api_key.account_id_name" duration=404.817µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.404365437Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.404848902Z level=info msg="Migration successfully executed" id="drop index IDX_api_key_account_id - v1" duration=483.325µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.40531827Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.405711736Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_key - v1" duration=393.146µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.406174122Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.406540207Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_account_id_name - v1" duration=366.035µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.406984808Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.409121005Z level=info msg="Migration successfully executed" id="Rename table api_key to api_key_v1 - v1" duration=2.135807ms 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.409612406Z level=info msg="Executing migration" id="create api_key table v2" 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.409979593Z level=info msg="Migration successfully executed" id="create api_key table v2" duration=366.175µs 2026-03-09T00:32:02.657 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.410431027Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.410813894Z level=info msg="Migration successfully executed" id="create index IDX_api_key_org_id - v2" duration=382.517µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.411288192Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.411659616Z level=info msg="Migration successfully executed" id="create index UQE_api_key_key - v2" duration=372.256µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.412114058Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.412513495Z level=info msg="Migration successfully executed" id="create index UQE_api_key_org_id_name - v2" duration=399.287µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.413066159Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.41325909Z level=info msg="Migration successfully executed" id="copy api_key v1 to v2" duration=193.011µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.413684397Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.413985921Z level=info msg="Migration successfully executed" id="Drop old table api_key_v1" duration=301.254µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.414441903Z level=info msg="Executing migration" id="Update api_key table charset" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.414474444Z level=info msg="Migration successfully executed" id="Update api_key table charset" duration=32.472µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.415018301Z level=info msg="Executing migration" id="Add expires to api_key table" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.415868493Z level=info msg="Migration successfully executed" id="Add expires to api_key table" duration=849.871µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.416301774Z level=info msg="Executing migration" id="Add service account foreign key" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.417146645Z level=info msg="Migration successfully executed" id="Add service account foreign key" duration=844.511µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.417588792Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.417691395Z level=info msg="Migration successfully executed" id="set service account foreign key to nil if 0" duration=102.841µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.418179157Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.419036933Z level=info msg="Migration successfully executed" id="Add last_used_at to api_key table" duration=857.826µs 2026-03-09T00:32:02.658 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.419470593Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.420326566Z level=info msg="Migration successfully executed" id="Add is_revoked column to api_key table" duration=856.143µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.420792959Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.421160787Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v4" duration=366.666µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.421627922Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.421924236Z level=info msg="Migration successfully executed" id="drop table dashboard_snapshot_v4 #1" duration=296.435µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.422372515Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.422750812Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v5 #2" duration=378.278µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.423204682Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.423603107Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_key - v5" duration=398.296µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.426068412Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.426503586Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_delete_key - v5" duration=434.943µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.42709377Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.427475915Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_snapshot_user_id - v5" duration=382.687µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.4280129Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.428069877Z level=info msg="Migration successfully executed" id="alter dashboard_snapshot to mediumtext v2" duration=57.007µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.428558391Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.428589098Z level=info msg="Migration successfully executed" id="Update dashboard_snapshot table charset" duration=31.238µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.428991121Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.429936098Z level=info msg="Migration successfully executed" id="Add column external_delete_url to dashboard_snapshots table" duration=943.766µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.43034776Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.43126214Z level=info msg="Migration successfully executed" id="Add encrypted dashboard json column" duration=914.431µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.431825815Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.43188759Z level=info msg="Migration successfully executed" id="Change dashboard_encrypted column to MEDIUMBLOB" duration=62.448µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.432356539Z level=info msg="Executing migration" id="create quota table v1" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.432692948Z level=info msg="Migration successfully executed" id="create quota table v1" duration=336.399µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.433269316Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.433645952Z level=info msg="Migration successfully executed" id="create index UQE_quota_org_id_user_id_target - v1" duration=376.406µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.434350029Z level=info msg="Executing migration" id="Update quota table charset" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.434380496Z level=info msg="Migration successfully executed" id="Update quota table charset" duration=30.538µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.434896081Z level=info msg="Executing migration" id="create plugin_setting table" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.43524291Z level=info msg="Migration successfully executed" id="create plugin_setting table" duration=346.939µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.435789162Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.4361942Z level=info msg="Migration successfully executed" id="create index UQE_plugin_setting_org_id_plugin_id - v1" duration=405.198µs 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.436718291Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2026-03-09T00:32:02.659 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.437650185Z level=info msg="Migration successfully executed" id="Add column plugin_version to plugin_settings" duration=931.994µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.438256059Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.438288049Z level=info msg="Migration successfully executed" id="Update plugin_setting table charset" duration=32.572µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.438779498Z level=info msg="Executing migration" id="create session table" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.439205084Z level=info msg="Migration successfully executed" id="create session table" duration=425.416µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.439735508Z level=info msg="Executing migration" id="Drop old table playlist table" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.439808334Z level=info msg="Migration successfully executed" id="Drop old table playlist table" duration=72.736µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.440291748Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.440362771Z level=info msg="Migration successfully executed" id="Drop old table playlist_item table" duration=71.354µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.440866333Z level=info msg="Executing migration" id="create playlist table v2" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.441198475Z level=info msg="Migration successfully executed" id="create playlist table v2" duration=332.063µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.441738215Z level=info msg="Executing migration" id="create playlist item table v2" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.442074985Z level=info msg="Migration successfully executed" id="create playlist item table v2" duration=336.619µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.442619975Z level=info msg="Executing migration" id="Update playlist table charset" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.442649791Z level=info msg="Migration successfully executed" id="Update playlist table charset" duration=30.277µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.44314068Z level=info msg="Executing migration" id="Update playlist_item table charset" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.443170806Z level=info msg="Migration successfully executed" id="Update playlist_item table charset" duration=30.468µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.443680149Z level=info msg="Executing migration" id="Add playlist column created_at" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.444676023Z level=info msg="Migration successfully executed" id="Add playlist column created_at" duration=995.824µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.445221162Z level=info msg="Executing migration" id="Add playlist column updated_at" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.446168386Z level=info msg="Migration successfully executed" id="Add playlist column updated_at" duration=947.282µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.446589423Z level=info msg="Executing migration" id="drop preferences table v2" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.446661838Z level=info msg="Migration successfully executed" id="drop preferences table v2" duration=72.326µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.44712163Z level=info msg="Executing migration" id="drop preferences table v3" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.447203753Z level=info msg="Migration successfully executed" id="drop preferences table v3" duration=82.404µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.447671548Z level=info msg="Executing migration" id="create preferences table v3" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.448033105Z level=info msg="Migration successfully executed" id="create preferences table v3" duration=361.637µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.448583856Z level=info msg="Executing migration" id="Update preferences table charset" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.448614504Z level=info msg="Migration successfully executed" id="Update preferences table charset" duration=31.049µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.449087328Z level=info msg="Executing migration" id="Add column team_id in preferences" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.450084083Z level=info msg="Migration successfully executed" id="Add column team_id in preferences" duration=996.696µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.45050984Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.450610118Z level=info msg="Migration successfully executed" id="Update team_id column values in preferences" duration=100.499µs 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.451079285Z level=info msg="Executing migration" id="Add column week_start in preferences" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.452108191Z level=info msg="Migration successfully executed" id="Add column week_start in preferences" duration=1.027352ms 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.452581877Z level=info msg="Executing migration" id="Add column preferences.json_data" 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.453643074Z level=info msg="Migration successfully executed" id="Add column preferences.json_data" duration=1.061176ms 2026-03-09T00:32:02.660 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.454109917Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.454169308Z level=info msg="Migration successfully executed" id="alter preferences.json_data to mediumtext v1" duration=59.412µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.454762489Z level=info msg="Executing migration" id="Add preferences index org_id" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.455230745Z level=info msg="Migration successfully executed" id="Add preferences index org_id" duration=468.076µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.455810089Z level=info msg="Executing migration" id="Add preferences index user_id" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.456244752Z level=info msg="Migration successfully executed" id="Add preferences index user_id" duration=459.37µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.456803308Z level=info msg="Executing migration" id="create alert table v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.457292884Z level=info msg="Migration successfully executed" id="create alert table v1" duration=489.676µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.457870084Z level=info msg="Executing migration" id="add index alert org_id & id " 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.458374468Z level=info msg="Migration successfully executed" id="add index alert org_id & id " duration=504.054µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.458963319Z level=info msg="Executing migration" id="add index alert state" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.459356847Z level=info msg="Migration successfully executed" id="add index alert state" duration=393.388µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.459900593Z level=info msg="Executing migration" id="add index alert dashboard_id" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.460301523Z level=info msg="Migration successfully executed" id="add index alert dashboard_id" duration=400.979µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.460850972Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.461156444Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v1" duration=329.928µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.46202575Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.462444454Z level=info msg="Migration successfully executed" id="Add unique index alert_rule_tag.alert_id_tag_id" duration=418.835µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.463001717Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.463406023Z level=info msg="Migration successfully executed" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" duration=404.286µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.463860204Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.466689918Z level=info msg="Migration successfully executed" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" duration=2.829194ms 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.467154058Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.467504313Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v2" duration=350.285µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.467937573Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.468355366Z level=info msg="Migration successfully executed" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" duration=416.28µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.468912899Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.469082376Z level=info msg="Migration successfully executed" id="copy alert_rule_tag v1 to v2" duration=169.397µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.469509626Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.469794278Z level=info msg="Migration successfully executed" id="drop table alert_rule_tag_v1" duration=285.253µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.470237458Z level=info msg="Executing migration" id="create alert_notification table v1" 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.470569138Z level=info msg="Migration successfully executed" id="create alert_notification table v1" duration=331.661µs 2026-03-09T00:32:02.661 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.471020293Z level=info msg="Executing migration" id="Add column is_default" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.472109781Z level=info msg="Migration successfully executed" id="Add column is_default" duration=1.089659ms 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.472528054Z level=info msg="Executing migration" id="Add column frequency" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.473696241Z level=info msg="Migration successfully executed" id="Add column frequency" duration=1.168096ms 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.47420951Z level=info msg="Executing migration" id="Add column send_reminder" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.475416669Z level=info msg="Migration successfully executed" id="Add column send_reminder" duration=1.207029ms 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.475891208Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.476982851Z level=info msg="Migration successfully executed" id="Add column disable_resolve_message" duration=1.091854ms 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.477407706Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.477803247Z level=info msg="Migration successfully executed" id="add index alert_notification org_id & name" duration=395.461µs 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.478352604Z level=info msg="Executing migration" id="Update alert table charset" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.478383662Z level=info msg="Migration successfully executed" id="Update alert table charset" duration=31.389µs 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.478883407Z level=info msg="Executing migration" id="Update alert_notification table charset" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.478912582Z level=info msg="Migration successfully executed" id="Update alert_notification table charset" duration=29.595µs 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.479381009Z level=info msg="Executing migration" id="create notification_journal table v1" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.479708812Z level=info msg="Migration successfully executed" id="create notification_journal table v1" duration=327.834µs 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.480239084Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2026-03-09T00:32:02.662 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.480629876Z level=info msg="Migration successfully executed" id="add index notification_journal org_id & alert_id & notifier_id" duration=390.612µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.481150911Z level=info msg="Executing migration" id="drop alert_notification_journal" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.481504873Z level=info msg="Migration successfully executed" id="drop alert_notification_journal" duration=354.012µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.481946108Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.482295694Z level=info msg="Migration successfully executed" id="create alert_notification_state table v1" duration=349.606µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.48272652Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.483120666Z level=info msg="Migration successfully executed" id="add index alert_notification_state org_id & alert_id & notifier_id" duration=393.116µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.483556162Z level=info msg="Executing migration" id="Add for to alert table" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.484668583Z level=info msg="Migration successfully executed" id="Add for to alert table" duration=1.111609ms 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.485183447Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.486306809Z level=info msg="Migration successfully executed" id="Add column uid in alert_notification" duration=1.123551ms 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.486750891Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.48687377Z level=info msg="Migration successfully executed" id="Update uid column values in alert_notification" duration=123.06µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.48734379Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.487730353Z level=info msg="Migration successfully executed" id="Add unique index alert_notification_org_id_uid" duration=386.363µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.488340886Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.488731907Z level=info msg="Migration successfully executed" id="Remove unique index org_id_name" duration=390.851µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.489201786Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.490370665Z level=info msg="Migration successfully executed" id="Add column secure_settings in alert_notification" duration=1.168667ms 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.490857475Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.49090283Z level=info msg="Migration successfully executed" id="alter alert.settings to mediumtext" duration=45.926µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.491424426Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.492030841Z level=info msg="Migration successfully executed" id="Add non-unique index alert_notification_state_alert_id" duration=605.734µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.492464051Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.492917952Z level=info msg="Migration successfully executed" id="Add non-unique index alert_rule_tag_alert_id" duration=454.001µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.493439016Z level=info msg="Executing migration" id="Drop old annotation table v4" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.493508346Z level=info msg="Migration successfully executed" id="Drop old annotation table v4" duration=69.63µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.493986871Z level=info msg="Executing migration" id="create annotation table v5" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.494374598Z level=info msg="Migration successfully executed" id="create annotation table v5" duration=387.666µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.494896584Z level=info msg="Executing migration" id="add index annotation 0 v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.495282095Z level=info msg="Migration successfully executed" id="add index annotation 0 v3" duration=386.554µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.495805625Z level=info msg="Executing migration" id="add index annotation 1 v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.496193481Z level=info msg="Migration successfully executed" id="add index annotation 1 v3" duration=387.595µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.496744261Z level=info msg="Executing migration" id="add index annotation 2 v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.497148167Z level=info msg="Migration successfully executed" id="add index annotation 2 v3" duration=404.036µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.497652472Z level=info msg="Executing migration" id="add index annotation 3 v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.498077767Z level=info msg="Migration successfully executed" id="add index annotation 3 v3" duration=425.135µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.498600706Z level=info msg="Executing migration" id="add index annotation 4 v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.499044437Z level=info msg="Migration successfully executed" id="add index annotation 4 v3" duration=443.82µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.499570821Z level=info msg="Executing migration" id="Update annotation table charset" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.499601499Z level=info msg="Migration successfully executed" id="Update annotation table charset" duration=29.566µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.500092097Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.501358487Z level=info msg="Migration successfully executed" id="Add column region_id to annotation table" duration=1.26628ms 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.50214009Z level=info msg="Executing migration" id="Drop category_id index" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.502542151Z level=info msg="Migration successfully executed" id="Drop category_id index" duration=402.122µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.502985251Z level=info msg="Executing migration" id="Add column tags to annotation table" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.504139Z level=info msg="Migration successfully executed" id="Add column tags to annotation table" duration=1.153539ms 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.504579875Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.504936884Z level=info msg="Migration successfully executed" id="Create annotation_tag table v2" duration=355.306µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.505382307Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.505783177Z level=info msg="Migration successfully executed" id="Add unique index annotation_tag.annotation_id_tag_id" duration=400.85µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.506367791Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.506774672Z level=info msg="Migration successfully executed" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" duration=406.701µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.507240424Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.510402641Z level=info msg="Migration successfully executed" id="Rename table annotation_tag to annotation_tag_v2 - v2" duration=3.161266ms 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.510916153Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.511273402Z level=info msg="Migration successfully executed" id="Create annotation_tag table v3" duration=357.429µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.511699459Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.512107271Z level=info msg="Migration successfully executed" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" duration=407.662µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.512669023Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.512864509Z level=info msg="Migration successfully executed" id="copy annotation_tag v2 to v3" duration=195.465µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.513269196Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.513544581Z level=info msg="Migration successfully executed" id="drop table annotation_tag_v2" duration=275.496µs 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.51396546Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2026-03-09T00:32:02.663 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.514073241Z level=info msg="Migration successfully executed" id="Update alert annotations and set TEXT to empty" duration=108.062µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.51452199Z level=info msg="Executing migration" id="Add created time to annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.515719422Z level=info msg="Migration successfully executed" id="Add created time to annotation table" duration=1.197361ms 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.516209949Z level=info msg="Executing migration" id="Add updated time to annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.517405156Z level=info msg="Migration successfully executed" id="Add updated time to annotation table" duration=1.195127ms 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.51781346Z level=info msg="Executing migration" id="Add index for created in annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.518223708Z level=info msg="Migration successfully executed" id="Add index for created in annotation table" duration=410.077µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.518650347Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.519056476Z level=info msg="Migration successfully executed" id="Add index for updated in annotation table" duration=405.989µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.519568284Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.519701633Z level=info msg="Migration successfully executed" id="Convert existing annotations from seconds to milliseconds" duration=133.549µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.520159952Z level=info msg="Executing migration" id="Add epoch_end column" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.521374674Z level=info msg="Migration successfully executed" id="Add epoch_end column" duration=1.214562ms 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.521844714Z level=info msg="Executing migration" id="Add index for epoch_end" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.522237549Z level=info msg="Migration successfully executed" id="Add index for epoch_end" duration=410.468µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.52275113Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.522862859Z level=info msg="Migration successfully executed" id="Make epoch_end the same as epoch" duration=112.962µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.523329573Z level=info msg="Executing migration" id="Move region to single row" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.523513046Z level=info msg="Migration successfully executed" id="Move region to single row" duration=182.572µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.523876175Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.524284419Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch from annotation table" duration=408.254µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.524715647Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.525159577Z level=info msg="Migration successfully executed" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" duration=443.65µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.525588359Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.525999449Z level=info msg="Migration successfully executed" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" duration=410.87µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.526442669Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.526852746Z level=info msg="Migration successfully executed" id="Add index for org_id_epoch_end_epoch on annotation table" duration=409.767µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.527270478Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.52765091Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch_epoch_end from annotation table" duration=380.202µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.528075605Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.528460545Z level=info msg="Migration successfully executed" id="Add index for alert_id on annotation table" duration=383.838µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.528906669Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.528951263Z level=info msg="Migration successfully executed" id="Increase tags column to length 4096" duration=45.576µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.52974026Z level=info msg="Executing migration" id="create test_data table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.530408069Z level=info msg="Migration successfully executed" id="create test_data table" duration=667.609µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.531011428Z level=info msg="Executing migration" id="create dashboard_version table v1" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.531354821Z level=info msg="Migration successfully executed" id="create dashboard_version table v1" duration=343.252µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.531877038Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.532263081Z level=info msg="Migration successfully executed" id="add index dashboard_version.dashboard_id" duration=385.872µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.532812659Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.533229158Z level=info msg="Migration successfully executed" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" duration=416.098µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.533751226Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.533872122Z level=info msg="Migration successfully executed" id="Set dashboard version to 1 where 0" duration=120.876µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.534315341Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.534504355Z level=info msg="Migration successfully executed" id="save existing dashboard data in dashboard_version table v1" duration=189.093µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.534802843Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.534862625Z level=info msg="Migration successfully executed" id="alter dashboard_version.data to mediumtext v1" duration=60.003µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.535326704Z level=info msg="Executing migration" id="create team table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.535650951Z level=info msg="Migration successfully executed" id="create team table" duration=324.117µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.536180942Z level=info msg="Executing migration" id="add index team.org_id" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.536624111Z level=info msg="Migration successfully executed" id="add index team.org_id" duration=443.329µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.537177297Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.537577836Z level=info msg="Migration successfully executed" id="add unique index team_org_id_name" duration=400.458µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.538108529Z level=info msg="Executing migration" id="Add column uid in team" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.539461561Z level=info msg="Migration successfully executed" id="Add column uid in team" duration=1.353002ms 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.539933084Z level=info msg="Executing migration" id="Update uid column values in team" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.540040064Z level=info msg="Migration successfully executed" id="Update uid column values in team" duration=107.281µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.540504433Z level=info msg="Executing migration" id="Add unique index team_org_id_uid" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.540939578Z level=info msg="Migration successfully executed" id="Add unique index team_org_id_uid" duration=435.054µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.541485549Z level=info msg="Executing migration" id="create team member table" 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.541816589Z level=info msg="Migration successfully executed" id="create team member table" duration=330.769µs 2026-03-09T00:32:02.664 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.54236253Z level=info msg="Executing migration" id="add index team_member.org_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.542769753Z level=info msg="Migration successfully executed" id="add index team_member.org_id" duration=407.122µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.543301959Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.543702889Z level=info msg="Migration successfully executed" id="add unique index team_member_org_id_team_id_user_id" duration=400.739µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.544485523Z level=info msg="Executing migration" id="add index team_member.team_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.544909507Z level=info msg="Migration successfully executed" id="add index team_member.team_id" duration=423.823µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.545487989Z level=info msg="Executing migration" id="Add column email to team table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.546894341Z level=info msg="Migration successfully executed" id="Add column email to team table" duration=1.406242ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.547313997Z level=info msg="Executing migration" id="Add column external to team_member table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.548722493Z level=info msg="Migration successfully executed" id="Add column external to team_member table" duration=1.408646ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.549188355Z level=info msg="Executing migration" id="Add column permission to team_member table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.550499649Z level=info msg="Migration successfully executed" id="Add column permission to team_member table" duration=1.311234ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.550955471Z level=info msg="Executing migration" id="create dashboard acl table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.551415522Z level=info msg="Migration successfully executed" id="create dashboard acl table" duration=460.101µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.551951335Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.552370138Z level=info msg="Migration successfully executed" id="add index dashboard_acl_dashboard_id" duration=418.592µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.552983806Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.553435873Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_user_id" duration=451.806µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.55401687Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.554430805Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_team_id" duration=413.743µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.554963872Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.555357088Z level=info msg="Migration successfully executed" id="add index dashboard_acl_user_id" duration=393.195µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.555883563Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.55645325Z level=info msg="Migration successfully executed" id="add index dashboard_acl_team_id" duration=569.626µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.556971239Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.55738856Z level=info msg="Migration successfully executed" id="add index dashboard_acl_org_id_role" duration=417.241µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.55790182Z level=info msg="Executing migration" id="add index dashboard_permission" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.558325724Z level=info msg="Migration successfully executed" id="add index dashboard_permission" duration=423.714µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.558918172Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.559177828Z level=info msg="Migration successfully executed" id="save default acl rules in dashboard_acl table" duration=258.895µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.559660292Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.559788992Z level=info msg="Migration successfully executed" id="delete acl rules for deleted dashboards and folders" duration=128.901µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.560487028Z level=info msg="Executing migration" id="create tag table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.56086263Z level=info msg="Migration successfully executed" id="create tag table" duration=375.613µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.561397442Z level=info msg="Executing migration" id="add index tag.key_value" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.56185043Z level=info msg="Migration successfully executed" id="add index tag.key_value" duration=452.747µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.562375762Z level=info msg="Executing migration" id="create login attempt table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.562703086Z level=info msg="Migration successfully executed" id="create login attempt table" duration=327.244µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.563225363Z level=info msg="Executing migration" id="add index login_attempt.username" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.563630991Z level=info msg="Migration successfully executed" id="add index login_attempt.username" duration=405.528µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.564170231Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.564587512Z level=info msg="Migration successfully executed" id="drop index IDX_login_attempt_username - v1" duration=417.27µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.56506223Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.569109234Z level=info msg="Migration successfully executed" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" duration=4.046764ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.569617465Z level=info msg="Executing migration" id="create login_attempt v2" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.569963272Z level=info msg="Migration successfully executed" id="create login_attempt v2" duration=345.818µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.570383919Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.570786722Z level=info msg="Migration successfully executed" id="create index IDX_login_attempt_username - v2" duration=402.674µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.57150194Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.571675486Z level=info msg="Migration successfully executed" id="copy login_attempt v1 to v2" duration=173.395µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.572103738Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.572387678Z level=info msg="Migration successfully executed" id="drop login_attempt_tmp_qwerty" duration=282.328µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.572856526Z level=info msg="Executing migration" id="create user auth table" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.573174181Z level=info msg="Migration successfully executed" id="create user auth table" duration=317.465µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.57360132Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.574019712Z level=info msg="Migration successfully executed" id="create index IDX_user_auth_auth_module_auth_id - v1" duration=418.162µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.574544485Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.574589088Z level=info msg="Migration successfully executed" id="alter user_auth.auth_id to length 190" duration=44.815µs 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.575150389Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.576705158Z level=info msg="Migration successfully executed" id="Add OAuth access token to user_auth" duration=1.554769ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.577273041Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.578736119Z level=info msg="Migration successfully executed" id="Add OAuth refresh token to user_auth" duration=1.463299ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.57919559Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.580881925Z level=info msg="Migration successfully executed" id="Add OAuth token type to user_auth" duration=1.686085ms 2026-03-09T00:32:02.665 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.581318632Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.58314545Z level=info msg="Migration successfully executed" id="Add OAuth expiry to user_auth" duration=1.826759ms 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.583587297Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.584083016Z level=info msg="Migration successfully executed" id="Add index to user_id column in user_auth" duration=495.829µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.584629478Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.586236485Z level=info msg="Migration successfully executed" id="Add OAuth ID token to user_auth" duration=1.606767ms 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.58669315Z level=info msg="Executing migration" id="create server_lock table" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.587071188Z level=info msg="Migration successfully executed" id="create server_lock table" duration=376.624µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.587654528Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.588098018Z level=info msg="Migration successfully executed" id="add index server_lock.operation_uid" duration=443.44µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.588661363Z level=info msg="Executing migration" id="create user auth token table" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.58905518Z level=info msg="Migration successfully executed" id="create user auth token table" duration=393.686µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.58960565Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.590030906Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.auth_token" duration=425.206µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.590564364Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.590992104Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.prev_auth_token" duration=427.5µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.591528188Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.591996774Z level=info msg="Migration successfully executed" id="add index user_auth_token.user_id" duration=468.556µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.592547845Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.594210517Z level=info msg="Migration successfully executed" id="Add revoked_at to the user auth token" duration=1.662621ms 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.59466597Z level=info msg="Executing migration" id="add index user_auth_token.revoked_at" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.595102737Z level=info msg="Migration successfully executed" id="add index user_auth_token.revoked_at" duration=436.677µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.595627769Z level=info msg="Executing migration" id="create cache_data table" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.596027097Z level=info msg="Migration successfully executed" id="create cache_data table" duration=399.268µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.596553412Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.597005968Z level=info msg="Migration successfully executed" id="add unique index cache_data.cache_key" duration=452.586µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.597553444Z level=info msg="Executing migration" id="create short_url table v1" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.597951909Z level=info msg="Migration successfully executed" id="create short_url table v1" duration=398.436µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.598514792Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.598962891Z level=info msg="Migration successfully executed" id="add index short_url.org_id-uid" duration=448.14µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.599707755Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.599763419Z level=info msg="Migration successfully executed" id="alter table short_url alter column created_by type to bigint" duration=45.395µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.600252774Z level=info msg="Executing migration" id="delete alert_definition table" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.600321924Z level=info msg="Migration successfully executed" id="delete alert_definition table" duration=69.39µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.600682289Z level=info msg="Executing migration" id="recreate alert_definition table" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.601076857Z level=info msg="Migration successfully executed" id="recreate alert_definition table" duration=394.568µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.601610395Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.602041763Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and title columns" duration=431.568µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.602556967Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.603006217Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and uid columns" duration=449.05µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.603564723Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.603609257Z level=info msg="Migration successfully executed" id="alter alert_definition table data column to mediumtext in mysql" duration=45.004µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.604101698Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.604524469Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and title columns" duration=422.721µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.604973199Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.605378797Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and uid columns" duration=405.639µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.605841974Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.606291304Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and title columns" duration=450.282µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.606741638Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.607180609Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and uid columns" duration=438.781µs 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.607607367Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.609466647Z level=info msg="Migration successfully executed" id="Add column paused in alert_definition" duration=1.858908ms 2026-03-09T00:32:02.666 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.609934503Z level=info msg="Executing migration" id="drop alert_definition table" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.610366662Z level=info msg="Migration successfully executed" id="drop alert_definition table" duration=431.898µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.61082034Z level=info msg="Executing migration" id="delete alert_definition_version table" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.610894739Z level=info msg="Migration successfully executed" id="delete alert_definition_version table" duration=72.356µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.611371171Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.611762864Z level=info msg="Migration successfully executed" id="recreate alert_definition_version table" duration=391.633µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.612233435Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.612677607Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_id and version columns" duration=444.223µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.613171631Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.613644906Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_uid and version columns" duration=473.856µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.614124054Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.614182343Z level=info msg="Migration successfully executed" id="alter alert_definition_version table data column to mediumtext in mysql" duration=58.459µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.614664004Z level=info msg="Executing migration" id="drop alert_definition_version table" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.615119305Z level=info msg="Migration successfully executed" id="drop alert_definition_version table" duration=454.931µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.615611647Z level=info msg="Executing migration" id="create alert_instance table" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.616022275Z level=info msg="Migration successfully executed" id="create alert_instance table" duration=410.548µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.616480893Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.61693867Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" duration=457.546µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.617402128Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.617821372Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, current_state columns" duration=418.903µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.618377933Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.620235981Z level=info msg="Migration successfully executed" id="add column current_state_end to alert_instance" duration=1.857788ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.620712713Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.62114924Z level=info msg="Migration successfully executed" id="remove index def_org_id, def_uid, current_state on alert_instance" duration=436.337µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.621613257Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.622066105Z level=info msg="Migration successfully executed" id="remove index def_org_id, current_state on alert_instance" duration=452.639µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.622517851Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.630529794Z level=info msg="Migration successfully executed" id="rename def_org_id to rule_org_id in alert_instance" duration=8.01015ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.631223362Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.638860184Z level=info msg="Migration successfully executed" id="rename def_uid to rule_uid in alert_instance" duration=7.6359ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.639452341Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.639926169Z level=info msg="Migration successfully executed" id="add index rule_org_id, rule_uid, current_state on alert_instance" duration=473.567µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.640398883Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.640852021Z level=info msg="Migration successfully executed" id="add index rule_org_id, current_state on alert_instance" duration=453.279µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.641412721Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.643107762Z level=info msg="Migration successfully executed" id="add current_reason column related to current_state" duration=1.694591ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.643602127Z level=info msg="Executing migration" id="add result_fingerprint column to alert_instance" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.645539142Z level=info msg="Migration successfully executed" id="add result_fingerprint column to alert_instance" duration=1.936503ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.646059477Z level=info msg="Executing migration" id="create alert_rule table" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.646502706Z level=info msg="Migration successfully executed" id="create alert_rule table" duration=443.43µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.647045371Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.647481427Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and title columns" duration=436.157µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.648055461Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.648541361Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and uid columns" duration=488.213µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.649065151Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.649535671Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" duration=470.371µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.650088425Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.650145231Z level=info msg="Migration successfully executed" id="alter alert_rule table data column to mediumtext in mysql" duration=58.45µs 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.650625291Z level=info msg="Executing migration" id="add column for to alert_rule" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.65244166Z level=info msg="Migration successfully executed" id="add column for to alert_rule" duration=1.816048ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.652920826Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.654597824Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule" duration=1.676818ms 2026-03-09T00:32:02.667 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.655061383Z level=info msg="Executing migration" id="add column labels to alert_rule" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.656714947Z level=info msg="Migration successfully executed" id="add column labels to alert_rule" duration=1.653405ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.657211976Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.657656999Z level=info msg="Migration successfully executed" id="remove unique index from alert_rule on org_id, title columns" duration=444.982µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.658117081Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.658556012Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespase_uid and title columns" duration=438.912µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.659044345Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.661757313Z level=info msg="Migration successfully executed" id="add dashboard_uid column to alert_rule" duration=2.712445ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.662358798Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.665360104Z level=info msg="Migration successfully executed" id="add panel_id column to alert_rule" duration=3.000745ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.66591287Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.666369744Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" duration=456.805µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.667047673Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.668803889Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule" duration=1.755866ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.669331056Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.671142746Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule table" duration=1.81162ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.671660494Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.671723903Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule table" duration=63.849µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.672269846Z level=info msg="Executing migration" id="create alert_rule_version table" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.672868936Z level=info msg="Migration successfully executed" id="create alert_rule_version table" duration=598.07µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.673467176Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.674003871Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" duration=536.975µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.674571212Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.675133094Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" duration=561.712µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.675933622Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.675992812Z level=info msg="Migration successfully executed" id="alter alert_rule_version table data column to mediumtext in mysql" duration=59.772µs 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.676524217Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.67841746Z level=info msg="Migration successfully executed" id="add column for to alert_rule_version" duration=1.892842ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.678893982Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.680696664Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule_version" duration=1.801872ms 2026-03-09T00:32:02.928 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.681215426Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.68305046Z level=info msg="Migration successfully executed" id="add column labels to alert_rule_version" duration=1.834873ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.683540687Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.686057136Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule_version" duration=2.514376ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.686523689Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.68871434Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule_versions table" duration=2.19028ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.689215898Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.689274537Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule_version table" duration=58.91µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.689777869Z level=info msg="Executing migration" id=create_alert_configuration_table 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.690150777Z level=info msg="Migration successfully executed" id=create_alert_configuration_table duration=373.019µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.690679186Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.692578891Z level=info msg="Migration successfully executed" id="Add column default in alert_configuration" duration=1.899685ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.69309094Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.693148758Z level=info msg="Migration successfully executed" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" duration=58.349µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.69369522Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.695595556Z level=info msg="Migration successfully executed" id="add column org_id in alert_configuration" duration=1.900276ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.696021214Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.696471385Z level=info msg="Migration successfully executed" id="add index in alert_configuration table on org_id column" duration=449.841µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.697084002Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.698999116Z level=info msg="Migration successfully executed" id="add configuration_hash column to alert_configuration" duration=1.914934ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.699527965Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.69993651Z level=info msg="Migration successfully executed" id=create_ngalert_configuration_table duration=408.404µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.700525933Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.701039144Z level=info msg="Migration successfully executed" id="add index in ngalert_configuration on org_id column" duration=513.251µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.701599061Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.703668104Z level=info msg="Migration successfully executed" id="add column send_alerts_to in ngalert_configuration" duration=2.068763ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.704151337Z level=info msg="Executing migration" id="create provenance_type table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.704510309Z level=info msg="Migration successfully executed" id="create provenance_type table" duration=359.023µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.705067571Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.705518516Z level=info msg="Migration successfully executed" id="add index to uniquify (record_key, record_type, org_id) columns" duration=450.784µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.706050451Z level=info msg="Executing migration" id="create alert_image table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.706390918Z level=info msg="Migration successfully executed" id="create alert_image table" duration=339.526µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.706930218Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.707348981Z level=info msg="Migration successfully executed" id="add unique index on token to alert_image table" duration=418.873µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.707905883Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.707961427Z level=info msg="Migration successfully executed" id="support longer URLs in alert_image table" duration=46.006µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.708420658Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.708910143Z level=info msg="Migration successfully executed" id=create_alert_configuration_history_table duration=489.406µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.709456936Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.709920193Z level=info msg="Migration successfully executed" id="drop non-unique orgID index on alert_configuration" duration=463.428µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.710334819Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.710525696Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.711012156Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.711268917Z level=info msg="Migration successfully executed" id="extract alertmanager configuration history to separate table" duration=256.892µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.711727395Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.712155636Z level=info msg="Migration successfully executed" id="add unique index on orgID to alert_configuration" duration=428.271µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.71260115Z level=info msg="Executing migration" id="add last_applied column to alert_configuration_history" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.714571658Z level=info msg="Migration successfully executed" id="add last_applied column to alert_configuration_history" duration=1.970408ms 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.715009728Z level=info msg="Executing migration" id="create library_element table v1" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.715485668Z level=info msg="Migration successfully executed" id="create library_element table v1" duration=475.74µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.71603136Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.716489527Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_id-name-kind" duration=457.836µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.717032773Z level=info msg="Executing migration" id="create library_element_connection table v1" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.717384502Z level=info msg="Migration successfully executed" id="create library_element_connection table v1" duration=351.668µs 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.717916237Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2026-03-09T00:32:02.929 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.718365537Z level=info msg="Migration successfully executed" id="add index library_element_connection element_id-kind-connection_id" duration=449.03µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.718880071Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.71930697Z level=info msg="Migration successfully executed" id="add unique index library_element org_id_uid" duration=426.989µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.720038488Z level=info msg="Executing migration" id="increase max description length to 2048" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.720069556Z level=info msg="Migration successfully executed" id="increase max description length to 2048" duration=31.438µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.720545928Z level=info msg="Executing migration" id="alter library_element model to mediumtext" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.720603396Z level=info msg="Migration successfully executed" id="alter library_element model to mediumtext" duration=56.606µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.720979099Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.721141563Z level=info msg="Migration successfully executed" id="clone move dashboard alerts to unified alerting" duration=162.785µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.721638773Z level=info msg="Executing migration" id="create data_keys table" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.722091441Z level=info msg="Migration successfully executed" id="create data_keys table" duration=452.518µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.7226311Z level=info msg="Executing migration" id="create secrets table" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.722999108Z level=info msg="Migration successfully executed" id="create secrets table" duration=368.059µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.723519533Z level=info msg="Executing migration" id="rename data_keys name column to id" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.733199367Z level=info msg="Migration successfully executed" id="rename data_keys name column to id" duration=9.679052ms 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.733732084Z level=info msg="Executing migration" id="add name column into data_keys" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.736074738Z level=info msg="Migration successfully executed" id="add name column into data_keys" duration=2.343746ms 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.7365782Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.736689959Z level=info msg="Migration successfully executed" id="copy data_keys id column values into name" duration=113.102µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.737213449Z level=info msg="Executing migration" id="rename data_keys name column to label" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.746868056Z level=info msg="Migration successfully executed" id="rename data_keys name column to label" duration=9.653385ms 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.747374714Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.75760012Z level=info msg="Migration successfully executed" id="rename data_keys id column back to name" duration=10.223152ms 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.758321891Z level=info msg="Executing migration" id="create kv_store table v1" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.758802761Z level=info msg="Migration successfully executed" id="create kv_store table v1" duration=481.109µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.759470811Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.760019027Z level=info msg="Migration successfully executed" id="add index kv_store.org_id-namespace-key" duration=548.096µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.760599022Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.760756878Z level=info msg="Migration successfully executed" id="update dashboard_uid and panel_id from existing annotations" duration=158.166µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.761307899Z level=info msg="Executing migration" id="create permission table" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.761763582Z level=info msg="Migration successfully executed" id="create permission table" duration=456.886µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.762386347Z level=info msg="Executing migration" id="add unique index permission.role_id" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.762889919Z level=info msg="Migration successfully executed" id="add unique index permission.role_id" duration=503.754µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.763458603Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.763953589Z level=info msg="Migration successfully executed" id="add unique index role_id_action_scope" duration=494.645µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.764523296Z level=info msg="Executing migration" id="create role table" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.764944234Z level=info msg="Migration successfully executed" id="create role table" duration=420.557µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.765471149Z level=info msg="Executing migration" id="add column display_name" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.767919511Z level=info msg="Migration successfully executed" id="add column display_name" duration=2.447901ms 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.768425999Z level=info msg="Executing migration" id="add column group_name" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.77051046Z level=info msg="Migration successfully executed" id="add column group_name" duration=2.084562ms 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.771007731Z level=info msg="Executing migration" id="add index role.org_id" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.771448646Z level=info msg="Migration successfully executed" id="add index role.org_id" duration=441.366µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.7720277Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.772485516Z level=info msg="Migration successfully executed" id="add unique index role_org_id_name" duration=457.886µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.773047848Z level=info msg="Executing migration" id="add index role_org_id_uid" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.773490036Z level=info msg="Migration successfully executed" id="add index role_org_id_uid" duration=442.239µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.774010801Z level=info msg="Executing migration" id="create team role table" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.774391863Z level=info msg="Migration successfully executed" id="create team role table" duration=363.108µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.774922447Z level=info msg="Executing migration" id="add index team_role.org_id" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.775392086Z level=info msg="Migration successfully executed" id="add index team_role.org_id" duration=468.276µs 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.775916657Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2026-03-09T00:32:02.930 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.776430539Z level=info msg="Migration successfully executed" id="add unique index team_role_org_id_team_id_role_id" duration=513.431µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.777194699Z level=info msg="Executing migration" id="add index team_role.team_id" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.777623822Z level=info msg="Migration successfully executed" id="add index team_role.team_id" duration=429.143µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.778153053Z level=info msg="Executing migration" id="create user role table" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.778577356Z level=info msg="Migration successfully executed" id="create user role table" duration=423.713µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.779103952Z level=info msg="Executing migration" id="add index user_role.org_id" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.779541511Z level=info msg="Migration successfully executed" id="add index user_role.org_id" duration=437.469µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.780046616Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.780482481Z level=info msg="Migration successfully executed" id="add unique index user_role_org_id_user_id_role_id" duration=435.715µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.780993017Z level=info msg="Executing migration" id="add index user_role.user_id" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.781417972Z level=info msg="Migration successfully executed" id="add index user_role.user_id" duration=425.075µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.781966328Z level=info msg="Executing migration" id="create builtin role table" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.782322915Z level=info msg="Migration successfully executed" id="create builtin role table" duration=355.515µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.782857246Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.783301457Z level=info msg="Migration successfully executed" id="add index builtin_role.role_id" duration=444.201µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.783804999Z level=info msg="Executing migration" id="add index builtin_role.name" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.784253208Z level=info msg="Migration successfully executed" id="add index builtin_role.name" duration=448.089µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.784771688Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.787292777Z level=info msg="Migration successfully executed" id="Add column org_id to builtin_role table" duration=2.520657ms 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.787783504Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.788233205Z level=info msg="Migration successfully executed" id="add index builtin_role.org_id" duration=449.661µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.788878393Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.789323907Z level=info msg="Migration successfully executed" id="add unique index builtin_role_org_id_role_id_role" duration=446.214µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.789852586Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.790291548Z level=info msg="Migration successfully executed" id="Remove unique index role_org_id_uid" duration=439.915µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.790709611Z level=info msg="Executing migration" id="add unique index role.uid" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.791170092Z level=info msg="Migration successfully executed" id="add unique index role.uid" duration=459.81µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.791598805Z level=info msg="Executing migration" id="create seed assignment table" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.791940083Z level=info msg="Migration successfully executed" id="create seed assignment table" duration=341.138µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.792449747Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.792932439Z level=info msg="Migration successfully executed" id="add unique index builtin_role_role_name" duration=482.612µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.79347214Z level=info msg="Executing migration" id="add column hidden to role table" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.796331632Z level=info msg="Migration successfully executed" id="add column hidden to role table" duration=2.856295ms 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.796966419Z level=info msg="Executing migration" id="permission kind migration" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.799236969Z level=info msg="Migration successfully executed" id="permission kind migration" duration=2.270079ms 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.799700356Z level=info msg="Executing migration" id="permission attribute migration" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.802259674Z level=info msg="Migration successfully executed" id="permission attribute migration" duration=2.559279ms 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.802869796Z level=info msg="Executing migration" id="permission identifier migration" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.805151937Z level=info msg="Migration successfully executed" id="permission identifier migration" duration=2.282079ms 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.805626345Z level=info msg="Executing migration" id="add permission identifier index" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.806133925Z level=info msg="Migration successfully executed" id="add permission identifier index" duration=507.369µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.80666577Z level=info msg="Executing migration" id="add permission action scope role_id index" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.807176316Z level=info msg="Migration successfully executed" id="add permission action scope role_id index" duration=510.256µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.807934895Z level=info msg="Executing migration" id="remove permission role_id action scope index" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.808380329Z level=info msg="Migration successfully executed" id="remove permission role_id action scope index" duration=445.555µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.808840079Z level=info msg="Executing migration" id="create query_history table v1" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.809217345Z level=info msg="Migration successfully executed" id="create query_history table v1" duration=377.346µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.80967435Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.81012298Z level=info msg="Migration successfully executed" id="add index query_history.org_id-created_by-datasource_uid" duration=448.5µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.810658923Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.810718985Z level=info msg="Migration successfully executed" id="alter table query_history alter column created_by type to bigint" duration=62.267µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.811212147Z level=info msg="Executing migration" id="rbac disabled migrator" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.811248515Z level=info msg="Migration successfully executed" id="rbac disabled migrator" duration=37.651µs 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.81166717Z level=info msg="Executing migration" id="teams permissions migration" 2026-03-09T00:32:02.931 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.81189676Z level=info msg="Migration successfully executed" id="teams permissions migration" duration=229.63µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.812340169Z level=info msg="Executing migration" id="dashboard permissions" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.812678311Z level=info msg="Migration successfully executed" id="dashboard permissions" duration=338.603µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.813179029Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.81345761Z level=info msg="Migration successfully executed" id="dashboard permissions uid scopes" duration=278.721µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.814009563Z level=info msg="Executing migration" id="drop managed folder create actions" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.814131241Z level=info msg="Migration successfully executed" id="drop managed folder create actions" duration=121.838µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.814582967Z level=info msg="Executing migration" id="alerting notification permissions" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.814850998Z level=info msg="Migration successfully executed" id="alerting notification permissions" duration=268.493µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.815340263Z level=info msg="Executing migration" id="create query_history_star table v1" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.815708833Z level=info msg="Migration successfully executed" id="create query_history_star table v1" duration=369.702µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.816283068Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.816747647Z level=info msg="Migration successfully executed" id="add index query_history.user_id-query_uid" duration=464.509µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.817307494Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.819644728Z level=info msg="Migration successfully executed" id="add column org_id in query_history_star" duration=2.338156ms 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.820107945Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.820164481Z level=info msg="Migration successfully executed" id="alter table query_history_star_mig column user_id type to bigint" duration=56.786µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.820653447Z level=info msg="Executing migration" id="create correlation table v1" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.821129998Z level=info msg="Migration successfully executed" id="create correlation table v1" duration=475.139µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.82171909Z level=info msg="Executing migration" id="add index correlations.uid" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.822188259Z level=info msg="Migration successfully executed" id="add index correlations.uid" duration=470.33µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.822713371Z level=info msg="Executing migration" id="add index correlations.source_uid" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.823196625Z level=info msg="Migration successfully executed" id="add index correlations.source_uid" duration=482.643µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.823700168Z level=info msg="Executing migration" id="add correlation config column" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.82608469Z level=info msg="Migration successfully executed" id="add correlation config column" duration=2.384291ms 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.826558898Z level=info msg="Executing migration" id="drop index IDX_correlation_uid - v1" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.827020612Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_uid - v1" duration=461.904µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.827492144Z level=info msg="Executing migration" id="drop index IDX_correlation_source_uid - v1" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.82794419Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_source_uid - v1" duration=451.835µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.828397789Z level=info msg="Executing migration" id="Rename table correlation to correlation_tmp_qwerty - v1" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.834644559Z level=info msg="Migration successfully executed" id="Rename table correlation to correlation_tmp_qwerty - v1" duration=6.242081ms 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.835349718Z level=info msg="Executing migration" id="create correlation v2" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.835940444Z level=info msg="Migration successfully executed" id="create correlation v2" duration=590.736µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.83641415Z level=info msg="Executing migration" id="create index IDX_correlation_uid - v2" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.83692141Z level=info msg="Migration successfully executed" id="create index IDX_correlation_uid - v2" duration=506.969µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.837450129Z level=info msg="Executing migration" id="create index IDX_correlation_source_uid - v2" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.837960344Z level=info msg="Migration successfully executed" id="create index IDX_correlation_source_uid - v2" duration=510.085µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.838527716Z level=info msg="Executing migration" id="create index IDX_correlation_org_id - v2" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.83906951Z level=info msg="Migration successfully executed" id="create index IDX_correlation_org_id - v2" duration=541.844µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.839603609Z level=info msg="Executing migration" id="copy correlation v1 to v2" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.839745865Z level=info msg="Migration successfully executed" id="copy correlation v1 to v2" duration=141.435µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.840233137Z level=info msg="Executing migration" id="drop correlation_tmp_qwerty" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.840616474Z level=info msg="Migration successfully executed" id="drop correlation_tmp_qwerty" duration=383.437µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.841098957Z level=info msg="Executing migration" id="add provisioning column" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.843517514Z level=info msg="Migration successfully executed" id="add provisioning column" duration=2.418206ms 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.844037997Z level=info msg="Executing migration" id="create entity_events table" 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.844408481Z level=info msg="Migration successfully executed" id="create entity_events table" duration=368.26µs 2026-03-09T00:32:02.932 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.844871308Z level=info msg="Executing migration" id="create dashboard public config v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.845306201Z level=info msg="Migration successfully executed" id="create dashboard public config v1" duration=434.804µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.84587275Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.846072143Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.846569054Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.846757798Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.847222977Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.8476201Z level=info msg="Migration successfully executed" id="Drop old dashboard public config table" duration=396.832µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.84808414Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.848517631Z level=info msg="Migration successfully executed" id="recreate dashboard public config v1" duration=432.318µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.84903591Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.849481725Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v1" duration=445.555µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.850043566Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.850538753Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" duration=496.629µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.851321447Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.851783903Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_public_config_uid - v2" duration=462.215µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.852234295Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.852731557Z level=info msg="Migration successfully executed" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=496.741µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.853245759Z level=info msg="Executing migration" id="Drop public config table" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.853640978Z level=info msg="Migration successfully executed" id="Drop public config table" duration=395.31µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.854130595Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.854589904Z level=info msg="Migration successfully executed" id="Recreate dashboard public config v2" duration=459.389µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.855043092Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.855497142Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v2" duration=453.871µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.855947184Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.856407846Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=461.974µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.85687472Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.857321696Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_access_token - v2" duration=446.916µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.857882676Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.865800122Z level=info msg="Migration successfully executed" id="Rename table dashboard_public_config to dashboard_public - v2" duration=7.912817ms 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.866560485Z level=info msg="Executing migration" id="add annotations_enabled column" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.869372267Z level=info msg="Migration successfully executed" id="add annotations_enabled column" duration=2.811031ms 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.870003168Z level=info msg="Executing migration" id="add time_selection_enabled column" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.87248896Z level=info msg="Migration successfully executed" id="add time_selection_enabled column" duration=2.4843ms 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.873090836Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.873235637Z level=info msg="Migration successfully executed" id="delete orphaned public dashboards" duration=145.011µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.873730884Z level=info msg="Executing migration" id="add share column" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.8761017Z level=info msg="Migration successfully executed" id="add share column" duration=2.370645ms 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.876575446Z level=info msg="Executing migration" id="backfill empty share column fields with default of public" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.876700772Z level=info msg="Migration successfully executed" id="backfill empty share column fields with default of public" duration=123.552µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.877236975Z level=info msg="Executing migration" id="create file table" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.877648605Z level=info msg="Migration successfully executed" id="create file table" duration=411.77µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.87818531Z level=info msg="Executing migration" id="file table idx: path natural pk" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.878641574Z level=info msg="Migration successfully executed" id="file table idx: path natural pk" duration=456.244µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.879175112Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.879654319Z level=info msg="Migration successfully executed" id="file table idx: parent_folder_path_hash fast folder retrieval" duration=479.226µs 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.880234565Z level=info msg="Executing migration" id="create file_meta table" 2026-03-09T00:32:02.933 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.88057425Z level=info msg="Migration successfully executed" id="create file_meta table" duration=339.676µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.881109191Z level=info msg="Executing migration" id="file table idx: path key" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.881558643Z level=info msg="Migration successfully executed" id="file table idx: path key" duration=449.532µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.882079838Z level=info msg="Executing migration" id="set path collation in file table" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.882124792Z level=info msg="Migration successfully executed" id="set path collation in file table" duration=45.526µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.882607746Z level=info msg="Executing migration" id="migrate contents column to mediumblob for MySQL" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.882651157Z level=info msg="Migration successfully executed" id="migrate contents column to mediumblob for MySQL" duration=43.794µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.883129973Z level=info msg="Executing migration" id="managed permissions migration" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.883390641Z level=info msg="Migration successfully executed" id="managed permissions migration" duration=260.617µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.88387091Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.883995142Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions migration" duration=123.221µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.884476383Z level=info msg="Executing migration" id="RBAC action name migrator" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.885141136Z level=info msg="Migration successfully executed" id="RBAC action name migrator" duration=665.345µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.885616797Z level=info msg="Executing migration" id="Add UID column to playlist" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.888188038Z level=info msg="Migration successfully executed" id="Add UID column to playlist" duration=2.570951ms 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.888675481Z level=info msg="Executing migration" id="Update uid column values in playlist" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.888792921Z level=info msg="Migration successfully executed" id="Update uid column values in playlist" duration=117.32µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.889376353Z level=info msg="Executing migration" id="Add index for uid in playlist" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.889969512Z level=info msg="Migration successfully executed" id="Add index for uid in playlist" duration=593.059µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.89057218Z level=info msg="Executing migration" id="update group index for alert rules" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.890767466Z level=info msg="Migration successfully executed" id="update group index for alert rules" duration=195.827µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.891248145Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.891377858Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated migration" duration=129.783µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.891820395Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.892063631Z level=info msg="Migration successfully executed" id="admin only folder/dashboard permission" duration=242.384µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.892563647Z level=info msg="Executing migration" id="add action column to seed_assignment" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.895608295Z level=info msg="Migration successfully executed" id="add action column to seed_assignment" duration=3.043446ms 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.896282846Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.900124486Z level=info msg="Migration successfully executed" id="add scope column to seed_assignment" duration=3.829707ms 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.900863979Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.901603234Z level=info msg="Migration successfully executed" id="remove unique index builtin_role_role_name before nullable update" duration=739.465µs 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.90223224Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2026-03-09T00:32:02.934 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.929456627Z level=info msg="Migration successfully executed" id="update seed_assignment role_name column to nullable" duration=27.219017ms 2026-03-09T00:32:03.180 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:02 vm09 bash[84809]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.937264449Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.939618444Z level=info msg="Migration successfully executed" id="add unique index builtin_role_name back" duration=2.372831ms 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.941790949Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.942294632Z level=info msg="Migration successfully executed" id="add unique index builtin_role_action_scope" duration=503.572µs 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.942931323Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.951025009Z level=info msg="Migration successfully executed" id="add primary key to seed_assigment" duration=8.091593ms 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.951866174Z level=info msg="Executing migration" id="add origin column to seed_assignment" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.954387943Z level=info msg="Migration successfully executed" id="add origin column to seed_assignment" duration=2.523062ms 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.954900112Z level=info msg="Executing migration" id="add origin to plugin seed_assignment" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.955082362Z level=info msg="Migration successfully executed" id="add origin to plugin seed_assignment" duration=182.382µs 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.955622594Z level=info msg="Executing migration" id="prevent seeding OnCall access" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.955774358Z level=info msg="Migration successfully executed" id="prevent seeding OnCall access" duration=151.984µs 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.956295443Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.956462485Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated fixed migration" duration=165.219µs 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.95696734Z level=info msg="Executing migration" id="managed folder permissions library panel actions migration" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.957136137Z level=info msg="Migration successfully executed" id="managed folder permissions library panel actions migration" duration=168.967µs 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.957687077Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2026-03-09T00:32:03.200 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.957869248Z level=info msg="Migration successfully executed" id="migrate external alertmanagers to datsourcse" duration=182.421µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.958401513Z level=info msg="Executing migration" id="create folder table" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.958852759Z level=info msg="Migration successfully executed" id="create folder table" duration=451.335µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.959295598Z level=info msg="Executing migration" id="Add index for parent_uid" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.959886563Z level=info msg="Migration successfully executed" id="Add index for parent_uid" duration=590.716µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.960483601Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.961031115Z level=info msg="Migration successfully executed" id="Add unique index for folder.uid and folder.org_id" duration=547.584µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.961598066Z level=info msg="Executing migration" id="Update folder title length" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.961676303Z level=info msg="Migration successfully executed" id="Update folder title length" duration=79.57µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.962271527Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.962796449Z level=info msg="Migration successfully executed" id="Add unique index for folder.title and folder.parent_uid" duration=523.209µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.963390381Z level=info msg="Executing migration" id="Remove unique index for folder.title and folder.parent_uid" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.963916294Z level=info msg="Migration successfully executed" id="Remove unique index for folder.title and folder.parent_uid" duration=525.773µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.964402323Z level=info msg="Executing migration" id="Add unique index for title, parent_uid, and org_id" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.964979544Z level=info msg="Migration successfully executed" id="Add unique index for title, parent_uid, and org_id" duration=577.07µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.965546264Z level=info msg="Executing migration" id="Sync dashboard and folder table" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.965812282Z level=info msg="Migration successfully executed" id="Sync dashboard and folder table" duration=266.189µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.966304093Z level=info msg="Executing migration" id="Remove ghost folders from the folder table" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.966491373Z level=info msg="Migration successfully executed" id="Remove ghost folders from the folder table" duration=187.421µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.967036183Z level=info msg="Executing migration" id="Remove unique index UQE_folder_uid_org_id" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.967527422Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_uid_org_id" duration=491.559µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.968429791Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_uid" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.969191356Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_uid" duration=761.634µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.969671515Z level=info msg="Executing migration" id="Remove unique index UQE_folder_title_parent_uid_org_id" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.970174736Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_title_parent_uid_org_id" duration=503.221µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.970633805Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_parent_uid_title" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.971176721Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_parent_uid_title" duration=543.248µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.971652402Z level=info msg="Executing migration" id="Remove index IDX_folder_parent_uid_org_id" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.972150493Z level=info msg="Migration successfully executed" id="Remove index IDX_folder_parent_uid_org_id" duration=498.031µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.972617838Z level=info msg="Executing migration" id="create anon_device table" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.973062009Z level=info msg="Migration successfully executed" id="create anon_device table" duration=444.732µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.973536728Z level=info msg="Executing migration" id="add unique index anon_device.device_id" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.974123095Z level=info msg="Migration successfully executed" id="add unique index anon_device.device_id" duration=586.589µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.974697059Z level=info msg="Executing migration" id="add index anon_device.updated_at" 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.975202334Z level=info msg="Migration successfully executed" id="add index anon_device.updated_at" duration=505.094µs 2026-03-09T00:32:03.201 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.976108711Z level=info msg="Executing migration" id="create signing_key table" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.976550617Z level=info msg="Migration successfully executed" id="create signing_key table" duration=441.786µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.977201556Z level=info msg="Executing migration" id="add unique index signing_key.key_id" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.977690221Z level=info msg="Migration successfully executed" id="add unique index signing_key.key_id" duration=489.656µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.978281106Z level=info msg="Executing migration" id="set legacy alert migration status in kvstore" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.978792413Z level=info msg="Migration successfully executed" id="set legacy alert migration status in kvstore" duration=511.297µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.979301004Z level=info msg="Executing migration" id="migrate record of created folders during legacy migration to kvstore" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.979486792Z level=info msg="Migration successfully executed" id="migrate record of created folders during legacy migration to kvstore" duration=186.028µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.97998244Z level=info msg="Executing migration" id="Add folder_uid for dashboard" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.982574069Z level=info msg="Migration successfully executed" id="Add folder_uid for dashboard" duration=2.591259ms 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.983087642Z level=info msg="Executing migration" id="Populate dashboard folder_uid column" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.98347165Z level=info msg="Migration successfully executed" id="Populate dashboard folder_uid column" duration=383.988µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.983988096Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.984488022Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title" duration=499.455µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.985068689Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_id_title" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.985571559Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_id_title" duration=502.84µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.98603156Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_uid_title" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.986519233Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_uid_title" duration=489.014µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.987040639Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.987563458Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" duration=522.628µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.98804076Z level=info msg="Executing migration" id="Restore index for dashboard_org_id_folder_id_title" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.988542389Z level=info msg="Migration successfully executed" id="Restore index for dashboard_org_id_folder_id_title" duration=501.819µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.989013651Z level=info msg="Executing migration" id="create sso_setting table" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.989610668Z level=info msg="Migration successfully executed" id="create sso_setting table" duration=596.736µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.990236219Z level=info msg="Executing migration" id="copy kvstore migration status to each org" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.990682534Z level=info msg="Migration successfully executed" id="copy kvstore migration status to each org" duration=446.716µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.991192117Z level=info msg="Executing migration" id="add back entry for orgid=0 migrated status" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.991371673Z level=info msg="Migration successfully executed" id="add back entry for orgid=0 migrated status" duration=180.709µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.991959493Z level=info msg="Executing migration" id="alter kv_store.value to longtext" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.992056245Z level=info msg="Migration successfully executed" id="alter kv_store.value to longtext" duration=97.132µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.992616253Z level=info msg="Executing migration" id="add notification_settings column to alert_rule table" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.995277242Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule table" duration=2.660639ms 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.995853621Z level=info msg="Executing migration" id="add notification_settings column to alert_rule_version table" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.998441615Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule_version table" duration=2.588043ms 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.998993146Z level=info msg="Executing migration" id="removing scope from alert.instances:read action migration" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.999217095Z level=info msg="Migration successfully executed" id="removing scope from alert.instances:read action migration" duration=224.14µs 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:02 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=migrator t=2026-03-09T00:32:02.999727601Z level=info msg="migrations completed" performed=547 skipped=0 duration=710.401315ms 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=sqlstore t=2026-03-09T00:32:03.000372147Z level=info msg="Created default organization" 2026-03-09T00:32:03.202 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=secrets t=2026-03-09T00:32:03.001046529Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=plugin.store t=2026-03-09T00:32:03.00869879Z level=info msg="Loading plugins..." 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=local.finder t=2026-03-09T00:32:03.04453977Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=plugin.store t=2026-03-09T00:32:03.044772205Z level=info msg="Plugins loaded" count=55 duration=36.073516ms 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=query_data t=2026-03-09T00:32:03.049159045Z level=info msg="Query Service initialization" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=live.push_http t=2026-03-09T00:32:03.053175912Z level=info msg="Live Push Gateway initialization" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.migration t=2026-03-09T00:32:03.054208596Z level=info msg=Starting 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.migration t=2026-03-09T00:32:03.054389033Z level=info msg="Applying transition" currentType=Legacy desiredType=UnifiedAlerting cleanOnDowngrade=false cleanOnUpgrade=false 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.migration orgID=1 t=2026-03-09T00:32:03.054548191Z level=info msg="Migrating alerts for organisation" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.migration orgID=1 t=2026-03-09T00:32:03.054846919Z level=info msg="Alerts found to migrate" alerts=0 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.migration t=2026-03-09T00:32:03.055503137Z level=info msg="Completed alerting migration" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.state.manager t=2026-03-09T00:32:03.062270482Z level=info msg="Running in alternative execution of Error/NoData mode" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=infra.usagestats.collector t=2026-03-09T00:32:03.063150237Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=provisioning.datasources t=2026-03-09T00:32:03.064385068Z level=info msg="inserting datasource from configuration" name=Dashboard1 uid=P43CA22E17D0F9596 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=provisioning.datasources t=2026-03-09T00:32:03.069266053Z level=info msg="inserting datasource from configuration" name=Loki uid=P8E80F9AEF21F6940 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=provisioning.alerting t=2026-03-09T00:32:03.073958163Z level=info msg="starting to provision alerting" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=provisioning.alerting t=2026-03-09T00:32:03.074057981Z level=info msg="finished to provision alerting" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=http.server t=2026-03-09T00:32:03.075177976Z level=info msg="HTTP Server TLS settings" MinTLSVersion=TLS1.2 configuredciphers=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=http.server t=2026-03-09T00:32:03.075428164Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.state.manager t=2026-03-09T00:32:03.07545847Z level=info msg="Warming state cache for startup" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.state.manager t=2026-03-09T00:32:03.075594036Z level=info msg="State cache has been initialized" states=0 duration=135.374µs 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=grafanaStorageLogger t=2026-03-09T00:32:03.082468139Z level=info msg="Storage starting" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.multiorg.alertmanager t=2026-03-09T00:32:03.082862687Z level=info msg="Starting MultiOrg Alertmanager" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ngalert.scheduler t=2026-03-09T00:32:03.082872545Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=ticker t=2026-03-09T00:32:03.085946428Z level=info msg=starting first_tick=2026-03-09T00:32:10Z 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=provisioning.dashboard t=2026-03-09T00:32:03.096067298Z level=info msg="starting to provision dashboards" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=sqlstore.transactions t=2026-03-09T00:32:03.11216857Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2026-03-09T00:32:03.203 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=plugins.update.checker t=2026-03-09T00:32:03.166173563Z level=info msg="Update check succeeded" duration=84.326475ms 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[49458]: Deploying daemon node-exporter.a on vm09 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:03 vm09 ceph-mon[56118]: Deploying daemon node-exporter.a on vm09 2026-03-09T00:32:03.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:03 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:03 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:03 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:03 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:03.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:03 vm11 ceph-mon[53379]: Deploying daemon node-exporter.a on vm09 2026-03-09T00:32:03.700 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=provisioning.dashboard t=2026-03-09T00:32:03.207076247Z level=info msg="finished to provision dashboards" 2026-03-09T00:32:03.700 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=grafana-apiserver t=2026-03-09T00:32:03.421791669Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" 2026-03-09T00:32:03.700 INFO:journalctl@ceph.grafana.a.vm11.stdout:Mar 09 00:32:03 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-grafana-a[79663]: logger=grafana-apiserver t=2026-03-09T00:32:03.422032691Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" 2026-03-09T00:32:04.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:04 vm09 ceph-mon[56118]: pgmap v10: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2026-03-09T00:32:04.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:04 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:04.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:04 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:32:04.680 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:04 vm09 bash[84809]: Getting image source signatures 2026-03-09T00:32:04.680 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:04 vm09 bash[84809]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2026-03-09T00:32:04.680 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:04 vm09 bash[84809]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2026-03-09T00:32:04.680 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:04 vm09 bash[84809]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2026-03-09T00:32:04.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:04 vm09 ceph-mon[49458]: pgmap v10: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2026-03-09T00:32:04.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:04 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:04.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:04 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:32:04.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:04 vm11 ceph-mon[53379]: pgmap v10: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2026-03-09T00:32:04.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:04 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:04.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:04 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:32:05.431 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:04 vm09 bash[84809]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:04 vm09 bash[84809]: Writing manifest to image destination 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 podman[84809]: 2026-03-09 00:32:05.002735723 +0000 UTC m=+2.109174741 container create 1d11f1ccf958a9f135ee2a67f230ec389681a52d790352e1d80398ded0eccfad (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 podman[84809]: 2026-03-09 00:32:04.995441561 +0000 UTC m=+2.101880589 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 podman[84809]: 2026-03-09 00:32:05.029743692 +0000 UTC m=+2.136182721 container init 1d11f1ccf958a9f135ee2a67f230ec389681a52d790352e1d80398ded0eccfad (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 podman[84809]: 2026-03-09 00:32:05.032410755 +0000 UTC m=+2.138849773 container start 1d11f1ccf958a9f135ee2a67f230ec389681a52d790352e1d80398ded0eccfad (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 bash[84809]: 1d11f1ccf958a9f135ee2a67f230ec389681a52d790352e1d80398ded0eccfad 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 systemd[1]: Started Ceph node-exporter.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.039Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.039Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.040Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.040Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.040Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.040Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=arp 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=bcache 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=bonding 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=btrfs 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=conntrack 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=cpu 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=cpufreq 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=diskstats 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=dmi 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=edac 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=entropy 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=fibrechannel 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=filefd 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=filesystem 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=hwmon 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=infiniband 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=ipvs 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=loadavg 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=mdadm 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=meminfo 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=netclass 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=netdev 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=netstat 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=nfs 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=nfsd 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=nvme 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=os 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=pressure 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=rapl 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=schedstat 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=selinux 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=sockstat 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=softnet 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=stat 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=tapestats 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=textfile 2026-03-09T00:32:05.432 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=thermal_zone 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=time 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=udp_queues 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=uname 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=vmstat 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=xfs 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=node_exporter.go:117 level=info collector=zfs 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2026-03-09T00:32:05.433 INFO:journalctl@ceph.node-exporter.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-a[84865]: ts=2026-03-09T00:32:05.041Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2026-03-09T00:32:05.791 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:05 vm11 systemd[1]: Starting Ceph node-exporter.b for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:32:06.180 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:05 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[84597]: ts=2026-03-09T00:32:05.692Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003200247s 2026-03-09T00:32:06.200 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:05 vm11 bash[79871]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[56118]: pgmap v11: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[56118]: Deploying daemon node-exporter.b on vm11 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[49458]: pgmap v11: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:06 vm09 ceph-mon[49458]: Deploying daemon node-exporter.b on vm11 2026-03-09T00:32:06.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:06 vm11 ceph-mon[53379]: pgmap v11: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2026-03-09T00:32:06.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:06 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:06 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:06 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:06.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:06 vm11 ceph-mon[53379]: Deploying daemon node-exporter.b on vm11 2026-03-09T00:32:07.450 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: Getting image source signatures 2026-03-09T00:32:07.450 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2026-03-09T00:32:07.450 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2026-03-09T00:32:07.450 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2026-03-09T00:32:07.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:07 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ::ffff:192.168.123.111 - - [09/Mar/2026:00:32:07] "GET /metrics HTTP/1.1" 503 1621 "" "Prometheus/2.51.0" 2026-03-09T00:32:08.200 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: Writing manifest to image destination 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 podman[79871]: 2026-03-09 00:32:07.788933935 +0000 UTC m=+1.913817055 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 podman[79871]: 2026-03-09 00:32:07.795152312 +0000 UTC m=+1.920035421 container create 575accc1fcf0c6462717ad72396abe733b02d23da25fe6972aea5ff90e0311af (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b, maintainer=The Prometheus Authors ) 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 podman[79871]: 2026-03-09 00:32:07.819157605 +0000 UTC m=+1.944040724 container init 575accc1fcf0c6462717ad72396abe733b02d23da25fe6972aea5ff90e0311af (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b, maintainer=The Prometheus Authors ) 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 podman[79871]: 2026-03-09 00:32:07.82174652 +0000 UTC m=+1.946629619 container start 575accc1fcf0c6462717ad72396abe733b02d23da25fe6972aea5ff90e0311af (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b, maintainer=The Prometheus Authors ) 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 bash[79871]: 575accc1fcf0c6462717ad72396abe733b02d23da25fe6972aea5ff90e0311af 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.825Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 systemd[1]: Started Ceph node-exporter.b for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.826Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.828Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.828Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.828Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.828Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=arp 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=bcache 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=bonding 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=btrfs 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=conntrack 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=cpu 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=cpufreq 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=diskstats 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=dmi 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=edac 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=entropy 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=fibrechannel 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=filefd 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=filesystem 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=hwmon 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=infiniband 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=ipvs 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=loadavg 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=mdadm 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=meminfo 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=netclass 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=netdev 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=netstat 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=nfs 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=nfsd 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=nvme 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=os 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=pressure 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.829Z caller=node_exporter.go:117 level=info collector=rapl 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=schedstat 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=selinux 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=sockstat 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=softnet 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=stat 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=tapestats 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=textfile 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=thermal_zone 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=time 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=udp_queues 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=uname 2026-03-09T00:32:08.201 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=vmstat 2026-03-09T00:32:08.202 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=xfs 2026-03-09T00:32:08.202 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=node_exporter.go:117 level=info collector=zfs 2026-03-09T00:32:08.202 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2026-03-09T00:32:08.202 INFO:journalctl@ceph.node-exporter.b.vm11.stdout:Mar 09 00:32:07 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-node-exporter-b[79926]: ts=2026-03-09T00:32:07.830Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2026-03-09T00:32:08.522 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: pgmap v12: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2026-03-09T00:32:08.523 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.523 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.523 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.523 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.523 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.523 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:08 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: pgmap v12: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: pgmap v12: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:08.681 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:08 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:32:09.606 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 systemd[1]: Stopping Ceph alertmanager.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[84597]: ts=2026-03-09T00:32:09.607Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85362]: 2026-03-09 00:32:09.62129333 +0000 UTC m=+0.031845867 container died 9d4a7ccc91d4e981cc66233065adf55c8859848e23cb224069ee9245b6b6766d (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85362]: 2026-03-09 00:32:09.641215938 +0000 UTC m=+0.051768475 container remove 9d4a7ccc91d4e981cc66233065adf55c8859848e23cb224069ee9245b6b6766d (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85362]: 2026-03-09 00:32:09.64215244 +0000 UTC m=+0.052704968 volume remove 508148f2ffba45455d846f05d28b8028e04fdee0f80f4e95c8c54e669cfdf90d 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 bash[85362]: ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 systemd[1]: ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@alertmanager.a.service: Deactivated successfully. 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 systemd[1]: Stopped Ceph alertmanager.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 systemd[1]: Starting Ceph alertmanager.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:32:09.872 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85430]: 2026-03-09 00:32:09.873155391 +0000 UTC m=+0.052682816 volume create db7839bb22a0bc9c511e9f394e4dc0a6a077a17c1e4a82e96161059d1fe84071 2026-03-09T00:32:10.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: pgmap v13: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: Reconfiguring alertmanager.a (dependencies changed)... 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[49458]: Reconfiguring daemon alertmanager.a on vm09 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: pgmap v13: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: Reconfiguring alertmanager.a (dependencies changed)... 2026-03-09T00:32:10.181 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:09 vm09 ceph-mon[56118]: Reconfiguring daemon alertmanager.a on vm09 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85430]: 2026-03-09 00:32:09.876182938 +0000 UTC m=+0.055710352 container create e3083350fa8e621454f065371a417cb2999db13b9f95ef886385848e6fc3b323 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85430]: 2026-03-09 00:32:09.908959524 +0000 UTC m=+0.088486959 container init e3083350fa8e621454f065371a417cb2999db13b9f95ef886385848e6fc3b323 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85430]: 2026-03-09 00:32:09.911716485 +0000 UTC m=+0.091243910 container start e3083350fa8e621454f065371a417cb2999db13b9f95ef886385848e6fc3b323 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 bash[85430]: e3083350fa8e621454f065371a417cb2999db13b9f95ef886385848e6fc3b323 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 podman[85430]: 2026-03-09 00:32:09.831169668 +0000 UTC m=+0.010697082 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 systemd[1]: Started Ceph alertmanager.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.933Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.933Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.934Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=192.168.123.109 port=9094 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.941Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.976Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.976Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2026-03-09T00:32:10.181 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.980Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2026-03-09T00:32:10.182 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:09 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:09.980Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: pgmap v13: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: Reconfiguring alertmanager.a (dependencies changed)... 2026-03-09T00:32:10.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:09 vm11 ceph-mon[53379]: Reconfiguring daemon alertmanager.a on vm09 2026-03-09T00:32:10.200 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:32:09 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug there is no tcmu-runner data available 2026-03-09T00:32:10.567 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 systemd[1]: Stopping Ceph prometheus.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.568Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.570Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.571Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.571Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[78144]: ts=2026-03-09T00:32:10.571Z caller=main.go:1273 level=info msg="See you next time!" 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 podman[80475]: 2026-03-09 00:32:10.581149859 +0000 UTC m=+0.027035765 container died 6cb7dc1741fd70b7b903da6d2e8378ec4b59e2cf1378b13fd334c6f29542fbaa (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 podman[80475]: 2026-03-09 00:32:10.59970875 +0000 UTC m=+0.045594656 container remove 6cb7dc1741fd70b7b903da6d2e8378ec4b59e2cf1378b13fd334c6f29542fbaa (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 bash[80475]: ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 systemd[1]: ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1@prometheus.a.service: Deactivated successfully. 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 systemd[1]: Stopped Ceph prometheus.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 systemd[1]: Starting Ceph prometheus.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1... 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 podman[80543]: 2026-03-09 00:32:10.771019886 +0000 UTC m=+0.019614927 container create dd060d7cea0265b08a727de99fd78a2f6beb0ff1a5e67eeca7a1b8a40beb39ca (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 podman[80543]: 2026-03-09 00:32:10.801222566 +0000 UTC m=+0.049817607 container init dd060d7cea0265b08a727de99fd78a2f6beb0ff1a5e67eeca7a1b8a40beb39ca (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 podman[80543]: 2026-03-09 00:32:10.804359076 +0000 UTC m=+0.052954107 container start dd060d7cea0265b08a727de99fd78a2f6beb0ff1a5e67eeca7a1b8a40beb39ca (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 bash[80543]: dd060d7cea0265b08a727de99fd78a2f6beb0ff1a5e67eeca7a1b8a40beb39ca 2026-03-09T00:32:10.831 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 podman[80543]: 2026-03-09 00:32:10.762133467 +0000 UTC m=+0.010728508 image pull 1d3b7f56885b6dd623f1785be963aa9c195f86bc256ea454e8d02a7980b79c53 quay.io/prometheus/prometheus:v2.51.0 2026-03-09T00:32:10.832 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 systemd[1]: Started Ceph prometheus.a for c172d940-1b4e-11f1-be3e-fb1b568ebce1. 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: Reconfiguring prometheus.a (dependencies changed)... 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: Reconfiguring daemon prometheus.a on vm11 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm09.local:9093"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://vm11.local:9095"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm11.local:3000"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:10 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:10] ENGINE Bus STOPPING 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STOPPED 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STARTING 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Serving on http://:::9283 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STARTED 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STOPPING 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: Reconfiguring prometheus.a (dependencies changed)... 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: Reconfiguring daemon prometheus.a on vm11 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm09.local:9093"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://vm11.local:9095"}]: dispatch 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.173 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-09T00:32:11.174 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm11.local:3000"}]: dispatch 2026-03-09T00:32:11.174 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.174 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:10 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: Reconfiguring prometheus.a (dependencies changed)... 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: Reconfiguring daemon prometheus.a on vm11 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm09.local:9093"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://vm11.local:9095"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm11.local:3000"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:11.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:10 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:32:11.200 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.833Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2026-03-09T00:32:11.200 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.833Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2026-03-09T00:32:11.200 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.833Z caller=main.go:623 level=info host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 vm11 (none))" 2026-03-09T00:32:11.200 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.833Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2026-03-09T00:32:11.200 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.833Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2026-03-09T00:32:11.200 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.836Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.840Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.840Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.840Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.841Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.841Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.673µs 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.841Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.841Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.842Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.842Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=18.304µs wal_replay_duration=323.896µs wbl_replay_duration=120ns total_replay_duration=430.265µs 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.843Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.843Z caller=main.go:1153 level=info msg="TSDB started" 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.843Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.854Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=10.41464ms db_storage=821ns remote_storage=1.333µs web_handler=140ns query_engine=592ns scrape=2.017605ms scrape_sd=68.558µs notify=7.334µs notify_sd=4.849µs rules=7.950508ms tracing=5.09µs 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.854Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2026-03-09T00:32:11.201 INFO:journalctl@ceph.prometheus.a.vm11.stdout:Mar 09 00:32:10 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-prometheus-a[80553]: ts=2026-03-09T00:32:10.854Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2026-03-09T00:32:11.930 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-03-09T00:32:11.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STOPPED 2026-03-09T00:32:11.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STARTING 2026-03-09T00:32:11.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Serving on http://:::9283 2026-03-09T00:32:11.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STARTED 2026-03-09T00:32:11.931 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:11] ENGINE Bus STOPPING 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: pgmap v14: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm09.local:9093"}]: dispatch 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://vm11.local:9095"}]: dispatch 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-09T00:32:12.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:11 vm11 ceph-mon[53379]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm11.local:3000"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: pgmap v14: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm09.local:9093"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://vm11.local:9095"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[56118]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm11.local:3000"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:11.942Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000695603s 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:12] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:12] ENGINE Bus STOPPED 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:12] ENGINE Bus STARTING 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: pgmap v14: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm09.local:9093"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://vm11.local:9095"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-09T00:32:12.289 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:11 vm09 ceph-mon[49458]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm11.local:3000"}]: dispatch 2026-03-09T00:32:12.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:12] ENGINE Serving on http://:::9283 2026-03-09T00:32:12.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:12 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: [09/Mar/2026:00:32:12] ENGINE Bus STARTED 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[49458]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:32:13.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:13 vm09 ceph-mon[56118]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:32:13.450 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:13 vm11 ceph-mon[53379]: from='mgr.14604 ' entity='mgr.y' 2026-03-09T00:32:14.430 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:14 vm09 ceph-mon[56118]: pgmap v15: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:14.430 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:14 vm09 ceph-mon[49458]: pgmap v15: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:14.449 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:14 vm11 ceph-mon[53379]: pgmap v15: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:16.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:16 vm09 ceph-mon[56118]: pgmap v16: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:16.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:16 vm09 ceph-mon[49458]: pgmap v16: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:16.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:16 vm11 ceph-mon[53379]: pgmap v16: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:17.680 INFO:journalctl@ceph.mgr.y.vm09.stdout:Mar 09 00:32:17 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-mgr-y[49665]: ::ffff:192.168.123.111 - - [09/Mar/2026:00:32:17] "GET /metrics HTTP/1.1" 503 1621 "" "Prometheus/2.51.0" 2026-03-09T00:32:18.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:18 vm09 ceph-mon[56118]: pgmap v17: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:18.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:18 vm09 ceph-mon[49458]: pgmap v17: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:18.699 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:18 vm11 ceph-mon[53379]: pgmap v17: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:19.680 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:19 vm09 ceph-mon[56118]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:32:19.680 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:19 vm09 ceph-mon[49458]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:32:19.700 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:19 vm11 ceph-mon[53379]: from='mgr.14604 192.168.123.109:0/2767697986' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T00:32:20.200 INFO:journalctl@ceph.iscsi.iscsi.a.vm11.stdout:Mar 09 00:32:19 vm11 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-iscsi-iscsi-a[77602]: debug there is no tcmu-runner data available 2026-03-09T00:32:20.430 INFO:journalctl@ceph.alertmanager.a.vm09.stdout:Mar 09 00:32:19 vm09 ceph-c172d940-1b4e-11f1-be3e-fb1b568ebce1-alertmanager-a[85442]: ts=2026-03-09T00:32:19.945Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003825978s 2026-03-09T00:32:21.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:20 vm09 ceph-mon[49458]: pgmap v18: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:21.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:20 vm09 ceph-mon[56118]: pgmap v18: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:21.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:20 vm11 ceph-mon[53379]: pgmap v18: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:22.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:21 vm09 ceph-mon[56118]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:22.180 INFO:journalctl@ceph.mon.c.vm09.stdout:Mar 09 00:32:21 vm09 ceph-mon[56118]: pgmap v19: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:22.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:21 vm09 ceph-mon[49458]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:22.180 INFO:journalctl@ceph.mon.a.vm09.stdout:Mar 09 00:32:21 vm09 ceph-mon[49458]: pgmap v19: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:22.199 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:21 vm11 ceph-mon[53379]: from='client.24433 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:22.200 INFO:journalctl@ceph.mon.b.vm11.stdout:Mar 09 00:32:21 vm11 ceph-mon[53379]: pgmap v19: 132 pgs: 132 active+clean; 455 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:22.384 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2026-03-09T00:32:22.384 DEBUG:teuthology.exit:Finished running handlers