2026-03-08T23:19:09.055 INFO:root:teuthology version: 1.2.4.dev6+g1c580df7a 2026-03-08T23:19:09.058 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-08T23:19:09.083 INFO:teuthology.run:Config: archive_path: /archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/298 branch: squid description: orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} email: null first_in_suite: false flavor: default job_id: '298' last_in_suite: false machine_type: vps name: kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ansible.cephlab: branch: main skip_tags: nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs vars: timezone: UTC ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd mclock iops capacity threshold hdd: 49000 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - OSD_DOWN log-only-match: - CEPHADM_ sha1: e911bdebe5c8faa3800735d1568fcdca65db60df ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e911bdebe5c8faa3800735d1568fcdca65db60df extra_system_packages: deb: - python3-xmltodict - python3-jmespath rpm: - bzip2 - perl-Test-Harness - python3-xmltodict - python3-jmespath selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: tt-squid sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 owner: kyr priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 seed: 8017 sha1: e911bdebe5c8faa3800735d1568fcdca65db60df sleep_before_teardown: 0 subset: 1/64 suite: orch:cephadm suite_branch: tt-squid suite_path: /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa suite_relpath: qa suite_repo: https://github.com/kshtsk/ceph.git suite_sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 targets: vm05.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGWmmkUTnqg7esbvGgphNlaEB512THSPhM373kpuw/s9R1FFqMhih4440s4DIebAe50vp8TGjE/I12K2g02BJI= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - cephadm: roleless: true single_host_defaults: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: clyso-debian-13 teuthology_repo: https://github.com/clyso/teuthology teuthology_sha1: 1c580df7a9c7c2aadc272da296344fd99f27c444 timestamp: 2026-03-08_22:22:45 tube: vps user: kyr verbose: false worker_log: /home/teuthos/.teuthology/dispatcher/dispatcher.vps.611473 2026-03-08T23:19:09.084 INFO:teuthology.run:suite_path is set to /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa; will attempt to use it 2026-03-08T23:19:09.084 INFO:teuthology.run:Found tasks at /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa/tasks 2026-03-08T23:19:09.084 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-03-08T23:19:09.085 INFO:teuthology.task.internal:Checking packages... 2026-03-08T23:19:09.085 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e911bdebe5c8faa3800735d1568fcdca65db60df' 2026-03-08T23:19:09.085 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-03-08T23:19:09.085 INFO:teuthology.packaging:ref: None 2026-03-08T23:19:09.085 INFO:teuthology.packaging:tag: None 2026-03-08T23:19:09.085 INFO:teuthology.packaging:branch: squid 2026-03-08T23:19:09.085 INFO:teuthology.packaging:sha1: e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-08T23:19:09.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-03-08T23:19:09.794 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-678.ge911bdeb 2026-03-08T23:19:09.795 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-03-08T23:19:09.796 INFO:teuthology.task.internal:no buildpackages task found 2026-03-08T23:19:09.796 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-03-08T23:19:09.797 INFO:teuthology.task.internal:Saving configuration 2026-03-08T23:19:09.800 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-03-08T23:19:09.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-03-08T23:19:09.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm05.local', 'description': '/archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/298', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-08 23:18:26.729484', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:05', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGWmmkUTnqg7esbvGgphNlaEB512THSPhM373kpuw/s9R1FFqMhih4440s4DIebAe50vp8TGjE/I12K2g02BJI='} 2026-03-08T23:19:09.808 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-03-08T23:19:09.808 INFO:teuthology.task.internal:roles: ubuntu@vm05.local - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-03-08T23:19:09.808 INFO:teuthology.run_tasks:Running task console_log... 2026-03-08T23:19:09.815 DEBUG:teuthology.task.console_log:vm05 does not support IPMI; excluding 2026-03-08T23:19:09.816 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8245d9cd30>, signals=[15]) 2026-03-08T23:19:09.816 INFO:teuthology.run_tasks:Running task internal.connect... 2026-03-08T23:19:09.817 INFO:teuthology.task.internal:Opening connections... 2026-03-08T23:19:09.817 DEBUG:teuthology.task.internal:connecting to ubuntu@vm05.local 2026-03-08T23:19:09.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm05.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-08T23:19:09.876 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-03-08T23:19:09.877 DEBUG:teuthology.orchestra.run.vm05:> uname -m 2026-03-08T23:19:10.024 INFO:teuthology.orchestra.run.vm05.stdout:x86_64 2026-03-08T23:19:10.025 DEBUG:teuthology.orchestra.run.vm05:> cat /etc/os-release 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:NAME="CentOS Stream" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:VERSION="9" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:ID="centos" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:ID_LIKE="rhel fedora" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:VERSION_ID="9" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:PLATFORM_ID="platform:el9" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:ANSI_COLOR="0;31" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:LOGO="fedora-logo-icon" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:HOME_URL="https://centos.org/" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-08T23:19:10.079 INFO:teuthology.orchestra.run.vm05.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-08T23:19:10.079 INFO:teuthology.lock.ops:Updating vm05.local on lock server 2026-03-08T23:19:10.084 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-03-08T23:19:10.086 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-03-08T23:19:10.087 INFO:teuthology.task.internal:Checking for old test directory... 2026-03-08T23:19:10.087 DEBUG:teuthology.orchestra.run.vm05:> test '!' -e /home/ubuntu/cephtest 2026-03-08T23:19:10.133 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-03-08T23:19:10.134 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-03-08T23:19:10.134 DEBUG:teuthology.orchestra.run.vm05:> test -z $(ls -A /var/lib/ceph) 2026-03-08T23:19:10.187 INFO:teuthology.orchestra.run.vm05.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-08T23:19:10.188 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-03-08T23:19:10.195 DEBUG:teuthology.orchestra.run.vm05:> test -e /ceph-qa-ready 2026-03-08T23:19:10.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-08T23:19:10.425 INFO:teuthology.run_tasks:Running task internal.base... 2026-03-08T23:19:10.426 INFO:teuthology.task.internal:Creating test directory... 2026-03-08T23:19:10.426 DEBUG:teuthology.orchestra.run.vm05:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-08T23:19:10.442 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-03-08T23:19:10.443 INFO:teuthology.run_tasks:Running task internal.archive... 2026-03-08T23:19:10.444 INFO:teuthology.task.internal:Creating archive directory... 2026-03-08T23:19:10.444 DEBUG:teuthology.orchestra.run.vm05:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-08T23:19:10.503 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-03-08T23:19:10.504 INFO:teuthology.task.internal:Enabling coredump saving... 2026-03-08T23:19:10.504 DEBUG:teuthology.orchestra.run.vm05:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-08T23:19:10.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-08T23:19:10.559 DEBUG:teuthology.orchestra.run.vm05:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-08T23:19:10.627 INFO:teuthology.orchestra.run.vm05.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-08T23:19:10.637 INFO:teuthology.orchestra.run.vm05.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-08T23:19:10.638 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-03-08T23:19:10.640 INFO:teuthology.task.internal:Configuring sudo... 2026-03-08T23:19:10.640 DEBUG:teuthology.orchestra.run.vm05:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-08T23:19:10.706 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-03-08T23:19:10.708 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-03-08T23:19:10.709 DEBUG:teuthology.orchestra.run.vm05:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-08T23:19:10.765 DEBUG:teuthology.orchestra.run.vm05:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-08T23:19:10.831 DEBUG:teuthology.orchestra.run.vm05:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-08T23:19:10.892 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:19:10.892 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-08T23:19:10.955 DEBUG:teuthology.orchestra.run.vm05:> sudo service rsyslog restart 2026-03-08T23:19:11.030 INFO:teuthology.orchestra.run.vm05.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-08T23:19:11.380 INFO:teuthology.run_tasks:Running task internal.timer... 2026-03-08T23:19:11.382 INFO:teuthology.task.internal:Starting timer... 2026-03-08T23:19:11.382 INFO:teuthology.run_tasks:Running task pcp... 2026-03-08T23:19:11.384 INFO:teuthology.run_tasks:Running task selinux... 2026-03-08T23:19:11.387 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-03-08T23:19:11.387 INFO:teuthology.task.selinux:Excluding vm05: VMs are not yet supported 2026-03-08T23:19:11.387 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-03-08T23:19:11.387 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-03-08T23:19:11.387 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-03-08T23:19:11.387 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-03-08T23:19:11.389 DEBUG:teuthology.task:Applying overrides for task ansible.cephlab: {'branch': 'main', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'UTC'}} 2026-03-08T23:19:11.389 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph-cm-ansible.git 2026-03-08T23:19:11.391 INFO:teuthology.repo_utils:Fetching github.com_ceph_ceph-cm-ansible_main from origin 2026-03-08T23:19:11.851 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main to origin/main 2026-03-08T23:19:11.856 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-03-08T23:19:11.856 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu", "timezone": "UTC"}' -i /tmp/teuth_ansible_inventory1t_e2m5a --limit vm05.local /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main/cephlab.yml --skip-tags nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs 2026-03-08T23:21:14.609 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@vm05.local')] 2026-03-08T23:21:14.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm05.local' 2026-03-08T23:21:14.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm05.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-08T23:21:14.675 DEBUG:teuthology.orchestra.run.vm05:> true 2026-03-08T23:21:14.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm05.local' 2026-03-08T23:21:14.749 INFO:teuthology.run_tasks:Running task clock... 2026-03-08T23:21:14.751 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-03-08T23:21:14.751 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-08T23:21:14.751 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-08T23:21:14.819 INFO:teuthology.orchestra.run.vm05.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-08T23:21:14.835 INFO:teuthology.orchestra.run.vm05.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-08T23:21:14.863 INFO:teuthology.orchestra.run.vm05.stderr:sudo: ntpd: command not found 2026-03-08T23:21:14.878 INFO:teuthology.orchestra.run.vm05.stdout:506 Cannot talk to daemon 2026-03-08T23:21:14.893 INFO:teuthology.orchestra.run.vm05.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-08T23:21:14.908 INFO:teuthology.orchestra.run.vm05.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-08T23:21:14.954 INFO:teuthology.orchestra.run.vm05.stderr:bash: line 1: ntpq: command not found 2026-03-08T23:21:14.956 INFO:teuthology.orchestra.run.vm05.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-08T23:21:14.956 INFO:teuthology.orchestra.run.vm05.stdout:=============================================================================== 2026-03-08T23:21:14.956 INFO:teuthology.run_tasks:Running task pexec... 2026-03-08T23:21:14.959 INFO:teuthology.task.pexec:Executing custom commands... 2026-03-08T23:21:14.959 DEBUG:teuthology.orchestra.run.vm05:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-08T23:21:14.998 DEBUG:teuthology.task.pexec:ubuntu@vm05.local< sudo dnf remove nvme-cli -y 2026-03-08T23:21:14.998 DEBUG:teuthology.task.pexec:ubuntu@vm05.local< sudo dnf install nvmetcli nvme-cli -y 2026-03-08T23:21:14.998 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm05.local 2026-03-08T23:21:14.999 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-08T23:21:14.999 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-03-08T23:21:15.216 INFO:teuthology.orchestra.run.vm05.stdout:No match for argument: nvme-cli 2026-03-08T23:21:15.216 INFO:teuthology.orchestra.run.vm05.stderr:No packages marked for removal. 2026-03-08T23:21:15.218 INFO:teuthology.orchestra.run.vm05.stdout:Dependencies resolved. 2026-03-08T23:21:15.219 INFO:teuthology.orchestra.run.vm05.stdout:Nothing to do. 2026-03-08T23:21:15.219 INFO:teuthology.orchestra.run.vm05.stdout:Complete! 2026-03-08T23:21:15.682 INFO:teuthology.orchestra.run.vm05.stdout:Last metadata expiration check: 0:01:20 ago on Sun 08 Mar 2026 11:19:55 PM UTC. 2026-03-08T23:21:15.807 INFO:teuthology.orchestra.run.vm05.stdout:Dependencies resolved. 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:================================================================================ 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: Package Architecture Version Repository Size 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:================================================================================ 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:Installing: 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:Installing dependencies: 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:Transaction Summary 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:================================================================================ 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout:Install 6 Packages 2026-03-08T23:21:15.808 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:21:15.810 INFO:teuthology.orchestra.run.vm05.stdout:Total download size: 2.3 M 2026-03-08T23:21:15.811 INFO:teuthology.orchestra.run.vm05.stdout:Installed size: 11 M 2026-03-08T23:21:15.811 INFO:teuthology.orchestra.run.vm05.stdout:Downloading Packages: 2026-03-08T23:21:16.746 INFO:teuthology.orchestra.run.vm05.stdout:(1/6): python3-configshell-1.1.30-1.el9.noarch. 179 kB/s | 72 kB 00:00 2026-03-08T23:21:16.770 INFO:teuthology.orchestra.run.vm05.stdout:(2/6): nvmetcli-0.8-3.el9.noarch.rpm 103 kB/s | 44 kB 00:00 2026-03-08T23:21:16.796 INFO:teuthology.orchestra.run.vm05.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.7 MB/s | 84 kB 00:00 2026-03-08T23:21:16.821 INFO:teuthology.orchestra.run.vm05.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.9 MB/s | 150 kB 00:00 2026-03-08T23:21:16.836 INFO:teuthology.orchestra.run.vm05.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 2.3 MB/s | 1.2 MB 00:00 2026-03-08T23:21:16.899 INFO:teuthology.orchestra.run.vm05.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 8.1 MB/s | 837 kB 00:00 2026-03-08T23:21:16.900 INFO:teuthology.orchestra.run.vm05.stdout:-------------------------------------------------------------------------------- 2026-03-08T23:21:16.900 INFO:teuthology.orchestra.run.vm05.stdout:Total 2.1 MB/s | 2.3 MB 00:01 2026-03-08T23:21:16.969 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction check 2026-03-08T23:21:16.975 INFO:teuthology.orchestra.run.vm05.stdout:Transaction check succeeded. 2026-03-08T23:21:16.976 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction test 2026-03-08T23:21:17.039 INFO:teuthology.orchestra.run.vm05.stdout:Transaction test succeeded. 2026-03-08T23:21:17.039 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction 2026-03-08T23:21:17.226 INFO:teuthology.orchestra.run.vm05.stdout: Preparing : 1/1 2026-03-08T23:21:17.235 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-03-08T23:21:17.249 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-03-08T23:21:17.259 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-08T23:21:17.268 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-08T23:21:17.270 INFO:teuthology.orchestra.run.vm05.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-03-08T23:21:17.456 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-03-08T23:21:17.460 INFO:teuthology.orchestra.run.vm05.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-08T23:21:17.890 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-08T23:21:17.890 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-08T23:21:17.890 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:21:18.451 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-03-08T23:21:18.451 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-03-08T23:21:18.451 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-08T23:21:18.452 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-08T23:21:18.452 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout:Installed: 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:21:18.553 INFO:teuthology.orchestra.run.vm05.stdout:Complete! 2026-03-08T23:21:18.611 DEBUG:teuthology.parallel:result is None 2026-03-08T23:21:18.611 INFO:teuthology.run_tasks:Running task cephadm... 2026-03-08T23:21:18.665 INFO:tasks.cephadm:Config: {'roleless': True, 'single_host_defaults': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'OSD_DOWN'], 'log-only-match': ['CEPHADM_'], 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df'} 2026-03-08T23:21:18.665 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-08T23:21:18.665 INFO:tasks.cephadm:Cluster fsid is 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:21:18.665 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-03-08T23:21:18.665 INFO:tasks.cephadm:No mon roles; fabricating mons 2026-03-08T23:21:18.665 INFO:tasks.cephadm:Monitor IPs: {'mon.vm05': '192.168.123.105'} 2026-03-08T23:21:18.665 INFO:tasks.cephadm:Normalizing hostnames... 2026-03-08T23:21:18.666 DEBUG:teuthology.orchestra.run.vm05:> sudo hostname $(hostname -s) 2026-03-08T23:21:18.710 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-03-08T23:21:18.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-08T23:21:19.291 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'ref': 'squid', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-25 18:55:15.146628', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-678-ge911bdeb', 'package_manager_version': '19.2.3-678.ge911bdeb', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3275/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-03-08T23:21:19.986 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 e911bdebe5c8faa3800735d1568fcdca65db60df from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-08T23:21:19.987 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-08T23:21:19.987 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-08T23:21:19.987 DEBUG:teuthology.orchestra.run.vm05:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-03-08T23:21:21.445 INFO:teuthology.orchestra.run.vm05.stdout:-rw-r--r--. 1 ubuntu ubuntu 788355 Mar 8 23:21 /home/ubuntu/cephtest/cephadm 2026-03-08T23:21:21.445 DEBUG:teuthology.orchestra.run.vm05:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-03-08T23:21:21.468 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df on all hosts... 2026-03-08T23:21:21.468 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-08T23:21:21.702 INFO:teuthology.orchestra.run.vm05.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-08T23:21:56.215 INFO:teuthology.orchestra.run.vm05.stdout:{ 2026-03-08T23:21:56.215 INFO:teuthology.orchestra.run.vm05.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-08T23:21:56.215 INFO:teuthology.orchestra.run.vm05.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-08T23:21:56.215 INFO:teuthology.orchestra.run.vm05.stdout: "repo_digests": [ 2026-03-08T23:21:56.216 INFO:teuthology.orchestra.run.vm05.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-08T23:21:56.216 INFO:teuthology.orchestra.run.vm05.stdout: ] 2026-03-08T23:21:56.216 INFO:teuthology.orchestra.run.vm05.stdout:} 2026-03-08T23:21:56.238 DEBUG:teuthology.orchestra.run.vm05:> sudo mkdir -p /etc/ceph 2026-03-08T23:21:56.267 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod 777 /etc/ceph 2026-03-08T23:21:56.337 INFO:tasks.cephadm:Writing seed config... 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [osd] osd mclock iops capacity threshold hdd = 49000 2026-03-08T23:21:56.337 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-03-08T23:21:56.337 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:21:56.337 DEBUG:teuthology.orchestra.run.vm05:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-03-08T23:21:56.397 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 82d18348-1b45-11f1-a9dd-c30ab03d28cc [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd mclock iops capacity threshold hdd = 49000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-03-08T23:21:56.397 DEBUG:teuthology.orchestra.run.vm05:mon.vm05> sudo journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05.service 2026-03-08T23:21:56.441 INFO:tasks.cephadm:Bootstrapping... 2026-03-08T23:21:56.441 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df -v bootstrap --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 192.168.123.105 --single-host-defaults --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-03-08T23:21:56.598 INFO:teuthology.orchestra.run.vm05.stdout:-------------------------------------------------------------------------------- 2026-03-08T23:21:56.598 INFO:teuthology.orchestra.run.vm05.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df', '-v', 'bootstrap', '--fsid', '82d18348-1b45-11f1-a9dd-c30ab03d28cc', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '192.168.123.105', '--single-host-defaults', '--skip-admin-label'] 2026-03-08T23:21:56.598 INFO:teuthology.orchestra.run.vm05.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-03-08T23:21:56.598 INFO:teuthology.orchestra.run.vm05.stdout:Verifying podman|docker is present... 2026-03-08T23:21:56.626 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stdout 5.8.0 2026-03-08T23:21:56.626 INFO:teuthology.orchestra.run.vm05.stdout:Verifying lvm2 is present... 2026-03-08T23:21:56.626 INFO:teuthology.orchestra.run.vm05.stdout:Verifying time synchronization is in place... 2026-03-08T23:21:56.634 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-08T23:21:56.634 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-08T23:21:56.640 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-08T23:21:56.640 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout inactive 2026-03-08T23:21:56.646 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout enabled 2026-03-08T23:21:56.651 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout active 2026-03-08T23:21:56.651 INFO:teuthology.orchestra.run.vm05.stdout:Unit chronyd.service is enabled and running 2026-03-08T23:21:56.651 INFO:teuthology.orchestra.run.vm05.stdout:Repeating the final host check... 2026-03-08T23:21:56.675 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stdout 5.8.0 2026-03-08T23:21:56.675 INFO:teuthology.orchestra.run.vm05.stdout:podman (/bin/podman) version 5.8.0 is present 2026-03-08T23:21:56.675 INFO:teuthology.orchestra.run.vm05.stdout:systemctl is present 2026-03-08T23:21:56.675 INFO:teuthology.orchestra.run.vm05.stdout:lvcreate is present 2026-03-08T23:21:56.681 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-08T23:21:56.681 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-08T23:21:56.687 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-08T23:21:56.687 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout inactive 2026-03-08T23:21:56.694 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout enabled 2026-03-08T23:21:56.699 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout active 2026-03-08T23:21:56.699 INFO:teuthology.orchestra.run.vm05.stdout:Unit chronyd.service is enabled and running 2026-03-08T23:21:56.699 INFO:teuthology.orchestra.run.vm05.stdout:Host looks OK 2026-03-08T23:21:56.699 INFO:teuthology.orchestra.run.vm05.stdout:Cluster fsid: 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:21:56.699 INFO:teuthology.orchestra.run.vm05.stdout:Acquiring lock 140655581791856 on /run/cephadm/82d18348-1b45-11f1-a9dd-c30ab03d28cc.lock 2026-03-08T23:21:56.700 INFO:teuthology.orchestra.run.vm05.stdout:Lock 140655581791856 acquired on /run/cephadm/82d18348-1b45-11f1-a9dd-c30ab03d28cc.lock 2026-03-08T23:21:56.700 INFO:teuthology.orchestra.run.vm05.stdout:Verifying IP 192.168.123.105 port 3300 ... 2026-03-08T23:21:56.700 INFO:teuthology.orchestra.run.vm05.stdout:Verifying IP 192.168.123.105 port 6789 ... 2026-03-08T23:21:56.700 INFO:teuthology.orchestra.run.vm05.stdout:Base mon IP(s) is [192.168.123.105:3300, 192.168.123.105:6789], mon addrv is [v2:192.168.123.105:3300,v1:192.168.123.105:6789] 2026-03-08T23:21:56.704 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout default via 192.168.123.1 dev eth0 proto dhcp src 192.168.123.105 metric 100 2026-03-08T23:21:56.704 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout 192.168.123.0/24 dev eth0 proto kernel scope link src 192.168.123.105 metric 100 2026-03-08T23:21:56.707 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-03-08T23:21:56.707 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout fe80::/64 dev eth0 proto kernel metric 1024 pref medium 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout 2: eth0: mtu 1500 state UP qlen 1000 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout inet6 fe80::5055:ff:fe00:5/64 scope link noprefixroute 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:Mon IP `192.168.123.105` is in CIDR network `192.168.123.0/24` 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:Mon IP `192.168.123.105` is in CIDR network `192.168.123.0/24` 2026-03-08T23:21:56.710 INFO:teuthology.orchestra.run.vm05.stdout:Inferred mon public CIDR from local network configuration ['192.168.123.0/24', '192.168.123.0/24'] 2026-03-08T23:21:56.711 INFO:teuthology.orchestra.run.vm05.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-03-08T23:21:56.711 INFO:teuthology.orchestra.run.vm05.stdout:Adjusting default settings to suit single-host cluster... 2026-03-08T23:21:56.711 INFO:teuthology.orchestra.run.vm05.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stdout 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Getting image source signatures 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Copying blob sha256:1752b8d01aa0dd33bbe0ab24e8316174c94fbdcd5d26252e2680bba0624747a7 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Copying config sha256:654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-08T23:21:57.949 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Writing manifest to image destination 2026-03-08T23:21:58.095 INFO:teuthology.orchestra.run.vm05.stdout:ceph: stdout ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-08T23:21:58.095 INFO:teuthology.orchestra.run.vm05.stdout:Ceph version: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-08T23:21:58.095 INFO:teuthology.orchestra.run.vm05.stdout:Extracting ceph user uid/gid from container image... 2026-03-08T23:21:58.220 INFO:teuthology.orchestra.run.vm05.stdout:stat: stdout 167 167 2026-03-08T23:21:58.220 INFO:teuthology.orchestra.run.vm05.stdout:Creating initial keys... 2026-03-08T23:21:58.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph-authtool: stdout AQCWBK5pUG6EERAA9U+Wdx/zVEFOA4B/m64kQw== 2026-03-08T23:21:58.446 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph-authtool: stdout AQCWBK5pFJe2GBAADFBQjqXbxJ5Yjkxn5XtP0g== 2026-03-08T23:21:58.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph-authtool: stdout AQCWBK5p5nqWHxAAr+czKJJYTXHeojIxmC2iJw== 2026-03-08T23:21:58.581 INFO:teuthology.orchestra.run.vm05.stdout:Creating initial monmap... 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:monmaptool for vm05 [v2:192.168.123.105:3300,v1:192.168.123.105:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:setting min_mon_release = quincy 2026-03-08T23:21:58.690 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: set fsid to 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:21:58.691 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-08T23:21:58.691 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:21:58.691 INFO:teuthology.orchestra.run.vm05.stdout:Creating mon... 2026-03-08T23:21:58.827 INFO:teuthology.orchestra.run.vm05.stdout:create mon.vm05 on 2026-03-08T23:21:59.165 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-03-08T23:21:59.317 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc.target → /etc/systemd/system/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc.target. 2026-03-08T23:21:59.317 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc.target → /etc/systemd/system/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc.target. 2026-03-08T23:21:59.495 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05 2026-03-08T23:21:59.496 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to reset failed state of unit ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05.service: Unit ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05.service not loaded. 2026-03-08T23:21:59.668 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc.target.wants/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05.service → /etc/systemd/system/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@.service. 2026-03-08T23:21:59.874 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-08T23:21:59.874 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to enable service . firewalld.service is not available 2026-03-08T23:21:59.874 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mon to start... 2026-03-08T23:21:59.875 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mon... 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout cluster: 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout id: 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout services: 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum vm05 (age 0.161206s) 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout data: 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout pgs: 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:mon is available 2026-03-08T23:22:00.138 INFO:teuthology.orchestra.run.vm05.stdout:Assimilating anything we can from ceph.conf... 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [global] 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout fsid = 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.105:3300,v1:192.168.123.105:6789] 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [osd] 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-08T23:22:00.346 INFO:teuthology.orchestra.run.vm05.stdout:Generating new minimal ceph.conf... 2026-03-08T23:22:00.553 INFO:teuthology.orchestra.run.vm05.stdout:Restarting the monitor... 2026-03-08T23:22:01.963 INFO:teuthology.orchestra.run.vm05.stdout:Setting public_network to 192.168.123.0/24 in mon config section 2026-03-08T23:22:02.182 INFO:teuthology.orchestra.run.vm05.stdout:Wrote config to /etc/ceph/ceph.conf 2026-03-08T23:22:02.185 INFO:teuthology.orchestra.run.vm05.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-03-08T23:22:02.185 INFO:teuthology.orchestra.run.vm05.stdout:Creating mgr... 2026-03-08T23:22:02.185 INFO:teuthology.orchestra.run.vm05.stdout:Verifying port 0.0.0.0:9283 ... 2026-03-08T23:22:02.186 INFO:teuthology.orchestra.run.vm05.stdout:Verifying port 0.0.0.0:8765 ... 2026-03-08T23:22:02.186 INFO:teuthology.orchestra.run.vm05.stdout:Verifying port 0.0.0.0:8443 ... 2026-03-08T23:22:02.366 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mgr.vm05.rlbdqk 2026-03-08T23:22:02.366 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to reset failed state of unit ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mgr.vm05.rlbdqk.service: Unit ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mgr.vm05.rlbdqk.service not loaded. 2026-03-08T23:22:02.514 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc.target.wants/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mgr.vm05.rlbdqk.service → /etc/systemd/system/ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@.service. 2026-03-08T23:22:02.725 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-08T23:22:02.725 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to enable service . firewalld.service is not available 2026-03-08T23:22:02.725 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-08T23:22:02.725 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2026-03-08T23:22:02.725 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr to start... 2026-03-08T23:22:02.725 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr... 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsid": "82d18348-1b45-11f1-a9dd-c30ab03d28cc", 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "health": { 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 0 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "vm05" 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-08T23:22:03.028 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "btime": "2026-03-08T23:21:59:912276+0000", 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "restful" 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modified": "2026-03-08T23:21:59.912985+0000", 2026-03-08T23:22:03.029 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-08T23:22:03.030 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:03.030 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-08T23:22:03.030 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:03.030 INFO:teuthology.orchestra.run.vm05.stdout:mgr not available, waiting (1/15)... 2026-03-08T23:22:05.331 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsid": "82d18348-1b45-11f1-a9dd-c30ab03d28cc", 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "health": { 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 0 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "vm05" 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-08T23:22:05.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "btime": "2026-03-08T23:21:59:912276+0000", 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "restful" 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modified": "2026-03-08T23:21:59.912985+0000", 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:05.333 INFO:teuthology.orchestra.run.vm05.stdout:mgr not available, waiting (2/15)... 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsid": "82d18348-1b45-11f1-a9dd-c30ab03d28cc", 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "health": { 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 0 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "vm05" 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-08T23:22:07.637 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "btime": "2026-03-08T23:21:59:912276+0000", 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "restful" 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modified": "2026-03-08T23:21:59.912985+0000", 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:07.638 INFO:teuthology.orchestra.run.vm05.stdout:mgr is available 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [global] 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout fsid = 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.105:3300,v1:192.168.123.105:6789] 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [osd] 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-08T23:22:07.899 INFO:teuthology.orchestra.run.vm05.stdout:Enabling cephadm module... 2026-03-08T23:22:09.543 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:09.543 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-03-08T23:22:09.543 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-08T23:22:09.543 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "active_name": "vm05.rlbdqk", 2026-03-08T23:22:09.543 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-08T23:22:09.544 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:09.544 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for the mgr to restart... 2026-03-08T23:22:09.544 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr epoch 5... 2026-03-08T23:22:13.807 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:13.807 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-03-08T23:22:13.807 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-08T23:22:13.807 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:13.807 INFO:teuthology.orchestra.run.vm05.stdout:mgr epoch 5 is available 2026-03-08T23:22:13.807 INFO:teuthology.orchestra.run.vm05.stdout:Setting orchestrator backend to cephadm... 2026-03-08T23:22:14.486 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout value unchanged 2026-03-08T23:22:14.486 INFO:teuthology.orchestra.run.vm05.stdout:Generating ssh key... 2026-03-08T23:22:15.055 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG8dKs3MXCgjI/aWDdbDfpPQGgrxp4GE3VtraqU84kYt ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:15.055 INFO:teuthology.orchestra.run.vm05.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-03-08T23:22:15.056 INFO:teuthology.orchestra.run.vm05.stdout:Adding key to root@localhost authorized_keys... 2026-03-08T23:22:15.056 INFO:teuthology.orchestra.run.vm05.stdout:Adding host vm05... 2026-03-08T23:22:17.039 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Added host 'vm05' with addr '192.168.123.105' 2026-03-08T23:22:17.039 INFO:teuthology.orchestra.run.vm05.stdout:Deploying mon service with default placement... 2026-03-08T23:22:17.415 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-03-08T23:22:17.415 INFO:teuthology.orchestra.run.vm05.stdout:Deploying mgr service with default placement... 2026-03-08T23:22:17.739 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-03-08T23:22:17.739 INFO:teuthology.orchestra.run.vm05.stdout:Deploying crash service with default placement... 2026-03-08T23:22:18.031 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2026-03-08T23:22:18.031 INFO:teuthology.orchestra.run.vm05.stdout:Deploying ceph-exporter service with default placement... 2026-03-08T23:22:18.324 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2026-03-08T23:22:18.324 INFO:teuthology.orchestra.run.vm05.stdout:Deploying prometheus service with default placement... 2026-03-08T23:22:18.599 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2026-03-08T23:22:18.599 INFO:teuthology.orchestra.run.vm05.stdout:Deploying grafana service with default placement... 2026-03-08T23:22:19.057 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2026-03-08T23:22:19.057 INFO:teuthology.orchestra.run.vm05.stdout:Deploying node-exporter service with default placement... 2026-03-08T23:22:19.471 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2026-03-08T23:22:19.471 INFO:teuthology.orchestra.run.vm05.stdout:Deploying alertmanager service with default placement... 2026-03-08T23:22:19.854 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2026-03-08T23:22:20.649 INFO:teuthology.orchestra.run.vm05.stdout:Enabling the dashboard module... 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "active_name": "vm05.rlbdqk", 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for the mgr to restart... 2026-03-08T23:22:22.216 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr epoch 9... 2026-03-08T23:22:26.280 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-08T23:22:26.280 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-03-08T23:22:26.280 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-08T23:22:26.280 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-08T23:22:26.280 INFO:teuthology.orchestra.run.vm05.stdout:mgr epoch 9 is available 2026-03-08T23:22:26.280 INFO:teuthology.orchestra.run.vm05.stdout:Generating a dashboard self-signed certificate... 2026-03-08T23:22:26.866 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-03-08T23:22:26.866 INFO:teuthology.orchestra.run.vm05.stdout:Creating initial admin user... 2026-03-08T23:22:27.332 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$kOdh8vJ6vxPZoxVQM.EAH.3FQ.WE3gT5WR3yIBSZJaxrBj7FZUmQS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1773012147, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-03-08T23:22:27.332 INFO:teuthology.orchestra.run.vm05.stdout:Fetching dashboard port number... 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 8443 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout:Ceph Dashboard is now available at: 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout: URL: https://vm05.local:8443/ 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout: User: admin 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout: Password: byukd9laq4 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:27.727 INFO:teuthology.orchestra.run.vm05.stdout:Saving cluster configuration to /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/config directory 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout:Or, if you are only running a single cluster on this host: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout:Please consider enabling telemetry to help improve Ceph: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: ceph telemetry on 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout:For more information see: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:28.033 INFO:teuthology.orchestra.run.vm05.stdout:Bootstrap complete. 2026-03-08T23:22:28.076 INFO:tasks.cephadm:Fetching config... 2026-03-08T23:22:28.076 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:28.076 DEBUG:teuthology.orchestra.run.vm05:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-03-08T23:22:28.139 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-03-08T23:22:28.139 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:28.139 DEBUG:teuthology.orchestra.run.vm05:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-03-08T23:22:28.164 INFO:tasks.cephadm:Fetching mon keyring... 2026-03-08T23:22:28.164 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:28.164 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/keyring of=/dev/stdout 2026-03-08T23:22:28.262 INFO:tasks.cephadm:Fetching pub ssh key... 2026-03-08T23:22:28.262 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:28.262 DEBUG:teuthology.orchestra.run.vm05:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-03-08T23:22:28.327 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-03-08T23:22:28.327 DEBUG:teuthology.orchestra.run.vm05:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG8dKs3MXCgjI/aWDdbDfpPQGgrxp4GE3VtraqU84kYt ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-03-08T23:22:28.421 INFO:teuthology.orchestra.run.vm05.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG8dKs3MXCgjI/aWDdbDfpPQGgrxp4GE3VtraqU84kYt ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:28.434 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-03-08T23:22:28.669 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:29.115 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-03-08T23:22:29.115 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-03-08T23:22:29.420 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:30.048 INFO:tasks.cephadm:Setting crush tunables to default 2026-03-08T23:22:30.049 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd crush tunables default 2026-03-08T23:22:30.267 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:31.024 INFO:teuthology.orchestra.run.vm05.stderr:adjusted tunables profile to default 2026-03-08T23:22:31.117 INFO:tasks.cephadm:Adding mon.vm05 on vm05 2026-03-08T23:22:31.117 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph orch apply mon '1;vm05:192.168.123.105=vm05' 2026-03-08T23:22:31.509 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:31.857 INFO:teuthology.orchestra.run.vm05.stdout:Scheduled mon update... 2026-03-08T23:22:31.960 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-03-08T23:22:31.960 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph mon dump -f json 2026-03-08T23:22:32.272 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:32.695 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:32.695 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":1,"fsid":"82d18348-1b45-11f1-a9dd-c30ab03d28cc","modified":"2026-03-08T23:21:58.659574Z","created":"2026-03-08T23:21:58.659574Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"vm05","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:3300","nonce":0},{"type":"v1","addr":"192.168.123.105:6789","nonce":0}]},"addr":"192.168.123.105:6789/0","public_addr":"192.168.123.105:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-03-08T23:22:32.695 INFO:teuthology.orchestra.run.vm05.stderr:dumped monmap epoch 1 2026-03-08T23:22:32.783 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-03-08T23:22:32.783 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph config generate-minimal-conf 2026-03-08T23:22:33.184 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:33.545 INFO:teuthology.orchestra.run.vm05.stdout:# minimal ceph.conf for 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:33.545 INFO:teuthology.orchestra.run.vm05.stdout:[global] 2026-03-08T23:22:33.545 INFO:teuthology.orchestra.run.vm05.stdout: fsid = 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:22:33.545 INFO:teuthology.orchestra.run.vm05.stdout: mon_host = [v2:192.168.123.105:3300/0,v1:192.168.123.105:6789/0] 2026-03-08T23:22:33.793 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-03-08T23:22:33.793 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:33.793 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/ceph/ceph.conf 2026-03-08T23:22:33.939 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:33.939 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-08T23:22:33.970 INFO:tasks.cephadm:Deploying OSDs... 2026-03-08T23:22:33.970 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:22:33.970 DEBUG:teuthology.orchestra.run.vm05:> dd if=/scratch_devs of=/dev/stdout 2026-03-08T23:22:34.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-08T23:22:34.028 DEBUG:teuthology.orchestra.run.vm05:> ls /dev/[sv]d? 2026-03-08T23:22:34.082 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vda 2026-03-08T23:22:34.083 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vdb 2026-03-08T23:22:34.083 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vdc 2026-03-08T23:22:34.083 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vdd 2026-03-08T23:22:34.083 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vde 2026-03-08T23:22:34.083 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-08T23:22:34.083 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-08T23:22:34.083 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vdb 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vdb 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 221 Links: 1 Device type: fc,10 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-08 23:22:30.662106859 +0000 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-08 23:21:17.921617094 +0000 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-08 23:21:17.921617094 +0000 2026-03-08T23:22:34.140 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-08 23:18:34.254000000 +0000 2026-03-08T23:22:34.140 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-08T23:22:34.202 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-08T23:22:34.202 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-08T23:22:34.202 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000167884 s, 3.0 MB/s 2026-03-08T23:22:34.203 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-08T23:22:34.262 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vdc 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vdc 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 224 Links: 1 Device type: fc,20 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-08 23:22:30.734106920 +0000 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-08 23:21:17.914617084 +0000 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-08 23:21:17.914617084 +0000 2026-03-08T23:22:34.318 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-08 23:18:34.275000000 +0000 2026-03-08T23:22:34.319 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-08T23:22:34.381 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-08T23:22:34.381 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-08T23:22:34.381 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000153276 s, 3.3 MB/s 2026-03-08T23:22:34.382 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-08T23:22:34.438 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vdd 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vdd 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 256 Links: 1 Device type: fc,30 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-08 23:22:30.791106968 +0000 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-08 23:21:17.937617117 +0000 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-08 23:21:17.937617117 +0000 2026-03-08T23:22:34.494 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-08 23:18:34.292000000 +0000 2026-03-08T23:22:34.494 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-08T23:22:34.556 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-08T23:22:34.556 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-08T23:22:34.556 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000133189 s, 3.8 MB/s 2026-03-08T23:22:34.557 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-08T23:22:34.612 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vde 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vde 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 257 Links: 1 Device type: fc,40 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-08 23:22:30.825106997 +0000 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-08 23:21:17.977617174 +0000 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-08 23:21:17.977617174 +0000 2026-03-08T23:22:34.667 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-08 23:18:34.354000000 +0000 2026-03-08T23:22:34.667 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-08T23:22:34.728 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-08T23:22:34.728 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-08T23:22:34.728 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000146503 s, 3.5 MB/s 2026-03-08T23:22:34.729 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-08T23:22:34.784 INFO:tasks.cephadm:Deploying osd.0 on vm05 with /dev/vde... 2026-03-08T23:22:34.785 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- lvm zap /dev/vde 2026-03-08T23:22:34.977 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:36.241 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:36 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:36.734 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:22:36.758 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph orch daemon add osd vm05:/dev/vde 2026-03-08T23:22:36.938 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:22:37.242 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:37 vm05 ceph-mon[51825]: Deploying daemon alertmanager.vm05 on vm05 2026-03-08T23:22:37.242 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:37 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-08T23:22:37.242 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:37 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-08T23:22:37.242 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:37 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:22:38.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:38 vm05 ceph-mon[51825]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm05:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: Regenerating cephadm self-signed grafana TLS certificates 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3169071907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27c6f8a3-1adc-4172-90e2-6a031a65d0ab"}]: dispatch 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3169071907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27c6f8a3-1adc-4172-90e2-6a031a65d0ab"}]': finished 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: osdmap e5: 1 total, 0 up, 1 in 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-08T23:22:41.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:40 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/4064889905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-08T23:22:42.016 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:41 vm05 ceph-mon[51825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-03-08T23:22:42.016 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:41 vm05 ceph-mon[51825]: Deploying daemon grafana.vm05 on vm05 2026-03-08T23:22:46.603 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:46 vm05 ceph-mon[51825]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:48.603 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:48 vm05 ceph-mon[51825]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.vm05.aawmpl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.vm05.aawmpl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-08T23:22:50.370 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:50 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: Deploying daemon mgr.vm05.aawmpl on vm05 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: Deploying daemon osd.0 on vm05 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:51.465 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:51 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:52.399 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:52 vm05 ceph-mon[51825]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:52.399 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:52 vm05 ceph-mon[51825]: Deploying daemon prometheus.vm05 on vm05 2026-03-08T23:22:54.833 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:54 vm05 ceph-mon[51825]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:54.833 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:54 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:54.834 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:54 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:56.103 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:55 vm05 ceph-mon[51825]: Standby manager daemon vm05.aawmpl started 2026-03-08T23:22:56.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:55 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:56.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:55 vm05 ceph-mon[51825]: from='osd.0 [v2:192.168.123.105:6802/2454715299,v1:192.168.123.105:6803/2454715299]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: mgrmap e14: vm05.rlbdqk(active, since 30s), standbys: vm05.aawmpl 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mgr metadata", "who": "vm05.aawmpl", "id": "vm05.aawmpl"}]: dispatch 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: from='osd.0 [v2:192.168.123.105:6802/2454715299,v1:192.168.123.105:6803/2454715299]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: osdmap e6: 1 total, 0 up, 1 in 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: from='osd.0 [v2:192.168.123.105:6802/2454715299,v1:192.168.123.105:6803/2454715299]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-08T23:22:57.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:57 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-08T23:22:58.540 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:58 vm05 ceph-mon[51825]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:22:58.540 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:58 vm05 ceph-mon[51825]: from='osd.0 [v2:192.168.123.105:6802/2454715299,v1:192.168.123.105:6803/2454715299]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-08T23:22:58.540 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:58 vm05 ceph-mon[51825]: osdmap e7: 1 total, 0 up, 1 in 2026-03-08T23:22:58.540 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:58 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-08T23:22:58.540 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:58 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-08T23:22:59.552 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: purged_snaps scrub starts 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: purged_snaps scrub ok 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: osd.0 [v2:192.168.123.105:6802/2454715299,v1:192.168.123.105:6803/2454715299] boot 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: osdmap e8: 1 total, 1 up, 1 in 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:22:59.553 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:22:59 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-08T23:22:59.610 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 0 on host 'vm05' 2026-03-08T23:22:59.685 DEBUG:teuthology.orchestra.run.vm05:osd.0> sudo journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.0.service 2026-03-08T23:22:59.687 INFO:tasks.cephadm:Deploying osd.1 on vm05 with /dev/vdd... 2026-03-08T23:22:59.687 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- lvm zap /dev/vdd 2026-03-08T23:22:59.902 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:00.696 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:00 vm05 ceph-mon[51825]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-08T23:23:00.696 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:00 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:00.696 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:00 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:00.696 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:00 vm05 ceph-mon[51825]: from='mgr.14162 192.168.123.105:0/2477287403' entity='mgr.vm05.rlbdqk' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-08T23:23:00.696 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:00 vm05 ceph-mon[51825]: mgrmap e15: vm05.rlbdqk(active, since 34s), standbys: vm05.aawmpl 2026-03-08T23:23:00.800 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:00.832 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph orch daemon add osd vm05:/dev/vdd 2026-03-08T23:23:01.045 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: Active manager daemon vm05.rlbdqk restarted 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: Activating manager daemon vm05.rlbdqk 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: osdmap e9: 1 total, 1 up, 1 in 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: mgrmap e16: vm05.rlbdqk(active, starting, since 0.00841002s), standbys: vm05.aawmpl 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mon metadata", "id": "vm05"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mgr metadata", "who": "vm05.rlbdqk", "id": "vm05.rlbdqk"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mgr metadata", "who": "vm05.aawmpl", "id": "vm05.aawmpl"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: Manager daemon vm05.rlbdqk is now available 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-08T23:23:03.750 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:03 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/vm05.rlbdqk/mirror_snapshot_schedule"}]: dispatch 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/vm05.rlbdqk/trash_purge_schedule"}]: dispatch 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: Standby manager daemon vm05.aawmpl restarted 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: Standby manager daemon vm05.aawmpl started 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: mgrmap e17: vm05.rlbdqk(active, since 1.01234s), standbys: vm05.aawmpl 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-08T23:23:04.611 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:04 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: [08/Mar/2026:23:23:04] ENGINE Bus STARTING 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: [08/Mar/2026:23:23:04] ENGINE Serving on http://192.168.123.105:8765 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: [08/Mar/2026:23:23:04] ENGINE Serving on https://192.168.123.105:7150 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: [08/Mar/2026:23:23:04] ENGINE Bus STARTED 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: [08/Mar/2026:23:23:04] ENGINE Client ('192.168.123.105', 37562) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/4163286372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3faa3668-4c65-4377-87d6-8fc1e4d6fdc8"}]: dispatch 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/4163286372' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3faa3668-4c65-4377-87d6-8fc1e4d6fdc8"}]': finished 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: osdmap e10: 2 total, 1 up, 2 in 2026-03-08T23:23:05.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:05 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-08T23:23:07.076 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:06 vm05 ceph-mon[51825]: pgmap v5: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-08T23:23:07.076 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:06 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:07.076 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:06 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:07.076 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:06 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3786975336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-08T23:23:07.076 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:06 vm05 ceph-mon[51825]: mgrmap e18: vm05.rlbdqk(active, since 2s), standbys: vm05.aawmpl 2026-03-08T23:23:08.893 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:08 vm05 ceph-mon[51825]: pgmap v6: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: Detected new or changed devices on vm05 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config rm", "who": "osd/host:vm05", "name": "osd_memory_target"}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: Updating vm05:/etc/ceph/ceph.conf 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: Updating vm05:/var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/config/ceph.conf 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: Deploying daemon osd.1 on vm05 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: Updating vm05:/etc/ceph/ceph.client.admin.keyring 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: Updating vm05:/var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/config/ceph.client.admin.keyring 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-08T23:23:10.565 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:10 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:11.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:11 vm05 ceph-mon[51825]: Reconfiguring mon.vm05 (unknown last config time)... 2026-03-08T23:23:11.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:11 vm05 ceph-mon[51825]: Reconfiguring daemon mon.vm05 on vm05 2026-03-08T23:23:12.993 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 1 on host 'vm05' 2026-03-08T23:23:13.053 DEBUG:teuthology.orchestra.run.vm05:osd.1> sudo journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.1.service 2026-03-08T23:23:13.054 INFO:tasks.cephadm:Deploying osd.2 on vm05 with /dev/vdc... 2026-03-08T23:23:13.055 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- lvm zap /dev/vdc 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: Reconfiguring mgr.vm05.rlbdqk (unknown last config time)... 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.vm05.rlbdqk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: Reconfiguring daemon mgr.vm05.rlbdqk on vm05 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:13.089 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:12 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:13.345 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:13.978 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:13 vm05 ceph-mon[51825]: Reconfiguring alertmanager.vm05 (dependencies changed)... 2026-03-08T23:23:14.006 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:13 vm05 ceph-mon[51825]: Reconfiguring daemon alertmanager.vm05 on vm05 2026-03-08T23:23:14.006 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:13 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:14.006 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:13 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:14.006 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:13 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:14.006 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:13 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:14.293 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:14 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1[71005]: 2026-03-08T23:23:14.098+0000 7fbcc4639740 -1 osd.1 0 log_to_monitors true 2026-03-08T23:23:14.373 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:14.389 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph orch daemon add osd vm05:/dev/vdc 2026-03-08T23:23:14.646 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: Reconfiguring grafana.vm05 (dependencies changed)... 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: Reconfiguring daemon grafana.vm05 on vm05 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: from='osd.1 [v2:192.168.123.105:6810/1880282824,v1:192.168.123.105:6811/1880282824]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-08T23:23:15.104 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:14 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:16.244 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:15 vm05 ceph-mon[51825]: from='client.14225 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm05:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='osd.1 [v2:192.168.123.105:6810/1880282824,v1:192.168.123.105:6811/1880282824]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: osdmap e11: 2 total, 1 up, 2 in 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='osd.1 [v2:192.168.123.105:6810/1880282824,v1:192.168.123.105:6811/1880282824]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm05.local:9093"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://vm05.local:9093"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm05.local:3000"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://vm05.local:3000"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/41999440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ce2f8aa-e228-499d-9893-c4c1b806ce3f"}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='osd.1 [v2:192.168.123.105:6810/1880282824,v1:192.168.123.105:6811/1880282824]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/41999440' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ce2f8aa-e228-499d-9893-c4c1b806ce3f"}]': finished 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: osdmap e12: 3 total, 1 up, 3 in 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:16 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:16.245 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:15 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1[71005]: 2026-03-08T23:23:15.972+0000 7fbcc0dcd640 -1 osd.1 0 waiting for initial osdmap 2026-03-08T23:23:16.245 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:15 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1[71005]: 2026-03-08T23:23:15.980+0000 7fbcbc3e4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/679785732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: osd.1 [v2:192.168.123.105:6810/1880282824,v1:192.168.123.105:6811/1880282824] boot 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: osdmap e13: 3 total, 2 up, 3 in 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-08T23:23:17.147 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:17 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:18.477 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:18 vm05 ceph-mon[51825]: purged_snaps scrub starts 2026-03-08T23:23:18.477 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:18 vm05 ceph-mon[51825]: purged_snaps scrub ok 2026-03-08T23:23:18.477 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:18 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vde 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74045]: pam_unix(sudo:session): session closed for user root 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74089]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vdd 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74089]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-08T23:23:19.516 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74089]: pam_unix(sudo:session): session closed for user root 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 ceph-mon[51825]: pgmap v14: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 ceph-mon[51825]: osdmap e14: 3 total, 2 up, 3 in 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-08T23:23:19.516 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74152]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-08T23:23:19.517 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74152]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-08T23:23:19.517 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-08T23:23:19.517 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:19 vm05 sudo[74152]: pam_unix(sudo:session): session closed for user root 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: osdmap e15: 3 total, 2 up, 3 in 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "mon metadata", "id": "vm05"}]: dispatch 2026-03-08T23:23:20.495 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:20 vm05 ceph-mon[51825]: pgmap v17: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: osdmap e16: 3 total, 2 up, 3 in 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: mgrmap e19: vm05.rlbdqk(active, since 16s), standbys: vm05.aawmpl 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: Detected new or changed devices on vm05 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config rm", "who": "osd/host:vm05", "name": "osd_memory_target"}]: dispatch 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:21.324 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:21 vm05 ceph-mon[51825]: Deploying daemon osd.2 on vm05 2026-03-08T23:23:22.499 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:22 vm05 ceph-mon[51825]: pgmap v19: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-08T23:23:23.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:23 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-08T23:23:23.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:23 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:23.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:23 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:24.291 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:24 vm05 ceph-mon[51825]: pgmap v20: 1 pgs: 1 active+clean; 449 KiB data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-08T23:23:24.354 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 2 on host 'vm05' 2026-03-08T23:23:24.423 DEBUG:teuthology.orchestra.run.vm05:osd.2> sudo journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.2.service 2026-03-08T23:23:24.425 INFO:tasks.cephadm:Deploying osd.3 on vm05 with /dev/vdb... 2026-03-08T23:23:24.425 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- lvm zap /dev/vdb 2026-03-08T23:23:24.553 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:23:24 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2[77006]: 2026-03-08T23:23:24.536+0000 7f5d219e6740 -1 osd.2 0 log_to_monitors true 2026-03-08T23:23:24.697 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:25.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:25 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:25.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:25 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:25.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:25 vm05 ceph-mon[51825]: from='osd.2 [v2:192.168.123.105:6818/3607964257,v1:192.168.123.105:6819/3607964257]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-08T23:23:25.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:25 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:25.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:25 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:25.558 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:25.578 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph orch daemon add osd vm05:/dev/vdb 2026-03-08T23:23:25.787 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='osd.2 [v2:192.168.123.105:6818/3607964257,v1:192.168.123.105:6819/3607964257]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: osdmap e17: 3 total, 2 up, 3 in 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='osd.2 [v2:192.168.123.105:6818/3607964257,v1:192.168.123.105:6819/3607964257]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: pgmap v22: 1 pgs: 1 active+clean; 449 KiB data, 54 MiB used, 40 GiB / 40 GiB avail 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='client.14237 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm05:/dev/vdb", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-08T23:23:26.569 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:26 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:23:27 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2[77006]: 2026-03-08T23:23:27.351+0000 7f5d1d967640 -1 osd.2 0 waiting for initial osdmap 2026-03-08T23:23:27.604 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:23:27 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2[77006]: 2026-03-08T23:23:27.386+0000 7f5d18f90640 -1 osd.2 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='osd.2 [v2:192.168.123.105:6818/3607964257,v1:192.168.123.105:6819/3607964257]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: osdmap e18: 3 total, 2 up, 3 in 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config rm", "who": "osd/host:vm05", "name": "osd_memory_target"}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/1183752670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32f80c95-4425-4a87-a68e-31c46fd534a7"}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/1183752670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32f80c95-4425-4a87-a68e-31c46fd534a7"}]': finished 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: osdmap e19: 4 total, 2 up, 4 in 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:27.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:27 vm05 ceph-mon[51825]: from='osd.2 [v2:192.168.123.105:6818/3607964257,v1:192.168.123.105:6819/3607964257]' entity='osd.2' 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: purged_snaps scrub starts 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: purged_snaps scrub ok 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: pgmap v25: 1 pgs: 1 active+clean; 449 KiB data, 54 MiB used, 40 GiB / 40 GiB avail 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/284025400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:28.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:28 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:29.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:29 vm05 ceph-mon[51825]: osd.2 [v2:192.168.123.105:6818/3607964257,v1:192.168.123.105:6819/3607964257] boot 2026-03-08T23:23:29.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:29 vm05 ceph-mon[51825]: osdmap e20: 4 total, 3 up, 4 in 2026-03-08T23:23:29.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:29 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-08T23:23:29.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:29 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:30.709 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:30 vm05 ceph-mon[51825]: pgmap v27: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-08T23:23:31.599 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:31 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-08T23:23:31.599 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:31 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:32.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:32 vm05 ceph-mon[51825]: Deploying daemon osd.3 on vm05 2026-03-08T23:23:32.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:32 vm05 ceph-mon[51825]: pgmap v28: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-08T23:23:33.493 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:33 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-08T23:23:33.493 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:33 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:33.792 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:33 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:34.676 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:34 vm05 ceph-mon[51825]: pgmap v29: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-08T23:23:34.676 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:34 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-08T23:23:34.950 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 3 on host 'vm05' 2026-03-08T23:23:35.036 DEBUG:teuthology.orchestra.run.vm05:osd.3> sudo journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.3.service 2026-03-08T23:23:35.038 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2026-03-08T23:23:35.038 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd stat -f json 2026-03-08T23:23:35.323 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:23:35 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3[83039]: 2026-03-08T23:23:35.106+0000 7f23d483e740 -1 osd.3 0 log_to_monitors true 2026-03-08T23:23:35.372 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:35.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:35 vm05 ceph-mon[51825]: osdmap e21: 4 total, 3 up, 4 in 2026-03-08T23:23:35.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:35 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:35.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:35 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:35.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:35 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:35.604 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:35 vm05 ceph-mon[51825]: from='osd.3 [v2:192.168.123.105:6826/85592020,v1:192.168.123.105:6827/85592020]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-08T23:23:35.691 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:35.852 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":21,"num_osds":4,"num_up_osds":3,"osd_up_since":1773012208,"num_in_osds":4,"osd_in_since":1773012207,"num_remapped_pgs":0} 2026-03-08T23:23:36.853 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd stat -f json 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: pgmap v31: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/2503726218' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: from='osd.3 [v2:192.168.123.105:6826/85592020,v1:192.168.123.105:6827/85592020]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: osdmap e22: 4 total, 3 up, 4 in 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: from='osd.3 [v2:192.168.123.105:6826/85592020,v1:192.168.123.105:6827/85592020]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-08T23:23:36.854 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:36 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:37.066 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:37.401 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:37.696 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":23,"num_osds":4,"num_up_osds":3,"osd_up_since":1773012208,"num_in_osds":4,"osd_in_since":1773012207,"num_remapped_pgs":0} 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: Detected new or changed devices on vm05 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config rm", "who": "osd/host:vm05", "name": "osd_memory_target"}]: dispatch 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='osd.3 [v2:192.168.123.105:6826/85592020,v1:192.168.123.105:6827/85592020]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: osdmap e23: 4 total, 3 up, 4 in 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:38.024 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:37 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/795741692' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-08T23:23:38.603 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:23:38 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3[83039]: 2026-03-08T23:23:38.396+0000 7f23d0fd2640 -1 osd.3 0 waiting for initial osdmap 2026-03-08T23:23:38.604 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:23:38 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3[83039]: 2026-03-08T23:23:38.404+0000 7f23cbde8640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-08T23:23:38.697 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd stat -f json 2026-03-08T23:23:38.915 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:39.194 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: purged_snaps scrub starts 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: purged_snaps scrub ok 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: pgmap v34: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='osd.3 [v2:192.168.123.105:6826/85592020,v1:192.168.123.105:6827/85592020]' entity='osd.3' 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-08T23:23:39.248 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:39 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' 2026-03-08T23:23:39.252 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":23,"num_osds":4,"num_up_osds":3,"osd_up_since":1773012208,"num_in_osds":4,"osd_in_since":1773012207,"num_remapped_pgs":0} 2026-03-08T23:23:40.253 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd stat -f json 2026-03-08T23:23:40.353 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:40 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:40.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:40 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/4093922189' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-08T23:23:40.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:40 vm05 ceph-mon[51825]: osd.3 [v2:192.168.123.105:6826/85592020,v1:192.168.123.105:6827/85592020] boot 2026-03-08T23:23:40.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:40 vm05 ceph-mon[51825]: osdmap e24: 4 total, 4 up, 4 in 2026-03-08T23:23:40.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:40 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-08T23:23:40.444 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:40.866 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:40.951 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1773012219,"num_in_osds":4,"osd_in_since":1773012207,"num_remapped_pgs":0} 2026-03-08T23:23:40.951 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd dump --format=json 2026-03-08T23:23:41.149 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:41.267 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:41 vm05 ceph-mon[51825]: pgmap v35: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-08T23:23:41.276 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:41 vm05 ceph-mon[51825]: osdmap e25: 4 total, 4 up, 4 in 2026-03-08T23:23:41.276 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:41 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3706857970' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-08T23:23:41.679 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:41.679 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":25,"fsid":"82d18348-1b45-11f1-a9dd-c30ab03d28cc","created":"2026-03-08T23:21:59.912611+0000","modified":"2026-03-08T23:23:40.535955+0000","last_up_change":"2026-03-08T23:23:39.400488+0000","last_in_change":"2026-03-08T23:23:27.031520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-08T23:23:17.500117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27c6f8a3-1adc-4172-90e2-6a031a65d0ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6802","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6803","nonce":2454715299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6804","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6805","nonce":2454715299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6808","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6809","nonce":2454715299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6806","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6807","nonce":2454715299}]},"public_addr":"192.168.123.105:6803/2454715299","cluster_addr":"192.168.123.105:6805/2454715299","heartbeat_back_addr":"192.168.123.105:6809/2454715299","heartbeat_front_addr":"192.168.123.105:6807/2454715299","state":["exists","up"]},{"osd":1,"uuid":"3faa3668-4c65-4377-87d6-8fc1e4d6fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6810","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6811","nonce":1880282824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6812","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6813","nonce":1880282824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6816","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6817","nonce":1880282824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6814","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6815","nonce":1880282824}]},"public_addr":"192.168.123.105:6811/1880282824","cluster_addr":"192.168.123.105:6813/1880282824","heartbeat_back_addr":"192.168.123.105:6817/1880282824","heartbeat_front_addr":"192.168.123.105:6815/1880282824","state":["exists","up"]},{"osd":2,"uuid":"2ce2f8aa-e228-499d-9893-c4c1b806ce3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6818","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6819","nonce":3607964257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6820","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6821","nonce":3607964257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6824","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6825","nonce":3607964257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6822","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6823","nonce":3607964257}]},"public_addr":"192.168.123.105:6819/3607964257","cluster_addr":"192.168.123.105:6821/3607964257","heartbeat_back_addr":"192.168.123.105:6825/3607964257","heartbeat_front_addr":"192.168.123.105:6823/3607964257","state":["exists","up"]},{"osd":3,"uuid":"32f80c95-4425-4a87-a68e-31c46fd534a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6826","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6827","nonce":85592020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6828","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6829","nonce":85592020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6832","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6833","nonce":85592020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6830","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6831","nonce":85592020}]},"public_addr":"192.168.123.105:6827/85592020","cluster_addr":"192.168.123.105:6829/85592020","heartbeat_back_addr":"192.168.123.105:6833/85592020","heartbeat_front_addr":"192.168.123.105:6831/85592020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:22:56.313027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:15.101141+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:25.534914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:36.131436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.105:0/4192174501":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/1910561761":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/788864128":"2026-03-09T23:22:12.737263+0000","192.168.123.105:0/3305758083":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6800/3002756344":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6801/3781044049":"2026-03-09T23:22:25.174147+0000","192.168.123.105:6801/3002756344":"2026-03-09T23:22:12.737263+0000","192.168.123.105:0/4160456993":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/1198340302":"2026-03-09T23:22:25.174147+0000","192.168.123.105:6800/3785579562":"2026-03-09T23:23:03.451318+0000","192.168.123.105:6800/3781044049":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/275416405":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/1316985984":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6801/3785579562":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/1769883016":"2026-03-09T23:23:03.451318+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-08T23:23:41.764 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-03-08T23:23:17.500117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-03-08T23:23:41.764 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd pool get .mgr pg_num 2026-03-08T23:23:41.955 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:42.253 INFO:teuthology.orchestra.run.vm05.stdout:pg_num: 1 2026-03-08T23:23:42.290 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:42 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3523831183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-08T23:23:42.318 INFO:tasks.cephadm:Setting up client nodes... 2026-03-08T23:23:42.318 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-08T23:23:42.532 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:43.015 INFO:teuthology.orchestra.run.vm05.stdout:[client.0] 2026-03-08T23:23:43.015 INFO:teuthology.orchestra.run.vm05.stdout: key = AQD+BK5pJoS1NhAAweV70Vw/kHc/rUbyYPsR5Q== 2026-03-08T23:23:43.158 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-08T23:23:43.158 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-03-08T23:23:43.158 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-03-08T23:23:43.185 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:43 vm05 ceph-mon[51825]: pgmap v38: 1 pgs: 1 active+clean; 449 KiB data, 106 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:43.185 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:43 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/1419512324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-08T23:23:43.185 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:43 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3617391095' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-08T23:23:43.185 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:43 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3617391095' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-08T23:23:43.199 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-03-08T23:23:43.199 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-03-08T23:23:43.199 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph mgr dump --format=json 2026-03-08T23:23:43.418 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:43.705 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:43.787 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"vm05.rlbdqk","active_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6800","nonce":1087853519},{"type":"v1","addr":"192.168.123.105:6801","nonce":1087853519}]},"active_addr":"192.168.123.105:6801/1087853519","active_change":"2026-03-08T23:23:03.451416+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14206,"name":"vm05.aawmpl","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://192.168.123.105:8443/","prometheus":"http://192.168.123.105:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":9,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":671539198}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":642014216}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":1951007095}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":787287449}]}]} 2026-03-08T23:23:43.789 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-03-08T23:23:43.789 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-03-08T23:23:43.789 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd dump --format=json 2026-03-08T23:23:43.971 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:44.215 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:44.215 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":25,"fsid":"82d18348-1b45-11f1-a9dd-c30ab03d28cc","created":"2026-03-08T23:21:59.912611+0000","modified":"2026-03-08T23:23:40.535955+0000","last_up_change":"2026-03-08T23:23:39.400488+0000","last_in_change":"2026-03-08T23:23:27.031520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-08T23:23:17.500117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27c6f8a3-1adc-4172-90e2-6a031a65d0ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6802","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6803","nonce":2454715299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6804","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6805","nonce":2454715299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6808","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6809","nonce":2454715299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6806","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6807","nonce":2454715299}]},"public_addr":"192.168.123.105:6803/2454715299","cluster_addr":"192.168.123.105:6805/2454715299","heartbeat_back_addr":"192.168.123.105:6809/2454715299","heartbeat_front_addr":"192.168.123.105:6807/2454715299","state":["exists","up"]},{"osd":1,"uuid":"3faa3668-4c65-4377-87d6-8fc1e4d6fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6810","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6811","nonce":1880282824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6812","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6813","nonce":1880282824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6816","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6817","nonce":1880282824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6814","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6815","nonce":1880282824}]},"public_addr":"192.168.123.105:6811/1880282824","cluster_addr":"192.168.123.105:6813/1880282824","heartbeat_back_addr":"192.168.123.105:6817/1880282824","heartbeat_front_addr":"192.168.123.105:6815/1880282824","state":["exists","up"]},{"osd":2,"uuid":"2ce2f8aa-e228-499d-9893-c4c1b806ce3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6818","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6819","nonce":3607964257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6820","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6821","nonce":3607964257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6824","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6825","nonce":3607964257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6822","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6823","nonce":3607964257}]},"public_addr":"192.168.123.105:6819/3607964257","cluster_addr":"192.168.123.105:6821/3607964257","heartbeat_back_addr":"192.168.123.105:6825/3607964257","heartbeat_front_addr":"192.168.123.105:6823/3607964257","state":["exists","up"]},{"osd":3,"uuid":"32f80c95-4425-4a87-a68e-31c46fd534a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6826","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6827","nonce":85592020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6828","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6829","nonce":85592020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6832","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6833","nonce":85592020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6830","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6831","nonce":85592020}]},"public_addr":"192.168.123.105:6827/85592020","cluster_addr":"192.168.123.105:6829/85592020","heartbeat_back_addr":"192.168.123.105:6833/85592020","heartbeat_front_addr":"192.168.123.105:6831/85592020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:22:56.313027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:15.101141+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:25.534914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:36.131436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.105:0/4192174501":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/1910561761":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/788864128":"2026-03-09T23:22:12.737263+0000","192.168.123.105:0/3305758083":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6800/3002756344":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6801/3781044049":"2026-03-09T23:22:25.174147+0000","192.168.123.105:6801/3002756344":"2026-03-09T23:22:12.737263+0000","192.168.123.105:0/4160456993":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/1198340302":"2026-03-09T23:22:25.174147+0000","192.168.123.105:6800/3785579562":"2026-03-09T23:23:03.451318+0000","192.168.123.105:6800/3781044049":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/275416405":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/1316985984":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6801/3785579562":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/1769883016":"2026-03-09T23:23:03.451318+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-08T23:23:44.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:44 vm05 ceph-mon[51825]: pgmap v39: 1 pgs: 1 active+clean; 449 KiB data, 106 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:44.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:44 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3022639208' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-08T23:23:44.488 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-03-08T23:23:44.488 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd dump --format=json 2026-03-08T23:23:44.660 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:44.890 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:44.890 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":25,"fsid":"82d18348-1b45-11f1-a9dd-c30ab03d28cc","created":"2026-03-08T23:21:59.912611+0000","modified":"2026-03-08T23:23:40.535955+0000","last_up_change":"2026-03-08T23:23:39.400488+0000","last_in_change":"2026-03-08T23:23:27.031520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-08T23:23:17.500117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27c6f8a3-1adc-4172-90e2-6a031a65d0ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6802","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6803","nonce":2454715299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6804","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6805","nonce":2454715299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6808","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6809","nonce":2454715299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6806","nonce":2454715299},{"type":"v1","addr":"192.168.123.105:6807","nonce":2454715299}]},"public_addr":"192.168.123.105:6803/2454715299","cluster_addr":"192.168.123.105:6805/2454715299","heartbeat_back_addr":"192.168.123.105:6809/2454715299","heartbeat_front_addr":"192.168.123.105:6807/2454715299","state":["exists","up"]},{"osd":1,"uuid":"3faa3668-4c65-4377-87d6-8fc1e4d6fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6810","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6811","nonce":1880282824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6812","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6813","nonce":1880282824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6816","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6817","nonce":1880282824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6814","nonce":1880282824},{"type":"v1","addr":"192.168.123.105:6815","nonce":1880282824}]},"public_addr":"192.168.123.105:6811/1880282824","cluster_addr":"192.168.123.105:6813/1880282824","heartbeat_back_addr":"192.168.123.105:6817/1880282824","heartbeat_front_addr":"192.168.123.105:6815/1880282824","state":["exists","up"]},{"osd":2,"uuid":"2ce2f8aa-e228-499d-9893-c4c1b806ce3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6818","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6819","nonce":3607964257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6820","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6821","nonce":3607964257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6824","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6825","nonce":3607964257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6822","nonce":3607964257},{"type":"v1","addr":"192.168.123.105:6823","nonce":3607964257}]},"public_addr":"192.168.123.105:6819/3607964257","cluster_addr":"192.168.123.105:6821/3607964257","heartbeat_back_addr":"192.168.123.105:6825/3607964257","heartbeat_front_addr":"192.168.123.105:6823/3607964257","state":["exists","up"]},{"osd":3,"uuid":"32f80c95-4425-4a87-a68e-31c46fd534a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6826","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6827","nonce":85592020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6828","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6829","nonce":85592020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6832","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6833","nonce":85592020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6830","nonce":85592020},{"type":"v1","addr":"192.168.123.105:6831","nonce":85592020}]},"public_addr":"192.168.123.105:6827/85592020","cluster_addr":"192.168.123.105:6829/85592020","heartbeat_back_addr":"192.168.123.105:6833/85592020","heartbeat_front_addr":"192.168.123.105:6831/85592020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:22:56.313027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:15.101141+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:25.534914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-08T23:23:36.131436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.105:0/4192174501":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/1910561761":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/788864128":"2026-03-09T23:22:12.737263+0000","192.168.123.105:0/3305758083":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6800/3002756344":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6801/3781044049":"2026-03-09T23:22:25.174147+0000","192.168.123.105:6801/3002756344":"2026-03-09T23:22:12.737263+0000","192.168.123.105:0/4160456993":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/1198340302":"2026-03-09T23:22:25.174147+0000","192.168.123.105:6800/3785579562":"2026-03-09T23:23:03.451318+0000","192.168.123.105:6800/3781044049":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/275416405":"2026-03-09T23:22:25.174147+0000","192.168.123.105:0/1316985984":"2026-03-09T23:22:12.737263+0000","192.168.123.105:6801/3785579562":"2026-03-09T23:23:03.451318+0000","192.168.123.105:0/1769883016":"2026-03-09T23:23:03.451318+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-08T23:23:44.945 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph tell osd.0 flush_pg_stats 2026-03-08T23:23:44.945 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph tell osd.1 flush_pg_stats 2026-03-08T23:23:44.945 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph tell osd.2 flush_pg_stats 2026-03-08T23:23:44.945 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph tell osd.3 flush_pg_stats 2026-03-08T23:23:45.310 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:45.332 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:45.353 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:45 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/4144659486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-08T23:23:45.354 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:45 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/1528192015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-08T23:23:45.372 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:45.451 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:45.787 INFO:teuthology.orchestra.run.vm05.stdout:55834574855 2026-03-08T23:23:45.787 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.1 2026-03-08T23:23:45.845 INFO:teuthology.orchestra.run.vm05.stdout:34359738379 2026-03-08T23:23:45.846 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.0 2026-03-08T23:23:45.854 INFO:teuthology.orchestra.run.vm05.stdout:85899345926 2026-03-08T23:23:45.854 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.2 2026-03-08T23:23:45.861 INFO:teuthology.orchestra.run.vm05.stdout:103079215107 2026-03-08T23:23:45.862 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.3 2026-03-08T23:23:46.095 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:46.107 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:46.357 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:46 vm05 ceph-mon[51825]: pgmap v40: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:46.410 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:46.457 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:46.515 INFO:teuthology.orchestra.run.vm05.stdout:55834574854 2026-03-08T23:23:46.627 INFO:teuthology.orchestra.run.vm05.stdout:34359738378 2026-03-08T23:23:46.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2026-03-08T23:23:46.703 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738379 got 34359738378 for osd.0 2026-03-08T23:23:46.825 INFO:teuthology.orchestra.run.vm05.stdout:85899345925 2026-03-08T23:23:46.849 INFO:teuthology.orchestra.run.vm05.stdout:103079215106 2026-03-08T23:23:46.932 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345926 got 85899345925 for osd.2 2026-03-08T23:23:46.934 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215107 got 103079215106 for osd.3 2026-03-08T23:23:47.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:47 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/1785863731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-08T23:23:47.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:47 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3802567655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-08T23:23:47.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:47 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3715333878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-08T23:23:47.469 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:47 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/2942242063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-08T23:23:47.636 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.1 2026-03-08T23:23:47.705 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.0 2026-03-08T23:23:47.838 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:47.932 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.2 2026-03-08T23:23:47.934 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph osd last-stat-seq osd.3 2026-03-08T23:23:47.972 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:48.164 INFO:teuthology.orchestra.run.vm05.stdout:55834574856 2026-03-08T23:23:48.303 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:48 vm05 ceph-mon[51825]: pgmap v41: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:48.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.1 2026-03-08T23:23:48.383 DEBUG:teuthology.parallel:result is None 2026-03-08T23:23:48.411 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:48.440 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:48.445 INFO:teuthology.orchestra.run.vm05.stdout:34359738379 2026-03-08T23:23:48.530 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738379 got 34359738379 for osd.0 2026-03-08T23:23:48.530 DEBUG:teuthology.parallel:result is None 2026-03-08T23:23:48.738 INFO:teuthology.orchestra.run.vm05.stdout:103079215107 2026-03-08T23:23:48.752 INFO:teuthology.orchestra.run.vm05.stdout:85899345926 2026-03-08T23:23:48.816 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.3 2026-03-08T23:23:48.816 DEBUG:teuthology.parallel:result is None 2026-03-08T23:23:48.835 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345926 got 85899345926 for osd.2 2026-03-08T23:23:48.835 DEBUG:teuthology.parallel:result is None 2026-03-08T23:23:48.835 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-03-08T23:23:48.835 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph pg dump --format=json 2026-03-08T23:23:49.056 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:49.284 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:49.284 INFO:teuthology.orchestra.run.vm05.stderr:dumped all 2026-03-08T23:23:49.350 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:49 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/896814877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-08T23:23:49.350 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:49 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/527171770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-08T23:23:49.350 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:49 vm05 ceph-mon[51825]: from='mgr.14208 192.168.123.105:0/2543704542' entity='mgr.vm05.rlbdqk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-08T23:23:49.350 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:49 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/2615548738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-08T23:23:49.350 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:49 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/3483406176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-08T23:23:49.350 INFO:teuthology.orchestra.run.vm05.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-03-08T23:23:47.476209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":83869696,"kb_used":109096,"kb_used_data":1736,"kb_used_omap":6,"kb_used_meta":107257,"kb_avail":83760600,"statfs":{"total":85882568704,"available":85770854400,"internally_reserved":0,"allocated":1777664,"data_stored":1215428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6358,"internal_metadata":109831978},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001487"},"pg_stats":[{"pgid":"1.0","version":"15'32","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-03-08T23:23:43.246008+0000","last_change":"2026-03-08T23:23:19.152305+0000","last_active":"2026-03-08T23:23:43.246008+0000","last_peered":"2026-03-08T23:23:43.246008+0000","last_clean":"2026-03-08T23:23:43.246008+0000","last_became_active":"2026-03-08T23:23:19.152207+0000","last_became_peered":"2026-03-08T23:23:19.152207+0000","last_unstale":"2026-03-08T23:23:43.246008+0000","last_undegraded":"2026-03-08T23:23:43.246008+0000","last_fullsized":"2026-03-08T23:23:43.246008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-08T23:23:18.140196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-08T23:23:18.140196+0000","last_clean_scrub_stamp":"2026-03-08T23:23:18.140196+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:57:27.081581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215107,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":27048,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940376,"statfs":{"total":21470642176,"available":21442945024,"internally_reserved":0,"allocated":212992,"data_stored":74217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27457996},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":27048,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940376,"statfs":{"total":21470642176,"available":21442945024,"internally_reserved":0,"allocated":212992,"data_stored":74217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27500,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939924,"statfs":{"total":21470642176,"available":21442482176,"internally_reserved":0,"allocated":675840,"data_stored":533497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27500,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939924,"statfs":{"total":21470642176,"available":21442482176,"internally_reserved":0,"allocated":675840,"data_stored":533497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-08T23:23:49.351 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph pg dump --format=json 2026-03-08T23:23:49.541 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:49.777 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:49.777 INFO:teuthology.orchestra.run.vm05.stderr:dumped all 2026-03-08T23:23:49.864 INFO:teuthology.orchestra.run.vm05.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-03-08T23:23:49.476413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":83869696,"kb_used":109096,"kb_used_data":1736,"kb_used_omap":6,"kb_used_meta":107257,"kb_avail":83760600,"statfs":{"total":85882568704,"available":85770854400,"internally_reserved":0,"allocated":1777664,"data_stored":1215428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6358,"internal_metadata":109831978},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.938212"},"pg_stats":[{"pgid":"1.0","version":"15'32","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-03-08T23:23:43.246008+0000","last_change":"2026-03-08T23:23:19.152305+0000","last_active":"2026-03-08T23:23:43.246008+0000","last_peered":"2026-03-08T23:23:43.246008+0000","last_clean":"2026-03-08T23:23:43.246008+0000","last_became_active":"2026-03-08T23:23:19.152207+0000","last_became_peered":"2026-03-08T23:23:19.152207+0000","last_unstale":"2026-03-08T23:23:43.246008+0000","last_undegraded":"2026-03-08T23:23:43.246008+0000","last_fullsized":"2026-03-08T23:23:43.246008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-08T23:23:18.140196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-08T23:23:18.140196+0000","last_clean_scrub_stamp":"2026-03-08T23:23:18.140196+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T03:57:27.081581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215107,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":27048,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940376,"statfs":{"total":21470642176,"available":21442945024,"internally_reserved":0,"allocated":212992,"data_stored":74217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27457996},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":27048,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940376,"statfs":{"total":21470642176,"available":21442945024,"internally_reserved":0,"allocated":212992,"data_stored":74217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27500,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939924,"statfs":{"total":21470642176,"available":21442482176,"internally_reserved":0,"allocated":675840,"data_stored":533497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27500,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939924,"statfs":{"total":21470642176,"available":21442482176,"internally_reserved":0,"allocated":675840,"data_stored":533497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-08T23:23:49.864 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-03-08T23:23:49.864 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-03-08T23:23:49.864 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-03-08T23:23:49.864 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph health --format=json 2026-03-08T23:23:50.059 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:50.312 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-08T23:23:50.312 INFO:teuthology.orchestra.run.vm05.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-03-08T23:23:50.368 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-03-08T23:23:50.369 INFO:tasks.cephadm:Setup complete, yielding 2026-03-08T23:23:50.369 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-03-08T23:23:50.371 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@vm05.local 2026-03-08T23:23:50.371 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch status' 2026-03-08T23:23:50.397 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:50 vm05 ceph-mon[51825]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-08T23:23:50.397 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:50 vm05 ceph-mon[51825]: pgmap v42: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:50.398 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:50 vm05 ceph-mon[51825]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-08T23:23:50.563 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:50.810 INFO:teuthology.orchestra.run.vm05.stdout:Backend: cephadm 2026-03-08T23:23:50.810 INFO:teuthology.orchestra.run.vm05.stdout:Available: Yes 2026-03-08T23:23:50.810 INFO:teuthology.orchestra.run.vm05.stdout:Paused: No 2026-03-08T23:23:50.874 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch ps' 2026-03-08T23:23:51.091 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:51.208 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:51 vm05 ceph-mon[51825]: from='client.? 192.168.123.105:0/1682506461' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-08T23:23:51.208 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:51 vm05 ceph-mon[51825]: from='client.14296 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:51.352 INFO:teuthology.orchestra.run.vm05.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:alertmanager.vm05 vm05 *:9093,9094 running (37s) 12s ago 71s 15.6M - 0.25.0 c8568f914cd2 ddb050c14edd 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:ceph-exporter.vm05 vm05 *:9926 running (79s) 12s ago 79s 8862k - 19.2.3-678-ge911bdeb 654f31e6858e 3db4861b71d7 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:crash.vm05 vm05 running (78s) 12s ago 78s 7616k - 19.2.3-678-ge911bdeb 654f31e6858e cddef4f62880 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:grafana.vm05 vm05 *:3000 running (36s) 12s ago 61s 67.6M - 10.4.0 c8b91775d855 e57354221ab1 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:mgr.vm05.aawmpl vm05 *:8443,8765 running (60s) 12s ago 60s 480M - 19.2.3-678-ge911bdeb 654f31e6858e 84ca1900a910 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:mgr.vm05.rlbdqk vm05 *:9283,8765,8443 running (108s) 12s ago 108s 544M - 19.2.3-678-ge911bdeb 654f31e6858e 5f799d1c520e 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:mon.vm05 vm05 running (109s) 12s ago 111s 49.4M 2048M 19.2.3-678-ge911bdeb 654f31e6858e 1c9e03fa435c 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:node-exporter.vm05 vm05 *:9100 running (75s) 12s ago 75s 9135k - 1.7.0 72c9c2088986 0c60222745d4 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:osd.0 vm05 running (57s) 12s ago 57s 36.0M 4096M 19.2.3-678-ge911bdeb 654f31e6858e eb998addbada 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:osd.1 vm05 running (39s) 12s ago 39s 40.6M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 306065f17d28 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:osd.2 vm05 running (28s) 12s ago 28s 54.3M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 631f81deaad1 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:osd.3 vm05 running (17s) 12s ago 17s 25.5M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 14e1ceac49f9 2026-03-08T23:23:51.353 INFO:teuthology.orchestra.run.vm05.stdout:prometheus.vm05 vm05 *:9095 running (52s) 12s ago 52s 33.1M - 2.51.0 1d3b7f56885b 692aa7c8e813 2026-03-08T23:23:51.406 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch ls' 2026-03-08T23:23:51.590 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:alertmanager ?:9093,9094 1/1 12s ago 92s count:1 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:ceph-exporter ?:9926 1/1 12s ago 93s * 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:crash 1/1 12s ago 93s * 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:grafana ?:3000 1/1 12s ago 92s count:1 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:mgr 2/2 12s ago 94s count:2 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:mon 1/1 12s ago 79s vm05:192.168.123.105=vm05;count:1 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:node-exporter ?:9100 1/1 12s ago 92s * 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:osd 4 12s ago - 2026-03-08T23:23:51.842 INFO:teuthology.orchestra.run.vm05.stdout:prometheus ?:9095 1/1 12s ago 93s count:1 2026-03-08T23:23:51.893 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch host ls' 2026-03-08T23:23:52.091 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:52.322 INFO:teuthology.orchestra.run.vm05.stdout:HOST ADDR LABELS STATUS 2026-03-08T23:23:52.322 INFO:teuthology.orchestra.run.vm05.stdout:vm05 192.168.123.105 2026-03-08T23:23:52.322 INFO:teuthology.orchestra.run.vm05.stdout:1 hosts in cluster 2026-03-08T23:23:52.398 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:52 vm05 ceph-mon[51825]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:52.398 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:52 vm05 ceph-mon[51825]: pgmap v43: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:52.398 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:52 vm05 ceph-mon[51825]: from='client.14300 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:52.399 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch device ls' 2026-03-08T23:23:52.592 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:52.831 INFO:teuthology.orchestra.run.vm05.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-03-08T23:23:52.831 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/sr0 hdd QEMU_DVD-ROM_QM00003 366k No 16s ago Has a FileSystem, Insufficient space (<5GB) 2026-03-08T23:23:52.831 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vdb hdd DWNBRSTVMM05001 20.0G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:52.831 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vdc hdd DWNBRSTVMM05002 20.0G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:52.831 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vdd hdd DWNBRSTVMM05003 20.0G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:52.831 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vde hdd DWNBRSTVMM05004 20.0G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:52.901 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-03-08T23:23:52.904 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@vm05.local 2026-03-08T23:23:52.904 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch status' 2026-03-08T23:23:53.079 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:53.194 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:53 vm05 ceph-mon[51825]: from='client.14302 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:53.195 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:53 vm05 ceph-mon[51825]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:53.318 INFO:teuthology.orchestra.run.vm05.stdout:Backend: cephadm 2026-03-08T23:23:53.318 INFO:teuthology.orchestra.run.vm05.stdout:Available: Yes 2026-03-08T23:23:53.318 INFO:teuthology.orchestra.run.vm05.stdout:Paused: No 2026-03-08T23:23:53.386 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch ps' 2026-03-08T23:23:53.558 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:alertmanager.vm05 vm05 *:9093,9094 running (40s) 14s ago 74s 15.6M - 0.25.0 c8568f914cd2 ddb050c14edd 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:ceph-exporter.vm05 vm05 *:9926 running (81s) 14s ago 81s 8862k - 19.2.3-678-ge911bdeb 654f31e6858e 3db4861b71d7 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:crash.vm05 vm05 running (80s) 14s ago 80s 7616k - 19.2.3-678-ge911bdeb 654f31e6858e cddef4f62880 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:grafana.vm05 vm05 *:3000 running (38s) 14s ago 63s 67.6M - 10.4.0 c8b91775d855 e57354221ab1 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:mgr.vm05.aawmpl vm05 *:8443,8765 running (62s) 14s ago 62s 480M - 19.2.3-678-ge911bdeb 654f31e6858e 84ca1900a910 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:mgr.vm05.rlbdqk vm05 *:9283,8765,8443 running (111s) 14s ago 111s 544M - 19.2.3-678-ge911bdeb 654f31e6858e 5f799d1c520e 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:mon.vm05 vm05 running (111s) 14s ago 113s 49.4M 2048M 19.2.3-678-ge911bdeb 654f31e6858e 1c9e03fa435c 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:node-exporter.vm05 vm05 *:9100 running (77s) 14s ago 77s 9135k - 1.7.0 72c9c2088986 0c60222745d4 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:osd.0 vm05 running (60s) 14s ago 60s 36.0M 4096M 19.2.3-678-ge911bdeb 654f31e6858e eb998addbada 2026-03-08T23:23:53.790 INFO:teuthology.orchestra.run.vm05.stdout:osd.1 vm05 running (41s) 14s ago 41s 40.6M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 306065f17d28 2026-03-08T23:23:53.791 INFO:teuthology.orchestra.run.vm05.stdout:osd.2 vm05 running (31s) 14s ago 30s 54.3M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 631f81deaad1 2026-03-08T23:23:53.791 INFO:teuthology.orchestra.run.vm05.stdout:osd.3 vm05 running (20s) 14s ago 20s 25.5M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 14e1ceac49f9 2026-03-08T23:23:53.791 INFO:teuthology.orchestra.run.vm05.stdout:prometheus.vm05 vm05 *:9095 running (54s) 14s ago 54s 33.1M - 2.51.0 1d3b7f56885b 692aa7c8e813 2026-03-08T23:23:53.846 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch ls' 2026-03-08T23:23:54.018 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:alertmanager ?:9093,9094 1/1 15s ago 94s count:1 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:ceph-exporter ?:9926 1/1 15s ago 95s * 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:crash 1/1 15s ago 96s * 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:grafana ?:3000 1/1 15s ago 95s count:1 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:mgr 2/2 15s ago 96s count:2 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:mon 1/1 15s ago 82s vm05:192.168.123.105=vm05;count:1 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:node-exporter ?:9100 1/1 15s ago 94s * 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:osd 4 15s ago - 2026-03-08T23:23:54.264 INFO:teuthology.orchestra.run.vm05.stdout:prometheus ?:9095 1/1 15s ago 95s count:1 2026-03-08T23:23:54.348 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch host ls' 2026-03-08T23:23:54.349 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:54 vm05 ceph-mon[51825]: from='client.14306 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:54.349 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:54 vm05 ceph-mon[51825]: pgmap v44: 1 pgs: 1 active+clean; 449 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-08T23:23:54.349 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:54 vm05 ceph-mon[51825]: from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:54.526 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:54.771 INFO:teuthology.orchestra.run.vm05.stdout:HOST ADDR LABELS STATUS 2026-03-08T23:23:54.771 INFO:teuthology.orchestra.run.vm05.stdout:vm05 192.168.123.105 2026-03-08T23:23:54.771 INFO:teuthology.orchestra.run.vm05.stdout:1 hosts in cluster 2026-03-08T23:23:54.852 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- bash -c 'ceph orch device ls' 2026-03-08T23:23:55.041 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:55.276 INFO:teuthology.orchestra.run.vm05.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-03-08T23:23:55.277 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/sr0 hdd QEMU_DVD-ROM_QM00003 366k No 18s ago Has a FileSystem, Insufficient space (<5GB) 2026-03-08T23:23:55.277 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vdb hdd DWNBRSTVMM05001 20.0G No 18s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:55.277 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vdc hdd DWNBRSTVMM05002 20.0G No 18s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:55.277 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vdd hdd DWNBRSTVMM05003 20.0G No 18s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:55.277 INFO:teuthology.orchestra.run.vm05.stdout:vm05 /dev/vde hdd DWNBRSTVMM05004 20.0G No 18s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-08T23:23:55.344 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-03-08T23:23:55.346 INFO:tasks.cephadm:Teardown begin 2026-03-08T23:23:55.346 DEBUG:teuthology.orchestra.run.vm05:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-08T23:23:55.378 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-03-08T23:23:55.378 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc -- ceph mgr module disable cephadm 2026-03-08T23:23:55.443 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:55 vm05 ceph-mon[51825]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:55.443 INFO:journalctl@ceph.mon.vm05.vm05.stdout:Mar 08 23:23:55 vm05 ceph-mon[51825]: from='client.14312 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-08T23:23:55.609 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/mon.vm05/config 2026-03-08T23:23:55.629 INFO:teuthology.orchestra.run.vm05.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-03-08T23:23:55.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-03-08T23:23:55.652 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-03-08T23:23:55.652 DEBUG:teuthology.orchestra.run.vm05:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-03-08T23:23:55.707 INFO:tasks.cephadm:Stopping all daemons... 2026-03-08T23:23:55.708 INFO:tasks.cephadm.mon.vm05:Stopping mon.vm05... 2026-03-08T23:23:55.708 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05 2026-03-08T23:23:55.964 DEBUG:teuthology.orchestra.run.vm05:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@mon.vm05.service' 2026-03-08T23:23:56.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-08T23:23:56.002 INFO:tasks.cephadm.mon.vm05:Stopped mon.vm05 2026-03-08T23:23:56.002 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-03-08T23:23:56.002 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.0 2026-03-08T23:23:56.354 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:56 vm05 systemd[1]: Stopping Ceph osd.0 for 82d18348-1b45-11f1-a9dd-c30ab03d28cc... 2026-03-08T23:23:56.355 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:56 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0[64318]: 2026-03-08T23:23:56.146+0000 7f0035f9d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-08T23:23:56.355 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:56 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0[64318]: 2026-03-08T23:23:56.146+0000 7f0035f9d640 -1 osd.0 25 *** Got signal Terminated *** 2026-03-08T23:23:56.355 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:23:56 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0[64318]: 2026-03-08T23:23:56.146+0000 7f0035f9d640 -1 osd.0 25 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-08T23:24:01.448 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 podman[90680]: 2026-03-08 23:24:01.164765828 +0000 UTC m=+5.031859889 container died eb998addbadafce781e95eb1d0c3edfd41b45cc33c113f675c58b162389d7c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, org.label-schema.license=GPLv2) 2026-03-08T23:24:01.449 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 podman[90680]: 2026-03-08 23:24:01.198172699 +0000 UTC m=+5.065266759 container remove eb998addbadafce781e95eb1d0c3edfd41b45cc33c113f675c58b162389d7c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid) 2026-03-08T23:24:01.449 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 bash[90680]: ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0 2026-03-08T23:24:01.449 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 podman[90743]: 2026-03-08 23:24:01.358071594 +0000 UTC m=+0.020132132 container create d836cfc6d599ccfbb36a769f8a9bc8e18b40b055e54af10c321779d3e07adcca (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0-deactivate, org.opencontainers.image.authors=Ceph Release Team , ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0) 2026-03-08T23:24:01.449 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 podman[90743]: 2026-03-08 23:24:01.4063435 +0000 UTC m=+0.068404050 container init d836cfc6d599ccfbb36a769f8a9bc8e18b40b055e54af10c321779d3e07adcca (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0-deactivate, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-08T23:24:01.449 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 podman[90743]: 2026-03-08 23:24:01.409787655 +0000 UTC m=+0.071848204 container start d836cfc6d599ccfbb36a769f8a9bc8e18b40b055e54af10c321779d3e07adcca (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0-deactivate, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3) 2026-03-08T23:24:01.449 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 08 23:24:01 vm05 podman[90743]: 2026-03-08 23:24:01.413700156 +0000 UTC m=+0.075760705 container attach d836cfc6d599ccfbb36a769f8a9bc8e18b40b055e54af10c321779d3e07adcca (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-0-deactivate, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image) 2026-03-08T23:24:01.589 DEBUG:teuthology.orchestra.run.vm05:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.0.service' 2026-03-08T23:24:01.625 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-08T23:24:01.625 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-03-08T23:24:01.625 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-03-08T23:24:01.625 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.1 2026-03-08T23:24:01.768 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:01 vm05 systemd[1]: Stopping Ceph osd.1 for 82d18348-1b45-11f1-a9dd-c30ab03d28cc... 2026-03-08T23:24:02.103 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:01 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1[71005]: 2026-03-08T23:24:01.767+0000 7fbcc15ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-08T23:24:02.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:01 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1[71005]: 2026-03-08T23:24:01.767+0000 7fbcc15ce640 -1 osd.1 25 *** Got signal Terminated *** 2026-03-08T23:24:02.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:01 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1[71005]: 2026-03-08T23:24:01.767+0000 7fbcc15ce640 -1 osd.1 25 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 podman[90839]: 2026-03-08 23:24:06.795257449 +0000 UTC m=+5.041872492 container died 306065f17d28624c7d8f25a67a9b13813f7b53dbdd889e8e50da008bdf08ab6c (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 podman[90839]: 2026-03-08 23:24:06.815772558 +0000 UTC m=+5.062387611 container remove 306065f17d28624c7d8f25a67a9b13813f7b53dbdd889e8e50da008bdf08ab6c (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 bash[90839]: ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 podman[90906]: 2026-03-08 23:24:06.951593126 +0000 UTC m=+0.016120085 container create 4480e5c267ab7225345706707a0b6e9da7e11856b45197ed465ba85025973bef (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 podman[90906]: 2026-03-08 23:24:06.991568348 +0000 UTC m=+0.056095307 container init 4480e5c267ab7225345706707a0b6e9da7e11856b45197ed465ba85025973bef (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 podman[90906]: 2026-03-08 23:24:06.994240478 +0000 UTC m=+0.058767437 container start 4480e5c267ab7225345706707a0b6e9da7e11856b45197ed465ba85025973bef (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:06 vm05 podman[90906]: 2026-03-08 23:24:06.998070355 +0000 UTC m=+0.062597314 container attach 4480e5c267ab7225345706707a0b6e9da7e11856b45197ed465ba85025973bef (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-1-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_REF=squid) 2026-03-08T23:24:07.104 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 08 23:24:07 vm05 podman[90906]: 2026-03-08 23:24:06.944695679 +0000 UTC m=+0.009222648 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-08T23:24:07.162 DEBUG:teuthology.orchestra.run.vm05:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.1.service' 2026-03-08T23:24:07.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-08T23:24:07.193 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-03-08T23:24:07.193 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-03-08T23:24:07.193 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.2 2026-03-08T23:24:07.603 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:07 vm05 systemd[1]: Stopping Ceph osd.2 for 82d18348-1b45-11f1-a9dd-c30ab03d28cc... 2026-03-08T23:24:07.604 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:07 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2[77006]: 2026-03-08T23:24:07.342+0000 7f5d1e97b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-08T23:24:07.604 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:07 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2[77006]: 2026-03-08T23:24:07.342+0000 7f5d1e97b640 -1 osd.2 25 *** Got signal Terminated *** 2026-03-08T23:24:07.604 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:07 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2[77006]: 2026-03-08T23:24:07.342+0000 7f5d1e97b640 -1 osd.2 25 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91003]: 2026-03-08 23:24:12.371593867 +0000 UTC m=+5.046431034 container stop 631f81deaad15b56c389be848d66650a5fdd6fb41da831acba9e2c7d7b6223c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91003]: 2026-03-08 23:24:12.402127181 +0000 UTC m=+5.076964339 container died 631f81deaad15b56c389be848d66650a5fdd6fb41da831acba9e2c7d7b6223c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default) 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91003]: 2026-03-08 23:24:12.423494885 +0000 UTC m=+5.098332043 container remove 631f81deaad15b56c389be848d66650a5fdd6fb41da831acba9e2c7d7b6223c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 bash[91003]: ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91071]: 2026-03-08 23:24:12.561079374 +0000 UTC m=+0.017569758 container create 6eb92af770ab714d8773a0358aefd0080e7b324373f7e314cbe85f0270d1525b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2-deactivate, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, OSD_FLAVOR=default, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3) 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91071]: 2026-03-08 23:24:12.599834542 +0000 UTC m=+0.056324937 container init 6eb92af770ab714d8773a0358aefd0080e7b324373f7e314cbe85f0270d1525b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2-deactivate, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_REF=squid) 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91071]: 2026-03-08 23:24:12.602493177 +0000 UTC m=+0.058983562 container start 6eb92af770ab714d8773a0358aefd0080e7b324373f7e314cbe85f0270d1525b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_REF=squid, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-08T23:24:12.653 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 08 23:24:12 vm05 podman[91071]: 2026-03-08 23:24:12.60334451 +0000 UTC m=+0.059834905 container attach 6eb92af770ab714d8773a0358aefd0080e7b324373f7e314cbe85f0270d1525b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-2-deactivate, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, ceph=True, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2) 2026-03-08T23:24:12.768 DEBUG:teuthology.orchestra.run.vm05:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.2.service' 2026-03-08T23:24:12.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-08T23:24:12.804 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-03-08T23:24:12.804 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-03-08T23:24:12.804 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.3 2026-03-08T23:24:12.946 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:12 vm05 systemd[1]: Stopping Ceph osd.3 for 82d18348-1b45-11f1-a9dd-c30ab03d28cc... 2026-03-08T23:24:13.353 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:12 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3[83039]: 2026-03-08T23:24:12.945+0000 7f23d17d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-08T23:24:13.353 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:12 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3[83039]: 2026-03-08T23:24:12.945+0000 7f23d17d3640 -1 osd.3 25 *** Got signal Terminated *** 2026-03-08T23:24:13.353 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:12 vm05 ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3[83039]: 2026-03-08T23:24:12.945+0000 7f23d17d3640 -1 osd.3 25 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-08T23:24:18.243 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:17 vm05 podman[91166]: 2026-03-08 23:24:17.987238355 +0000 UTC m=+5.056102430 container died 14e1ceac49f91a56e26e9fcf3fef2c7b42e5e42aa9856170f29f5440aedf1af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_REF=squid, OSD_FLAVOR=default, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-08T23:24:18.244 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:18 vm05 podman[91166]: 2026-03-08 23:24:18.014804637 +0000 UTC m=+5.083668722 container remove 14e1ceac49f91a56e26e9fcf3fef2c7b42e5e42aa9856170f29f5440aedf1af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=squid, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-03-08T23:24:18.244 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:18 vm05 bash[91166]: ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3 2026-03-08T23:24:18.244 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:18 vm05 podman[91234]: 2026-03-08 23:24:18.150438146 +0000 UTC m=+0.015886388 container create afc1a2dda5c7a5bf3f81d209715233a21d851093d82ce87d4fba5038dc755c40 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image) 2026-03-08T23:24:18.244 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:18 vm05 podman[91234]: 2026-03-08 23:24:18.188071527 +0000 UTC m=+0.053519769 container init afc1a2dda5c7a5bf3f81d209715233a21d851093d82ce87d4fba5038dc755c40 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-03-08T23:24:18.244 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:18 vm05 podman[91234]: 2026-03-08 23:24:18.191072271 +0000 UTC m=+0.056520513 container start afc1a2dda5c7a5bf3f81d209715233a21d851093d82ce87d4fba5038dc755c40 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3-deactivate, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_REF=squid, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-08T23:24:18.244 INFO:journalctl@ceph.osd.3.vm05.stdout:Mar 08 23:24:18 vm05 podman[91234]: 2026-03-08 23:24:18.19715872 +0000 UTC m=+0.062606952 container attach afc1a2dda5c7a5bf3f81d209715233a21d851093d82ce87d4fba5038dc755c40 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc-osd-3-deactivate, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-08T23:24:18.374 DEBUG:teuthology.orchestra.run.vm05:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82d18348-1b45-11f1-a9dd-c30ab03d28cc@osd.3.service' 2026-03-08T23:24:18.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-08T23:24:18.407 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-03-08T23:24:18.407 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc --force --keep-logs 2026-03-08T23:24:18.580 INFO:teuthology.orchestra.run.vm05.stdout:Deleting cluster with fsid: 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:24:22.977 DEBUG:teuthology.orchestra.run.vm05:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-08T23:24:23.001 INFO:tasks.cephadm:Archiving crash dumps... 2026-03-08T23:24:23.001 DEBUG:teuthology.misc:Transferring archived files from vm05:/var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/crash to /archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/298/remote/vm05/crash 2026-03-08T23:24:23.001 DEBUG:teuthology.orchestra.run.vm05:> sudo tar c -f - -C /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/crash -- . 2026-03-08T23:24:23.064 INFO:teuthology.orchestra.run.vm05.stderr:tar: /var/lib/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/crash: Cannot open: No such file or directory 2026-03-08T23:24:23.064 INFO:teuthology.orchestra.run.vm05.stderr:tar: Error is not recoverable: exiting now 2026-03-08T23:24:23.065 INFO:tasks.cephadm:Checking cluster log for badness... 2026-03-08T23:24:23.065 DEBUG:teuthology.orchestra.run.vm05:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v OSD_DOWN | head -n 1 2026-03-08T23:24:23.131 INFO:tasks.cephadm:Compressing logs... 2026-03-08T23:24:23.131 DEBUG:teuthology.orchestra.run.vm05:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-03-08T23:24:23.193 INFO:teuthology.orchestra.run.vm05.stderr:find: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-03-08T23:24:23.193 INFO:teuthology.orchestra.run.vm05.stderr:‘/var/log/rbd-target-api’: No such file or directory 2026-03-08T23:24:23.194 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mon.vm05.log 2026-03-08T23:24:23.196 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mon.vm05.log: gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.log 2026-03-08T23:24:23.202 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mgr.vm05.rlbdqk.log 2026-03-08T23:24:23.202 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.log: 84.0% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.log.gz 2026-03-08T23:24:23.204 INFO:teuthology.orchestra.run.vm05.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2026-03-08T23:24:23.205 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.audit.log 2026-03-08T23:24:23.213 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mgr.vm05.rlbdqk.log: gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.cephadm.log 2026-03-08T23:24:23.213 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.audit.log: 89.7% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.audit.log.gz 2026-03-08T23:24:23.218 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-volume.log 2026-03-08T23:24:23.218 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.cephadm.log: 80.7% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph.cephadm.log.gz 2026-03-08T23:24:23.226 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-client.ceph-exporter.vm05.log 2026-03-08T23:24:23.236 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.0.log 2026-03-08T23:24:23.236 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-client.ceph-exporter.vm05.log: 90.9% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-client.ceph-exporter.vm05.log.gz 2026-03-08T23:24:23.238 INFO:teuthology.orchestra.run.vm05.stderr: 95.4% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-volume.log.gz 2026-03-08T23:24:23.244 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mgr.vm05.aawmpl.log 2026-03-08T23:24:23.245 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.0.log: 90.1% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mgr.vm05.rlbdqk.log.gz 2026-03-08T23:24:23.246 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.1.log 2026-03-08T23:24:23.248 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mgr.vm05.aawmpl.log: 91.2% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mgr.vm05.aawmpl.log.gz 2026-03-08T23:24:23.249 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.2.log 2026-03-08T23:24:23.255 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.3.log 2026-03-08T23:24:23.264 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.2.log: 93.4% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.0.log.gz 2026-03-08T23:24:23.264 INFO:teuthology.orchestra.run.vm05.stderr: 91.4% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-mon.vm05.log.gz 2026-03-08T23:24:23.270 INFO:teuthology.orchestra.run.vm05.stderr:/var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.3.log: 93.5% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.2.log.gz 2026-03-08T23:24:23.271 INFO:teuthology.orchestra.run.vm05.stderr: 93.6% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.3.log.gz 2026-03-08T23:24:23.272 INFO:teuthology.orchestra.run.vm05.stderr: 93.7% -- replaced with /var/log/ceph/82d18348-1b45-11f1-a9dd-c30ab03d28cc/ceph-osd.1.log.gz 2026-03-08T23:24:23.274 INFO:teuthology.orchestra.run.vm05.stderr: 2026-03-08T23:24:23.274 INFO:teuthology.orchestra.run.vm05.stderr:real 0m0.090s 2026-03-08T23:24:23.274 INFO:teuthology.orchestra.run.vm05.stderr:user 0m0.142s 2026-03-08T23:24:23.274 INFO:teuthology.orchestra.run.vm05.stderr:sys 0m0.028s 2026-03-08T23:24:23.275 INFO:tasks.cephadm:Archiving logs... 2026-03-08T23:24:23.275 DEBUG:teuthology.misc:Transferring archived files from vm05:/var/log/ceph to /archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/298/remote/vm05/log 2026-03-08T23:24:23.275 DEBUG:teuthology.orchestra.run.vm05:> sudo tar c -f - -C /var/log/ceph -- . 2026-03-08T23:24:23.352 INFO:tasks.cephadm:Removing cluster... 2026-03-08T23:24:23.352 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82d18348-1b45-11f1-a9dd-c30ab03d28cc --force 2026-03-08T23:24:23.522 INFO:teuthology.orchestra.run.vm05.stdout:Deleting cluster with fsid: 82d18348-1b45-11f1-a9dd-c30ab03d28cc 2026-03-08T23:24:23.631 INFO:tasks.cephadm:Removing cephadm ... 2026-03-08T23:24:23.631 DEBUG:teuthology.orchestra.run.vm05:> rm -rf /home/ubuntu/cephtest/cephadm 2026-03-08T23:24:23.646 INFO:tasks.cephadm:Teardown complete 2026-03-08T23:24:23.647 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-03-08T23:24:23.649 INFO:teuthology.task.clock:Checking final clock skew... 2026-03-08T23:24:23.649 DEBUG:teuthology.orchestra.run.vm05:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-08T23:24:23.702 INFO:teuthology.orchestra.run.vm05.stderr:bash: line 1: ntpq: command not found 2026-03-08T23:24:23.707 INFO:teuthology.orchestra.run.vm05.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-08T23:24:23.707 INFO:teuthology.orchestra.run.vm05.stdout:=============================================================================== 2026-03-08T23:24:23.707 INFO:teuthology.orchestra.run.vm05.stdout:^+ ntp2.uni-ulm.de 2 6 77 53 -247us[ -212us] +/- 15ms 2026-03-08T23:24:23.707 INFO:teuthology.orchestra.run.vm05.stdout:^* vps-ber1.orleans.ddnss.de 2 6 77 52 -1270us[-1235us] +/- 16ms 2026-03-08T23:24:23.707 INFO:teuthology.orchestra.run.vm05.stdout:^+ 139-162-156-95.ip.linode> 2 6 77 52 +3572us[+3607us] +/- 33ms 2026-03-08T23:24:23.707 INFO:teuthology.orchestra.run.vm05.stdout:^+ nbg01.muxx.net 2 6 77 53 +37us[ +72us] +/- 16ms 2026-03-08T23:24:23.708 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-03-08T23:24:23.709 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-03-08T23:24:23.710 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-03-08T23:24:23.712 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-03-08T23:24:23.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-03-08T23:24:23.716 INFO:teuthology.task.internal:Duration was 312.334114 seconds 2026-03-08T23:24:23.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-03-08T23:24:23.718 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-03-08T23:24:23.718 DEBUG:teuthology.orchestra.run.vm05:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-03-08T23:24:23.784 INFO:teuthology.orchestra.run.vm05.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-08T23:24:23.885 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-03-08T23:24:23.885 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@vm05.local 2026-03-08T23:24:23.885 DEBUG:teuthology.orchestra.run.vm05:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-03-08T23:24:23.947 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-03-08T23:24:23.947 DEBUG:teuthology.orchestra.run.vm05:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-08T23:24:24.505 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-03-08T23:24:24.505 DEBUG:teuthology.orchestra.run.vm05:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-03-08T23:24:24.526 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-08T23:24:24.526 INFO:teuthology.orchestra.run.vm05.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-08T23:24:24.526 INFO:teuthology.orchestra.run.vm05.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: gzip 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-03-08T23:24:24.526 INFO:teuthology.orchestra.run.vm05.stderr: -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-08T23:24:24.527 INFO:teuthology.orchestra.run.vm05.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/journalctl.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-03-08T23:24:24.691 INFO:teuthology.orchestra.run.vm05.stderr: 97.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-03-08T23:24:24.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-03-08T23:24:24.695 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-03-08T23:24:24.695 DEBUG:teuthology.orchestra.run.vm05:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-03-08T23:24:24.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-03-08T23:24:24.761 DEBUG:teuthology.orchestra.run.vm05:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-03-08T23:24:24.825 INFO:teuthology.orchestra.run.vm05.stdout:kernel.core_pattern = core 2026-03-08T23:24:24.838 DEBUG:teuthology.orchestra.run.vm05:> test -e /home/ubuntu/cephtest/archive/coredump 2026-03-08T23:24:24.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-08T23:24:24.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-03-08T23:24:24.894 INFO:teuthology.task.internal:Transferring archived files... 2026-03-08T23:24:24.894 DEBUG:teuthology.misc:Transferring archived files from vm05:/home/ubuntu/cephtest/archive to /archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/298/remote/vm05 2026-03-08T23:24:24.894 DEBUG:teuthology.orchestra.run.vm05:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-03-08T23:24:24.959 INFO:teuthology.task.internal:Removing archive directory... 2026-03-08T23:24:24.959 DEBUG:teuthology.orchestra.run.vm05:> rm -rf -- /home/ubuntu/cephtest/archive 2026-03-08T23:24:25.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-03-08T23:24:25.017 INFO:teuthology.task.internal:Not uploading archives. 2026-03-08T23:24:25.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-03-08T23:24:25.019 INFO:teuthology.task.internal:Tidying up after the test... 2026-03-08T23:24:25.019 DEBUG:teuthology.orchestra.run.vm05:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-03-08T23:24:25.073 INFO:teuthology.orchestra.run.vm05.stdout: 8532146 0 drwxr-xr-x 2 ubuntu ubuntu 6 Mar 8 23:24 /home/ubuntu/cephtest 2026-03-08T23:24:25.074 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-03-08T23:24:25.079 INFO:teuthology.run:Summary data: description: orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} duration: 312.3341135978699 owner: kyr success: true 2026-03-08T23:24:25.079 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-08T23:24:25.097 INFO:teuthology.run:pass