Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 4636 2026-03-31 23:51:24 2026-04-01 02:13:16 2026-04-01 02:24:53 0:11:37 0:08:14 0:03:23 vps uv2 rocky 9.7 rgw/bucket-logging/{0-install beast fixed-1 ignore-pg-availability overrides s3tests-branch supported-distros/{rocky_latest} tasks/{s3tests}} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm04 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and bucket_logging'"

fail 4637 2026-03-31 23:51:24 2026-04-01 02:14:52 2026-04-01 02:51:31 0:36:39 0:34:06 0:02:33 vps uv2 rocky 9.7 rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{rocky_latest} tasks/restore/cloud_restore_s3tests} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm09 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and cloud_restore and not bucket_logging'"

fail 4638 2026-03-31 23:51:25 2026-04-01 02:15:28 2026-04-01 02:36:08 0:20:40 0:18:44 0:01:56 vps uv2 rocky 9.7 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides rocky_latest s3tests-branch} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm05 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

pass 4639 2026-03-31 23:51:25 2026-04-01 02:16:06 2026-04-01 02:27:09 0:11:03 0:09:30 0:01:33 vps uv2 rocky 9.7 rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{rocky_latest} tasks/rgw_s3tests} 1
fail 4640 2026-03-31 23:51:26 2026-04-01 02:17:08 2026-04-01 03:00:52 0:43:44 0:39:10 0:04:34 vps uv2 rocky 9.7 rgw/dedup/{beast bluestore-bitmap fixed-3-rgw ignore-pg-availability overrides supported-distros/{rocky_latest} tasks/{0-install test_dedup}} 3
Failure Reason:

Command failed on vm03 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph'

fail 4641 2026-03-31 23:51:26 2026-04-01 02:20:49 2026-04-01 02:59:57 0:39:08 0:35:58 0:03:10 vps uv2 rocky 9.7 rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{rocky_latest} tasks/rgw_s3tests} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm02 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

pass 4642 2026-03-31 23:51:26 2026-04-01 02:21:54 2026-04-01 02:32:58 0:11:04 0:09:05 0:01:59 vps uv2 rocky 9.7 rgw/lua/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides supported-distros/{rocky_latest} tasks/{0-install test_lua}} 2
fail 4643 2026-03-31 23:51:27 2026-04-01 02:22:56 2026-04-01 02:50:36 0:27:40 0:20:09 0:07:31 vps uv2 rocky 9.7 rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile rocky_latest s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota}} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm00 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4644 2026-03-31 23:51:27 2026-04-01 02:28:34 2026-04-01 03:48:27 1:19:53 0:54:00 0:25:53 vps uv2 rocky 9.7 rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{rocky_latest} tasks/test_multi} 4
Failure Reason:

rgw multisite test failures

fail 4645 2026-03-31 23:51:28 2026-04-01 02:52:23 2026-04-01 03:11:52 0:19:29 0:17:08 0:02:21 vps uv2 centos 9.stream rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/amqp/{0-install centos_latest test_amqp} valgrind} 2
Failure Reason:

Command failed (bucket notification tests against different endpoints) on vm00 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test'

pass 4646 2026-03-31 23:51:28 2026-04-01 02:53:50 2026-04-01 03:08:35 0:14:45 0:06:24 0:08:21 vps uv2 rocky 9.7 rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest tasks/service-token} 1
pass 4647 2026-03-31 23:51:29 2026-04-01 03:00:34 2026-04-01 03:12:00 0:11:26 0:08:19 0:03:07 vps uv2 rocky 9.7 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rocky_latest}} 2
fail 4648 2026-03-31 23:51:29 2026-04-01 03:01:59 2026-04-01 03:41:28 0:39:29 0:31:06 0:08:23 vps uv2 rocky 9.7 rgw/sts/{auth-order/local-sts cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{rocky_latest} tasks/{0-install 1-keycloak 2-s3tests}} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm02 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4649 2026-03-31 23:51:30 2026-04-01 03:09:26 2026-04-01 03:34:31 0:25:05 0:20:05 0:05:00 vps uv2 rocky 9.7 rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest s3tests-branch tasks/s3/{auth-order/external-local s3tests}} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm09 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

pass 4650 2026-03-31 23:51:30 2026-04-01 03:12:30 2026-04-01 03:25:22 0:12:52 0:10:17 0:02:35 vps uv2 rocky 9.7 rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap rocky_latest s3tests-branch thrasher/default thrashosds-health workload/rgw_bucket_quota} 2
pass 4651 2026-03-31 23:51:30 2026-04-01 03:13:20 2026-04-01 03:25:59 0:12:39 0:11:31 0:01:08 vps uv2 rocky 9.7 rgw/tools/{cluster ignore-pg-availability rocky_latest tasks} 1
fail 4652 2026-03-31 23:51:31 2026-04-01 03:13:57 2026-04-01 03:32:33 0:18:36 0:05:48 0:12:48 vps uv2 centos 9.stream rgw/upgrade/{1-install/reef/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0597158282e6d69429e60df2354a6c8eed0e5bce

fail 4653 2026-03-31 23:51:31 2026-04-01 03:26:32 2026-04-01 04:13:37 0:47:05 0:38:19 0:08:46 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm03 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4654 2026-03-31 23:51:32 2026-04-01 03:33:35 2026-04-01 03:39:49 0:06:14 0:02:08 0:04:06 vps uv2 ubuntu 22.04 rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0597158282e6d69429e60df2354a6c8eed0e5bce

fail 4655 2026-03-31 23:51:32 2026-04-01 03:35:48 2026-04-01 03:48:50 0:13:02 0:07:10 0:05:52 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm00 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4656 2026-03-31 23:51:32 2026-04-01 03:40:49 2026-04-01 04:36:35 0:55:46 0:53:36 0:02:10 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm02 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4657 2026-03-31 23:51:33 2026-04-01 03:42:31 2026-04-01 04:15:28 0:32:57 0:25:14 0:07:43 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm01 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4658 2026-03-31 23:51:33 2026-04-01 03:49:25 2026-04-01 04:28:18 0:38:53 0:37:33 0:01:20 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm05 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4659 2026-03-31 23:51:34 2026-04-01 03:50:16 2026-04-01 04:06:55 0:16:39 0:14:05 0:02:34 vps uv2 rocky 9.7 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides rocky_latest s3tests-branch} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm09 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4660 2026-03-31 23:51:34 2026-04-01 03:50:53 2026-04-01 04:16:01 0:25:08 0:06:57 0:18:11 vps uv2 rocky 9.7 rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/http/{0-install supported-distros/{rocky_latest} test_http} valgrind} 2
Failure Reason:

Command failed (bucket notification tests against different endpoints) on vm00 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a http_test'

fail 4661 2026-03-31 23:51:34 2026-04-01 04:08:00 2026-04-01 04:34:45 0:26:45 0:18:55 0:07:50 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm03 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

pass 4662 2026-03-31 23:51:35 2026-04-01 04:14:43 2026-04-01 04:32:34 0:17:51 0:14:09 0:03:42 vps uv2 rocky 9.7 rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap rocky_latest s3tests-branch thrasher/default thrashosds-health workload/rgw_multipart_upload} 2
fail 4663 2026-03-31 23:51:35 2026-04-01 04:16:32 2026-04-01 04:39:49 0:23:17 0:20:58 0:02:19 vps uv2 centos 9.stream rgw/upgrade/{1-install/squid/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0597158282e6d69429e60df2354a6c8eed0e5bce

fail 4664 2026-03-31 23:51:36 2026-04-01 04:17:47 2026-04-01 04:55:22 0:37:35 0:23:35 0:14:00 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/test_librgw_file.sh) on vm05 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh'

fail 4665 2026-03-31 23:51:36 2026-04-01 04:29:19 2026-04-01 04:41:59 0:12:40 0:06:29 0:06:11 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm01 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4666 2026-03-31 23:51:37 2026-04-01 04:33:58 2026-04-01 04:56:00 0:22:02 0:18:48 0:03:14 vps uv2 rocky 9.7 rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec rocky_latest s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota}} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm03 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

pass 4667 2026-03-31 23:51:37 2026-04-01 04:35:58 2026-04-01 04:47:46 0:11:48 0:09:46 0:02:02 vps uv2 rocky 9.7 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rocky_latest}} 2
fail 4668 2026-03-31 23:51:37 2026-04-01 04:37:45 2026-04-01 04:56:30 0:18:45 0:14:01 0:04:44 vps uv2 rocky 9.7 rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest s3tests-branch tasks/tempest} 1
Failure Reason:

Command failed on vm00 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding|.*test_object_expiry.ObjectExpiryTest.test_get_object_after_expiry_time|.*test_object_expiry.ObjectExpiryTest.test_get_object_at_expiry_time|.*test_account_services.AccountTest.test_list_no_account_metadata'"

fail 4669 2026-03-31 23:51:38 2026-04-01 04:40:28 2026-04-01 04:59:26 0:18:58 0:13:54 0:05:04 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/test_librgw_file.sh) on vm01 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh'

fail 4670 2026-03-31 23:51:38 2026-04-01 04:43:24 2026-04-01 05:00:45 0:17:21 0:11:54 0:05:27 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm06 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4671 2026-03-31 23:51:39 2026-04-01 04:48:44 2026-04-01 05:05:23 0:16:39 0:15:09 0:01:30 vps uv2 rocky 9.7 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides rocky_latest s3tests-branch} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm02 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4672 2026-03-31 23:51:39 2026-04-01 04:49:21 2026-04-01 05:04:14 0:14:53 0:06:20 0:08:33 vps uv2 rocky 9.7 rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/kafka/{0-install supported-distros/{rocky_latest} test_kafka} valgrind} 2
Failure Reason:

Command failed on vm05 with status 8: 'cd /home/ubuntu/cephtest && wget https://dlcdn.apache.org//kafka/3.8.1/kafka_2.13-3.8.1.tgz'

dead 4673 2026-03-31 23:51:40 2026-04-01 04:56:13 2026-04-01 06:59:36 2:03:23 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

hit max job timeout

fail 4674 2026-03-31 23:51:40 2026-04-01 04:57:27 2026-04-01 05:12:26 0:14:59 0:11:15 0:03:44 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm01 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

pass 4675 2026-03-31 23:51:40 2026-04-01 05:00:25 2026-04-01 05:25:10 0:24:45 0:22:43 0:02:02 vps uv2 rocky 9.7 rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{rocky_latest} tasks/transition/cloud_transition_s3tests} 1
pass 4676 2026-03-31 23:51:41 2026-04-01 05:01:08 2026-04-01 06:04:08 1:03:00 0:56:52 0:06:08 vps uv2 rocky 9.7 rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{rocky_latest} tasks/test_multi} 4
fail 4677 2026-03-31 23:51:41 2026-04-01 05:06:05 2026-04-01 05:49:49 0:43:44 0:35:47 0:07:57 vps uv2 rocky 9.7 rgw/sts/{auth-order/sts-local cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{rocky_latest} tasks/{0-install 1-keycloak 2-s3tests}} 2
Failure Reason:

Command failed on vm01 with status 8: 'source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/keycloak-11.0.0 && wget https://downloads.jboss.org/keycloak/11.0.0/adapters/keycloak-oidc/keycloak-wildfly-adapter-dist-11.0.0.tar.gz'

fail 4678 2026-03-31 23:51:42 2026-04-01 05:13:47 2026-04-01 05:42:13 0:28:26 0:15:18 0:13:08 vps uv2 rocky 9.7 rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap rocky_latest s3tests-branch thrasher/default thrashosds-health workload/rgw_s3tests} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm02 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4679 2026-03-31 23:51:42 2026-04-01 05:26:12 2026-04-01 05:51:23 0:25:11 0:06:20 0:18:51 vps uv2 centos 9.stream rgw/upgrade/{1-install/squid/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0597158282e6d69429e60df2354a6c8eed0e5bce

fail 4680 2026-03-31 23:51:43 2026-04-01 05:43:22 2026-04-01 05:58:47 0:15:25 0:06:08 0:09:17 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm01 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4681 2026-03-31 23:51:43 2026-04-01 05:50:46 2026-04-01 06:24:31 0:33:45 0:30:12 0:03:33 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/test_librgw_file.sh) on vm02 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh'

fail 4682 2026-03-31 23:51:44 2026-04-01 05:52:28 2026-04-01 06:07:43 0:15:15 0:06:07 0:09:08 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm01 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4683 2026-03-31 23:51:44 2026-04-01 05:59:42 2026-04-01 06:20:46 0:21:04 0:14:21 0:06:43 vps uv2 rocky 9.7 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides rocky_latest s3tests-branch} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm06 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4684 2026-03-31 23:51:45 2026-04-01 06:04:45 2026-04-01 06:13:37 0:08:52 0:06:23 0:02:29 vps uv2 rocky 9.7 rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/kafka_failover/{0-install supported-distros/{rocky_latest} test_kafka} valgrind} 2
Failure Reason:

Command failed on vm07 with status 8: 'cd /home/ubuntu/cephtest && wget https://dlcdn.apache.org//kafka/3.8.1/kafka_2.13-3.8.1.tgz'

fail 4685 2026-03-31 23:51:45 2026-04-01 06:05:35 2026-04-01 06:26:50 0:21:15 0:15:39 0:05:36 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/test_librgw_file.sh) on vm04 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh'

fail 4686 2026-03-31 23:51:46 2026-04-01 06:08:48 2026-04-01 06:42:34 0:33:46 0:25:57 0:07:49 vps uv2 rocky 9.7 rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated rocky_latest s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota}} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm07 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

pass 4687 2026-03-31 23:51:46 2026-04-01 06:14:32 2026-04-01 06:35:49 0:21:17 0:13:48 0:07:29 vps uv2 rocky 9.7 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rocky_latest}} 2
fail 4688 2026-03-31 23:51:47 2026-04-01 06:21:47 2026-04-01 06:43:12 0:21:25 0:16:57 0:04:28 vps uv2 rocky 9.7 rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest s3tests-branch tasks/s3/{auth-order/local-external s3tests}} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm02 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4689 2026-03-31 23:51:47 2026-04-01 06:25:10 2026-04-01 06:35:50 0:10:40 0:06:11 0:04:29 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm04 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4690 2026-03-31 23:51:48 2026-04-01 06:27:49 2026-04-01 07:40:51 1:13:02 1:02:10 0:10:52 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm04 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4691 2026-03-31 23:51:48 2026-04-01 06:36:47 2026-04-01 06:47:51 0:11:04 0:08:38 0:02:26 vps uv2 rocky 9.7 rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap rocky_latest s3tests-branch thrasher/default thrashosds-health workload/rgw_user_quota} 2
Failure Reason:

Command crashed: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota-run.sh'

fail 4692 2026-03-31 23:51:49 2026-04-01 06:37:50 2026-04-01 06:56:01 0:18:11 0:10:21 0:07:50 vps uv2 ubuntu 22.04 rgw/upgrade/{1-install/reef/{distro$/{ubuntu_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0597158282e6d69429e60df2354a6c8eed0e5bce

fail 4693 2026-03-31 23:51:49 2026-04-01 06:43:59 2026-04-01 06:55:03 0:11:04 0:09:54 0:01:10 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm02 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4694 2026-03-31 23:51:50 2026-04-01 06:45:02 2026-04-01 07:34:46 0:49:44 0:45:54 0:03:50 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm01 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"

fail 4695 2026-03-31 23:51:51 2026-04-01 06:48:43 2026-04-01 07:11:39 0:22:56 0:15:11 0:07:45 vps uv2 rocky 9.7 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides rocky_latest s3tests-branch} 1
Failure Reason:

Command failed (s3 tests against rgw) on vm09 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not bucket_logging'"

fail 4696 2026-03-31 23:51:51 2026-04-01 06:55:38 2026-04-01 07:07:04 0:11:26 0:08:32 0:02:54 vps uv2 rocky 9.7 rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{rocky_latest} test_others} valgrind} 2
Failure Reason:

Command failed (bucket notification tests against different endpoints) on vm02 with status 1: "BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a '!kafka_test,!data_path_v2_kafka_test,!kafka_failover,!amqp_test,!amqp_ssl_test,!kafka_security_test,!modification_required,!manual_test,!http_test'"

fail 4697 2026-03-31 23:51:52 2026-04-01 06:57:02 2026-04-01 07:06:35 0:09:33 0:07:12 0:02:21 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm00 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4698 2026-03-31 23:51:52 2026-04-01 06:58:34 2026-04-01 07:23:59 0:25:25 0:14:06 0:11:19 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (workunit test rgw/test_librgw_file.sh) on vm03 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh'

fail 4699 2026-03-31 23:51:53 2026-04-01 07:07:57 2026-04-01 07:26:50 0:18:53 0:16:46 0:02:07 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} 2
Failure Reason:

Command failed (workunit test rgw/run-datacache.sh) on vm00 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99e8bef8f767b591604d6078b7861a00c2936d53 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'

fail 4700 2026-03-31 23:51:54 2026-04-01 07:08:48 2026-04-01 07:58:37 0:49:49 0:45:57 0:03:52 vps uv2 rocky 9.7 rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rocky_latest} tasks/{bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} 2
Failure Reason:

Command failed (s3 tests against rgw) on vm06 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'"