2024-10-16T08:52:42.633Z | <Sunil Angadi> c9 `default` build still getting failed
<https://shaman.ceph.com/builds/ceph/wip-sangadi2-testing-2024-10-16-0620/>
even after merging <https://github.com/ceph/ceph/pull/60228>
also please let me know why two `sha` id’s getting created? |
2024-10-16T09:58:24.602Z | <Ilya Dryomov> It's the arm64 build that failed, it shouldn't prevent you from scheduling the suite as we don't test on ARM |
2024-10-16T09:59:05.842Z | <Ilya Dryomov> Also the failure seems bogus, so I'd just ignore it:
```+ sudo yum install -y yum-utils
CentOS Stream 9 - AppStream 1.1 kB/s | 4.4 kB 00:04
Errors during downloading metadata for repository 'appstream':
- Downloading successful, but checksum doesn't match. Calculated: ef16d195332d673efbe2fc9a316726df177a605e1caef3ca49f88a7181f973654347400cb50ee464dd7206fc9a59c34cf37d0baea158add0bde531cb7cab8039(sha512) Expected: b2b0cdc3fdc6021ff6ddd33a4b508daa7050cc8cdfca7dd9aa6c854ed80dd39b4fd5bfa6e66db2c37e0ad25cee9f53e7b24b84d7f302f2ca07198439524d1c99(sha512)
Error: Failed to download metadata for repo 'appstream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
Build step 'Execute shell' marked build as failure``` |
2024-10-16T10:13:15.304Z | <Sunil Angadi> ok but i tried to schedule runs got failed like this
<https://privatebin.corp.redhat.com/?341f4f4aee52bf19#2dpiQoXQzJfbkzo9deCtiSg5SU2RZY6F8vAEc6yPqzvh>
```2024-10-16 08:49:56,129.129 ERROR:teuthology.suite.run:Packages for os_type 'ubuntu', flavor default and ceph hash '027dc6040a774d6df5fb3d5a0f55cd3352453b17' not found
2024-10-16 08:49:56,151.151 DEBUG:teuthology.suite.util:Memo: command: /cephfs/home/sangadi/teuthology/teuthology/virtualenv/bin/teuthology-schedule --name sangadi-2024-10-16_08:49:18-rbd-wip-sangadi2-testing-2024-10-16-0620-distro-default-smithi --worker smithi --dry-run --priority 230 -v --first-in-suite --subset 111/120000 --seed 6735
2024-10-16 08:49:56,151.151 INFO:teuthology.suite.run:Scheduling rbd/singleton/{all/merge_diff conf/{disable-pool-app} objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_20.04}}
Traceback (most recent call last):
File "/cephfs/home/sangadi/teuthology/teuthology/virtualenv/bin/teuthology-suite", line 8, in <module>
sys.exit(main())
File "/cephfs/home/sangadi/teuthology/teuthology/scripts/suite.py", line 230, in main
return teuthology.suite.main(args)
File "/cephfs/home/sangadi/teuthology/teuthology/teuthology/suite/__init__.py", line 140, in main
run.prepare_and_schedule()
File "/cephfs/home/sangadi/teuthology/teuthology/teuthology/suite/run.py", line 468, in prepare_and_schedule
num_jobs = self.schedule_suite()
File "/cephfs/home/sangadi/teuthology/teuthology/teuthology/suite/run.py", line 715, in schedule_suite
self.schedule_jobs(jobs_missing_packages, jobs_to_schedule, name)
File "/cephfs/home/sangadi/teuthology/teuthology/teuthology/suite/run.py", line 546, in schedule_jobs
util.schedule_fail(
File "/cephfs/home/sangadi/teuthology/teuthology/teuthology/suite/util.py", line 77, in schedule_fail
raise ScheduleFailError(message, name)
teuthology.exceptions.ScheduleFailError: Scheduling sangadi-2024-10-16_08:49:18-rbd-wip-sangadi2-testing-2024-10-16-0620-distro-default-smithi failed: At least one job needs packages that don't exist for hash 027dc6040a774d6df5fb3d5a0f55cd3352453b17.``` |
2024-10-16T10:13:56.990Z | <Sunil Angadi> please let me know is there anything i need to change with command to run? |
2024-10-16T10:27:44.564Z | <Ilya Dryomov> It looks like Ubuntu 20.04 build is missing
I think you would need to recreate your branch with `wip-sangadi2-testing-<...>-reef` name (i.e. add `-reef` suffix) from scratch, push it and have it built |
2024-10-16T10:30:27.155Z | <Ilya Dryomov> It looks like Ubuntu 20.04 build is missing
I think you would need to recreate your branch with `wip-sangadi2-testing-<...>-reef` name (i.e. add `-reef` suffix) from scratch, push it and wait for it to build |
2024-10-16T10:30:42.521Z | <Ilya Dryomov> The suffix would instruct ceph-build to launch builds for distros that are needed for reef instead of those that are needed for main |
2024-10-16T10:40:43.137Z | <Sunil Angadi> ok will try that thanks! |
2024-10-16T10:58:30.087Z | <Sunil Angadi> For PR added lebel as `wip-sangadi2-testing-reef`
WIP=wip-sangadi2-testing-reef
git clone git@github.com:ceph/ceph $WIP
git remote add ci [git@github.com](mailto:git@github.com):ceph/ceph-ci.git
git checkout reef
git remote add sunilangadi2 [git@github.com](mailto:git@github.com):sunilangadi2/ceph.git
```sangadi@teuthology:~/wip-sangadi2-testing-reef$ src/script/build-integration-branch $WIP
--- found 5 issues tagged with wip-sangadi2-testing-reef
--- queried 5 prs
branch wip-sangadi2-testing-reef-2024-10-16-1052
--- creating branch wip-sangadi2-testing-reef-2024-10-16-1052
error: branch 'wip-sangadi2-testing-reef-2024-10-16-1052' not found.
Switched to a new branch 'wip-sangadi2-testing-reef-2024-10-16-1052'
--- pr 59271 --- pulling [ 100.00 KiB/s, done.
From <https://github.com/k0ste/ceph](https://github.com/k0ste/ceph.git> branch wip-63065-reef
remote: Enumerating objects: 4, done.
remote: Counting objects: 100% (3/3), done.
remote: Total 4 (delta 2), reused 2 (delta 2), pack-reused 1 (from 1)
Unpacking objects: 100% (4/4), 5.48 KiB )
* branch wip-63065-reef -> FETCH_HEAD
Merge made by the 'recursive' strategy.
src/test/cls_lock/test_cls_lock.cc | 30 ++++--------------------------
1 file changed, 4 insertions(+), 26 deletions(-)
--- pr 59501 --- pulling [ 23.00 KiB/s, done.
From <https://github.com/idryomov/ceph](https://github.com/idryomov/ceph.git> branch wip-67698-reef
remote: Enumerating objects: 6, done.
remote: Counting objects: 100% (6/6), done.
remote: Compressing objects: 100% (3/3), done.
remote: Total 6 (delta 3), reused 3 (delta 3), pack-reused 0 (from 0)
Unpacking objects: 100% (6/6), 2.85 KiB )
* branch wip-67698-reef -> FETCH_HEAD
Merge made by the 'recursive' strategy.
src/tools/rbd/action/Bench.cc | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
--- pr 59660 --- pulling [ 244.00 KiB/s, done.
From <https://github.com/idryomov/ceph](https://github.com/idryomov/ceph.git> branch wip-67845-reef
remote: Enumerating objects: 22, done.
remote: Counting objects: 100% (22/22), done.
remote: Compressing objects: 100% (12/12), done.
remote: Total 22 (delta 10), reused 10 (delta 10), pack-reused 0 (from 0)
Unpacking objects: 100% (22/22), 28.40 KiB )
* branch wip-67845-reef -> FETCH_HEAD
Merge made by the 'recursive' strategy.
qa/workunits/rbd/cli_migration.sh | 5 ++++-
src/librbd/ImageCtx.cc | 13 +------------
src/librbd/io/Utils.cc | 15 +++++++++++++++
src/librbd/io/Utils.h | 1 +
src/librbd/migration/NativeFormat.cc | 1 -
src/librbd/migration/QCOWFormat.cc | 1 -
src/librbd/migration/RawFormat.cc | 6 ++++--
src/test/librbd/migration/test_mock_RawFormat.cc | 2 +-
8 files changed, 26 insertions(+), 18 deletions(-)
--- pr 59772 --- pulling [ 813.00 KiB/s, done.
From <https://github.com/nbalacha/ceph](https://github.com/nbalacha/ceph.git> branch wip-67763-reef
remote: Enumerating objects: 7, done.
remote: Counting objects: 100% (6/6), done.
remote: Compressing objects: 100% (2/2), done.
remote: Total 7 (delta 4), reused 4 (delta 4), pack-reused 1 (from 1)
Unpacking objects: 100% (7/7), 11.91 KiB )
* branch wip-67763-reef -> FETCH_HEAD
Merge made by the 'recursive' strategy.
src/test/rbd_mirror/test_mock_PoolReplayer.cc | 10 ++++++++++
src/tools/rbd_mirror/PoolReplayer.cc | 6 +++++-
2 files changed, 15 insertions(+), 1 deletion(-)
--- pr 60170 --- pulling [ 230.00 KiB/s, done.
From <https://github.com/idryomov/ceph](https://github.com/idryomov/ceph.git> branch wip-63184-reef
remote: Enumerating objects: 13, done.
remote: Counting objects: 100% (11/11), done.
remote: Compressing objects: 100% (2/2), done.
remote: Total 13 (delta 9), reused 9 (delta 9), pack-reused 2 (from 1)
Unpacking objects: 100% (13/13), 5.64 KiB )
* branch wip-63184-reef -> FETCH_HEAD
Merge made by the 'recursive' strategy.
qa/workunits/rbd/luks-encryption.sh | 91 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++-----
src/librbd/crypto/LoadRequest.cc | 20 +++++++++++++++-----
src/librbd/crypto/LoadRequest.h | 2 +-
3 files changed, 102 insertions(+), 11 deletions(-)
--- done. these PRs were included:
<https://github.com/ceph/ceph/pull/59271> - reef: test/cls_lock: expired lock before unlock and start check
<https://github.com/ceph/ceph/pull/59501> - reef: rbd: "rbd bench" always writes the same byte
<https://github.com/ceph/ceph/pull/59660> - reef: librbd/migration: prune snapshot extents in RawFormat::list_snaps()
<https://github.com/ceph/ceph/pull/59772> - reef: rbd-mirror: use correct ioctx for namespace
<https://github.com/ceph/ceph/pull/60170> - reef: librbd/crypto/LoadRequest: clone format for migration source image
--- perhaps you want to: ./run-make-check.sh && git push ci wip-sangadi2-testing-reef-2024-10-16-1052
sangadi@teuthology:~/wip-sangadi2-testing-reef$ git push ci wip-sangadi2-testing-reef-2024-10-16-1052-reef
error: src refspec wip-sangadi2-testing-reef-2024-10-16-1052-reef does not match any
error: failed to push some refs to 'git@github.com:ceph/ceph-ci.git'```
Is it ok if i just push this `git push ci wip-sangadi2-testing-reef-2024-10-16-1052` |
2024-10-16T11:00:05.242Z | <Sunil Angadi> i remember initially when we checkout the branch it used to add by itself,
not sure something got changed recently |
2024-10-16T11:09:47.619Z | <Ilya Dryomov> I don't use `src/script/build-integration-branch`, so I don't know how it interacts with labels
@yuriw must have provided you with notes, isn't getting the suffix right covered there? |
2024-10-16T11:10:06.670Z | <Ilya Dryomov> I don't use `src/script/build-integration-branch` script, so I don't know how it interacts with PR labels
@yuriw must have provided you with notes, isn't getting the suffix right covered there? |
2024-10-16T11:16:12.987Z | <Ilya Dryomov> Going just by the pasted output, I think `git push ci wip-sangadi2-testing-reef-2024-10-16-1052:wip-sangadi2-testing-reef-2024-10-16-1052-reef` would do what you seem to want it to do (i.e. push the branch with that name) |
2024-10-16T11:16:56.261Z | <Ilya Dryomov> ... but I don't know if this is what @yuriw usually does
I'd guess not since you ended up with `-reef` mentioned twice in the branch name |
2024-10-16T12:35:23.375Z | <Sunil Angadi> yes let me check with @yuriw itself,
please let me know what steps makes `git push ci wip-sangadi2-testing-reef-2024-10-16-1052` gets suffix with `reef` ? |
2024-10-16T13:10:36.990Z | <Sunil Angadi> Able to push now with `reef` suffix
```--- done. these PRs were included:
<https://github.com/ceph/ceph/pull/59271> - reef: test/cls_lock: expired lock before unlock and start check
<https://github.com/ceph/ceph/pull/59501> - reef: rbd: "rbd bench" always writes the same byte
<https://github.com/ceph/ceph/pull/59660> - reef: librbd/migration: prune snapshot extents in RawFormat::list_snaps()
<https://github.com/ceph/ceph/pull/59772> - reef: rbd-mirror: use correct ioctx for namespace
<https://github.com/ceph/ceph/pull/60170> - reef: librbd/crypto/LoadRequest: clone format for migration source image
--- perhaps you want to: ./run-make-check.sh && git push ci wip-sangadi2-testing-2024-10-16-1248-reef
sangadi@teuthology:~/wip-sangadi2-testing$ git push ci wip-sangadi2-testing-2024-10-16-1248-reef
Enumerating objects: 1209, done.```
There is a `src/script/build-integration-branch script` issue while creating the reef build.
```36 if current_branch in 'mimic nautilus octopus pacific quincy '.split():
37 postfix += '-' + current_branch
38 print(f"Adding current branch name '-{current_branch}' as a postfix")```
By adding the “reef” in the line line 36 solves the issue.
```if current_branch in 'mimic nautilus octopus pacific quincy reef'.split():```
@yuriw should i raise PR for this fix? |
2024-10-16T14:02:40.919Z | <Ilya Dryomov> @Sunil Angadi I think the assumption is that all scripts come from main
That is, even if you are working on a reef-based branch, you should use the script from main |
2024-10-16T14:39:39.856Z | <yuriw> I thought this issue was already discussed, what @Ilya Dryomov indicated above is correct, you need to use the latest `build-integration-branch script` |
2024-10-16T14:40:05.563Z | <yuriw> Keep it in a separate directory to avoid such issues |
2024-10-16T14:56:30.423Z | <yuriw> can it be merged yet? |
2024-10-16T15:25:18.359Z | <yuriw> I thought this issue was already discussed, what @Ilya Dryomov indicated above is correct, you need to use the latest `build-integration-branch script` from `main` branch |
2024-10-16T17:10:07.908Z | <nehaojha> is [senta02.front.sepia.ceph.com](http://senta02.front.sepia.ceph.com) down? |
2024-10-16T18:15:13.942Z | <yuriw> @Dan Mick @Laura Flores ^ |
2024-10-16T18:49:37.910Z | <Dan Mick> Merged |
2024-10-16T22:37:34.264Z | <yuriw> Rebased builds (2) failed unfortunately 😞
<https://jenkins.ceph.com/job/ceph-dev-new-setup/85491//consoleFull>
<https://jenkins.ceph.com/job/ceph-dev-new-setup/85492//consoleFull>
building tarball
+ rm 'ceph-*.tar.gz'
rm: cannot remove 'ceph-*.tar.gz': No such file or directory
@Dan Mick @Laura Flores |
2024-10-16T23:31:35.845Z | <Dan Mick> that's not the error, there's a lot of log after that |
2024-10-16T23:32:28.008Z | <Dan Mick> search for NewConnection. It looks like an external network problem |
2024-10-16T23:33:36.379Z | <Dan Mick> braggi03 can access [pypi.org](http://pypi.org) now |
2024-10-16T23:34:02.468Z | <Dan Mick> try again at will |