Notice how there are only binaries for armhf architecture in raspbian repo: Index of linux/raspbian/dists/bookworm/stable/, whereas binaries for your architecture (arm64) are available for debian here.
So either force your arch to match ‘armhf’ and continue to use raspbian repo, or switch to the debian one. This is the one I use on my Raspberry Pi (still on Bullseye though -_-).