It’s a stock Raspbian 32 vs a clean Debian 64.
I stopped all unneeded services (wpa_supplicant, bluetooth, avahi, etc.) on both distros before running any test.