spec: Clean up outdated arch deps
    
    - rdma-core, xen, spice, numactl are available in more places
    - drop presumably obsolete aarch64 ld flag droppage
    - centralize arch dep checks in one place