Use %set_build_flags to set build flags
    
    The previous version fo the spec file was trying to append flags to e.g.
    LDFLAGS, but those are empty without doing a %set_build_flags first.
    Use %set_build_flags to populate all build flags.