to load zargs

autoload -U zargs

To remove all the ~ files recursively and prevent rm to have to many arguments :

zargs **/*~ -- rm