Administer subusers wasn't enough, since I didn't want my parent users visiting the user administration page - just cause it's one more thing to train them on.
Instead, I added a views field handler to show a delete link, plus I had to customize the access callback to ensure that users don't delete themselves.
All in all, not so bad. I think I'll contribute that back into the module if I can...