Me, too. Especially on the iPhone since so much space is being taken up by the icons. The icons obscure enough of the photo that it ends up looking odd and busy. I've always just used color gradient wallpapers on the home screen.
I used to only use a black background, however, since my daughter was born I use a black and white image of her for the background. It makes it so that I can still see the icons and folders.