How do you fix the papery texture of drywall?

I just tore up some wallpaper in my bathroom. Unfortunately I also tore up the first paper layer of the drywall as well. Now I am left with this very rough papery texture similar to ripped cardboard. I have used joint compound on some areas but don't want to use it on the entire wall. Is there anything I can use to smooth out the texture of the wall?