I've never stuffed them inside-out, but I store them in their cotton bags inside-out to help air them out a bit. If you're not noticing a difference, it probably doesn't matter. My biggest advice is always stuff, don't fold and roll (breaks down the insulation in the fold lines more quickly, I believe).