This happened to me a couple years ago playing golf, i was hitting a 3 wood off the tee and playing for a 250-260 yard draw around the going to go down the hill of this hole. I don't wear a glove and had just used spray sunscreen on my hands to put on my face and apparently didn't wash it all off.
I hit my shot, 3 wood came flying out of my hands and went helicoptering down the left side of the fairway about 30 yards or so. Ball still went the same distance. It was at that particular moment i knew the hands didn't matter so much down at impact; just get a good impact condition (d-plane) and don't worry about it.