i hate to sound like a broken record, digger, but you "throw it away" to avoid hitting your shot to the right.....if you were to keep the bar against your forearm on the downswing, your ball would go right......this frustrates you because you know the swing aid is helping you do the right thing.....
so consciously or unconsciously you slighty throw the clubhead to the ball during the downswing (causing the bar to move off your forearm) and you hit a nice little straight lob shot .....ben calls it leakage......it's a safety valve for you
close the clubface (at address, in your left hand grip, in the backswing, in the downswing - pick your favorite spot) and the bar will start to stay on your forearm and the ball will go straight with some crispness