Update, in case someone else find themselves in this situation. I hit the high parts ( area I can feel with finger) with 2000 sand paper. Then did the whole helmet at 3000 sand pad. I then using a polish compound and lots of elbow grease and that did the trick.
Hard to tell from photo but close up is before and the long shot is after.