perhaps try a small rap floated and twitched on top the next time.
if they are looking up... fish up!
another thought... go buy a few sulfers, then use that same floating rap, but now have a 12" piece of 2-4lb mono tied off one of the rapala's hooks with a sulfer on the end, then clean up instead of just watching
