Howdy and Welcome...
I think that's the nature of most of the pen/stylus based devices...
You have to press somewhere on the screen to start moving the pen, and it does not really give you an option to decide when you are actually rolling over some object, and that's not the same as the one you can see in the monitor where you don't have to press somewhere to start something... It's just different type of user interaction and you have to be sitting in the seat of that user base to design something rather than thinking from the desktop chair...