Ya, sometimes the cursor can zip away because of dust at the
lens. Other times it could be due to the texture of the surface ur
mouse is on. I have a computer in my room also resting on a wooden
table, sometimes the cursor zips away due to the grooves on the
table.
If the laser bounce off the surface at the right angle, the sensor
might think of it as a actual movement. If you use a mouse pad, it
might solve ur problem, but be careful of dust though, as
usual.