When it comes to fishing with plastic worms many people dont realize there actually are techniques that can be used to catch greater amounts of fish.
The problem is people tend to real the worm in much too fast. They usually get this happening because they have used other baits that do require faster reeling such as crank baits or buzz baits.
Of course there is an exception to every rule but when it comes right down to it the only way to deal with a plastic worm is slow. You will want to speed up but you just have to keep forcing yourself to slow things down. Another problem when fishing with worms is taking too big of sweeps. The trick to sweeping a worm is use your wrists to sweep instead of the entire rod. Doing this will keep the worm moving slowly but still aggresively enough.