Since filler often takes quite a while to dry there could be something still working out of it that reacts with the paint and slows its drying time. If you are sanding right before painting, there is an even better chance of exposing something that hasn't had time to totally air-cure and could still have a higher than ideal solvent content for overcoating. Filler also has a pretty high mineral content, and just like the marine barrier coatings, moisture (or anything else, like solvents) literally has to zig-zag around the particles to get through it (or out of it). You could certainly get to a situation where the filler has hardened, but is still slowly trickling out a little bit of evaporating solvents for quite some time. As long as the paint will eventually dry and is well attached to the surface, I'd just plan on the first coats usually taking longer to dry and live with it. After that first coat dries, the second will likely dry faster because the first one has sealed the surface.