rough

I restored my WC canoe and I'm not happy with the finish. It feels/looks like fine grained sandpaper. I applied the filler as directed, smoothed it by hand as directed, sanded as directed but couldn't get it as smooth as others I have done. I thought maybe the paint would smooth it a bit...