It wouldn't be too much of a confusion, the anime didn't really digress from the manga too far. If I remember, there was only one filler episode that kind of followed a reoccurring theme in drama CDs anyway |D But yes! The anime wasn't long enough to the point of grasping for an ending while the manga was still ongoing.