I use a rear facing infant seat in mine constantly, both my wife and I think the car is great for baby seats. It has the steel anchor points, so we don't need to fuss with the seat belt, and theres a ton of room so the person in front of the seat doesn't feel cramped. The only reason i bought the cx-5 was to carry my daughter around, so its funny that it was rated poorly for that reason.
I'm in the same boat. We bought a CX-5 last week because a Scion Xa and a WRX just weren't going to cut it anymore. So far my only complaint has been with the rear facing car seat. We use a base so we can pop it in and out, and at the car seat demo we went to they told us the middle was the best spot. Unfortunately it doesn't fit in the middle. The handle rests on the front section center console. Really it's nitpicking, but thought I could provide some potential insight on the rating.