Umm...I wanna call BS on something, but I believe your story for some reason. However the problem is if you called the cops on him, and they came out they CAN prove that his vehicle hit your car.
But how? Well something called paint transfer...plain and simple. If the collision was enough to cause the kind of damage that you are talking about than there will be paint transfer. Alls the officers have to do is look at your car, and look at his..that simple. On his car will be your paint, on your car will be his paint. Not only that but his car will have damage also.
Now what this does, is you can at least claim on his insurance for the damages. Than if they prove that he was driving the car, he is up for insurance fuand, hit and run, possibly DUII.
So my suggestion to you, and this is from experience...get the ******* police back out there and look at your car and his. Again, if the damage is as bad as you say there WILL be paint transfer, and you can also line impact points with one another. Meaning the damage on his car should line up some what with the damage on your car.
Good luck with racking his ass across the coals man.