In fact, there is lots of other evidence beside fossil which agree with fossil records.
One of them are the genetic code. The universal use of the same genetic material (DNA) to encode the recipe for any organism is a powerful fact in support of evolution from a common origin. In addition, the genetic code differ from each species, but the degree of difference between two species is positively correlated with the time passed since their divergence from a common ancestor, which is determined by fossil record. Some section of genetic code are even nearly identical in every organism.