In the high-stakes world of real estate, emotions run high and math often goes out the window. Here are the most expensive traps homebuyers fall into.