The broker was only with me at the first visit. It was a year ago, I haven't seen him since. He's done nothing for me after that. I initially asked him that I want 50% of his commission since he doesn't have to anything beside showing up with me. He agreed that he will give me back 50% of his commission on an email before we went to the model houses. I had to contact him about three weeks after I closed regarding the rebate. He didn't answer my email until two weeks later. Anyway, I've been reading about the subject and even consider suing him in small claim court. I trusted him and now I feel angry and stupid.
Again, thank you everybody, especially qwerty for your advice.