Should I stay or should I go? Husband and kid?

I have been married for 2 years been with his for 4. I use to be infatuated with my husband did everything together use to be scared to think about never being with his. We have a 2 year old daughter. We got married right after she was born while we were getting married our daughter was in the hospital sick from problems during birth. Wat im saying is I think we got married for the wrong reasons yes I was inlove with him at the time. Before we got married and had our daughter he was always cheating on me I should have left him then but after we got married he stopped it all. Now that we have a child its gone down hill hes never around he never helps with our daughter he never takes us anywhere with him he works during the day and goes to his familys or friends house after work or fish. I always have my kid I dont work so I do everything at the house. He acts like he doesnt want nothing to do with us. We also argue alot and hes been a mean person ever since we got married. I dont feel like I love him or attracted to him anymore. Hes so annoiying and everything makes me sick to my stomach on how he acts. I just want to know should I get out and start a newife with my dahghter or should I stay for our familys sake my daughters future. I try talking to him but he never listens.