Im having an issue regarding childsupport with my exhusband?

My ex husband and i have been seperated for 6 years and divorced for the last 4 years, we have 5 children from a marriage that began 13 years ago. When we were married he was a truck driver who initially made good money but eventually due to his lack of respect for rules and authority kept getting fired. He aculated 11 points on his license making it very hard for him to find a good paying job. This was due to him repeatedly commiting traffic violations. I was in school to become a nurse and worked partime and took care of the children. After years of his infidelity we split up and i moved to my moms house and got my nursing license. We got back together after my graduation and tried to make it work, it was hard because he was unemployed for the most part because he had been involved with several run in with the law a lot of places didnt want to hire him cause he had a record, so i was the sole income source for 3 years, i knew it was hard for him to go from being the one who took care of us to being dependent on me, so i tried to involve him in all financial decisions. He became upset saying he needed his own money and i was being stingy by not giving him anyway, so i decided to give him some money for his own, i gave it to him at 8am by 4pm he was asking for more. We finally broke up for good when he got a good job with the city and used his first paycheck to go to atlantic city and blew it all on a another women. Since our break up he hasnt helped me at all with our children. After trying for 2 years i finally asked the court to help and put him on chld support. He has accrued over $50,000 in back support over the last 4 years, so last year he called me and pleaded that he could not pay child support because he couldnt get a job, because the court had suspended his license and put out a warrant for his arrest for not paying. I felt bad and decided that i would not cancel the cs but put a year hold on the cs so he can get back on his feet. I went to the court and asked the judge to put the childsupport on hold, that was 6 months ago. Since then him and his wife had another child and he has a steady job as a truck driver and he still hasnt given me a dime, he says im a nurse and i should drop the childsupport completley cause i make enough money to care for our children. I am at my wits ends. He calls the kids every couple of months when he wants to see them, i have full custody of them but i have no restrictions to his access to them. Recently i have denied his sporadic visits to them because it cause more hurt for them then anything cause he wont call again for months, I dont want to deny them a father but where do i draw the line and what should i do about the cs, should i drop it for good, i dont ever see me or the kids getting any help