Do you think i was wrong?

My b.f works 2 weeks out the month. && off for 2 weeks. To make along story short, he carried this women child on his taxes. He owes the women 1000. He has decided to pay her in small payments !! I said, well IL come along with you to her house. *there has been some drama between me and the lady, because she was calling my man 3 o'clock one morning * Anyways, he said no i couldn't come, because i would start some chit, or The lady would look @ me funny and i might take it the wrong way. I said well until u done paying her "in small payments" IL just stay home.. instead of visiting you for the few weeks i am able to visit you !! He pays her about 250 every month... so With what i said, we probably wont see each other until end of year. He said i was putting the relationship on the line because of this. I barely see him enough as it iz, and totally understands his job, but i thought it was wrong how he just said.. OK well i guess you are gonna stay home, because I'm not letting you come with me !!