Relationship advice- Need a break!!!!?

Okay so my boyfriend and I (of 4 years) have kids (2- 1 each -before the relationship started). Problem is i want a vacation and he don't because the kids are not coming. I work, go to school, and care for the kids. Is it wrong of me to want a vacation from working and motherhood? I feel its unfair for the other 2 deadbeat parents ( my son's father and his daughter's mother) to get all of the breaks, yet I can't get one. I'm I being selfish?