To break one’s promise is not justified if one is able to fulfill it and the promise is permissible in itself. Breaking one’s promise without justification is a sinful act. Regarding your case, you need to speak with your husband. Fix your family issues through mutual understanding.