So long as there are not grounds for suspicion or doubt, one should think positively of a Muslim and presume that he or she is decent and innocent. In the Noble Qur’an, Allah Ta’ala states, “O you who believe!” Avoid much [negative] assumption. Indeed, some assumption is sin. And do not  spy or backbite each other…. (49:12) Thinking negatively of people leads to spying. This conduct was not beneficial; rather, it may have been damaging, as it may have encouraged the wife to sin, raising your suspicions. Your behavior is deplorable.