Not only a few times, but every time he did not give in to his urge to go look for her, he resented the moment that came in its place. Even if the moment was beautiful and was something he valued, and made him who he was. He could not help but also long for that other life in which he lived with Della, even if she abused him.