they became confused and in their turn forgot that they were even touching until it was my turn again, then just decided to ignore it because I didn't want to look up the rules, it was breakpoint that turn for him.
But I just wanted to double check and since the game ended late and went straight to bed asap after the game and then came to work like usual and I never got to look it up nor have a rulebook on hand just thought I would ask on here before really getting to work.
Thanks everybody for clarifying.