When can I swap a joker?

In order to swap a joker in someone's exposure (or their own), a player needs to have the corresponding tile in their Mah Jongg hand and it needs to be their turn before doing so.