Do I have to put the tile I just picked up on my rack before discarding?

No, you can hold the tile in your hand and go directly to a joker swap or discard the tile without first placing it in the sloped part of your rack with the rest of your hand.