Step 2: Drain the water lines. Before you remove the toilet shut-off valve, you’ll need to drain the supply line to prevent the water remaining in the pipe from gushing out onto your bathroom floor.