When does a weapon's speed take effect?

According to the Stardew Valley wiki, a weapon's speed statistic affects how fast a player moves. Does this occur only when the weapon is selected? Or does the speed change occur even when the weapon is unequipped in the player's inventory?