My kettle has what looks like rust deposit forming inside

This is more than likely due to limescale build up. Limescale or staining from mineral deposits in some parts of the country can manifest itself as a brown deposit.
Descaling your kettle should remove the brown deposit. To reduce limescale build up use filtered water.