This is more than likely due to limescale build up. Limescale or staining from mineral deposits in some parts of the country can manifest itself as a brown deposit.
Descaling your kettle should remove the brown deposit. To reduce limescale build up use filtered water.