Where does “留守番” come from?

留守番 (Japanese): house-sitting; being at home while the owner is away