As tubers become fully mature, the potato plant's stems and leaves….

Turn brown. You don't however, have to wait for the plants to die back to start eating your potatoes. Harvest when the potatoes reach the size you want. If you plan to store them, make sure the skins are very tough, and don't peel off easily when you gently rub them with a finger at harvest time.