The loss of memory could be directly related to the choices you make on a daily basis or originate from a disease or a medical condition. Permanent memory loss is far more troubling than most types. Severe seizures and strokes can contribute to permanent memory loss. It could also result from a brain tumor, old age, infections or psychological conditions. Temporary memory loss is when your memories come back after a period of time. This type of memory loss could be directly associated with your lifestyle choices.