If you notice that you keep getting small, unpleasant ulcers on the inside of your mouth, you may be dealing with canker sores. These are a type of shallow ulcer that typically looks pale with an inflamed red border around it. The most common location is along the inner lip, but a canker sore can also occur along the inside of the cheeks or the gum line.