I'm setting an upper-limit alarm for measuring temperature. Can I prevent the alarm from occurring when the temperature rises temporarily?

Yes, set a delay upper-limit alarm.
A delay upper-limit alarm will not engage until the measured value remains above a specified value for a specified length of time (the delay time).