The earphones use an in-ear detection sensor to determine if they are being worn. If you cover the sensor while holding the earphones, it will mistakenly detect that the earphones are being worn. If you don't need the wear detection feature, you can disable it in the Xiaomi Earbuds APP.
Note:
When holding the earphones, avoid covering the sensor.
Does it help?