How to remove 'Always' permission

[RajDSS]

My app doesn't use the 'Always' permission, and I ask user WhenInApp permission. But in settings, user can explictely select 'Always'.
I tried removing the NSLocationAlwaysUsageDescritpion from app and submitted the app, and it gave the above error.

By removing the NSLocationAlwaysUsageDescritpion from info.plist, the 'Always' option is removed from Privacy settings of the app, and that is what I want, so that user doesn't have an option to choose 'Always'.

The reason why I want all that is, even when I ask user WhenInApp permission, some users went to settings and explicitly gave 'Always' permission, which caused the new iOS 13 popup appearing while the app was in background which shoes that the app was getting your location, putting the users away from using the app!