Yeah, UC is strong, and probably not the best thing to use every single time you want to detail. You could go with a milder pad, or less pressure, etc, but at that point you may as well just have a milder product.
Ult. Polish is actually a very mild cleaner/polish, so would be good for any dirt in the paint. It may be better to use that a few times after off-roading, and then only use the UC once or twice a year, or something like that.