My dji mini 2 will not hover in place keeps drifting right or left.

Check propellers again, mine had very small dent on 1 propeller from bottom side on the end, around 0,5mm not visible but I could feel it by touch. Simply sand it very gently with grit 400 sand paper to get it smooth and voila.

Your circumstantial description is somewhat limited ;

1. did you take off after the spoken message "home point updated" ?
2. did you verify how many satellites were detected once it started to drift ?
3. is your DJI FLY set for 'return home' or 'stay in place' if connection with RC is lost ?

It may be that gps module has a technical problem, it is not so difficult to replace because it is a seperate pcb in the top half of the Mini2. It helps if you have some repair experience though. The costs are about 35€ if I recall well, for the GPS pcb I mean. Just make sure you order exactly the same pcb number as original, like in this example "PP 002025.02"
See Aliexpress.