Remove replace directive for golang.org/x/exp (#5972)

Remove replace directive for golang.org/x/exp (#5972) #1454