Are you certain that it’s not being captured at higher resolution? When you did the lens calibration, what was the reported resolution?
I suspect things would look far worse if it was capturing at 640x480. Note that the overlay that you’re showing is a small area of the overall captured image.
Also, have you run the camera alignment process? Curious why the overlay is so zoomed in.