At which height did you calibrate the camera? I guess you did it at the honeycomb level. If you put a piece of wood with like one or two centimeters thickness onto that honeycomb, the calibration is not valid anymore. You need to calibrate the camera at the EXACT height of the material you want to use.
Some background:
You do. Or you build a workflow where you can have the workpiece at the same distance to the camera all the time (like height adjustable honeycomb). Read the article linked above, then you understand why there is no other way to do it.
You can also calibrate to different heights and save the calibration files and load them if needed.