A problem with the size of the cuts

Does the cutting layer have a nonzero Kerf Offset?

The machine may also have backlash. These discussions will give you places to check: