Opinion: You really need a chuck for precise results on multiple passes, particularly on a slippery Delrin cylinder with an irregular surface.
Which need not break the bank if you’re not averse to a bit of DIY: