Once established, the chaste tree is nearly carefree. It has few pests and minimal disease issues. Depending on the look you’re after, annual pruning may be your biggest maintenance chore.