In some cases, teeth can move back very quickly - these are called high risk relapse cases. This may happen for very rotated teeth, or teeth with gaps in the midline.
You could consider asking your orthodontist for a fixed retainer, which is a wire retainer glued to the back of your teeth to help maintain the teeth position, whenever you are not wearing your removal retainers.
Good luck! And don't ever stop wearing those retainers.
Best wishes,
Dr Sylvia Tan