I have used a lot of quarter sawn white oak and have seen very little seasonal movement. I do build to accommodate seasonal movement across large glue-ups. With the small pieces in the drawer, I think you won’t see movement especially if the piece is indoors. If it lived outdoors, you might get movement.