“It was all a little bit rushed for everyone, and so there weren’t certain accommodations set up,” Pfeiffer confessed