Pregnancy and deviated septum?

I'm so happy to say that I'm 4 weeks pregnant. We confirmed it yesterday. Since my periods are not regular I didn't bother to test as I was disappointed before. But 2 days back I felt tired and was uncomfortable so I went to an OB/GYN in my locality (Toronto). The only thing that bothers me is my nose surgery. I have been scheduled for nose job from one of the best rhinoplasty surgeons in my locality to correct my deviated septum. Since I'm 4 weeks pregnant, is it safe to undergo the procedure now? Will there be any issue during my pregnancy time because of this deviated septum? Any advice is highly appreciated.