Picking my Battles or just caving?

OK so for a week now Charlie has been going to nap time and bed time in his room... but the last two mornings at 5 AM he has come into our bed and went back to sleep till about 7:30. Both mornings I have tried to put him back in his bed and he just cries and says "no mommy". This morning I even waited for him to go back to sleep then tried moving him and he still woke back up. I don't want to be up at 5 AM but also am liking Charlie sleeping in his room. I am thinking we will eventually stop waking up so he will stay in his room.... I hope!