Scott wrote :
If you went to sleep in my body in my bed with my memories, and awoke in your body in your bed with your memories, would you notice a difference? Would there be a difference to notice?
If my memories on the following day, would exclude the going to bed with your memories on the day before, then i could not know.
Since what i would have gone to bed with, were your memories, the question implies, that this exclusion is the meaning of the question.
Since nothing within the question seems to imply, that your memories would become mine, or vice versa, there is no logical reason to think that this memory-swapping would have happened.
Answer from a strictly logical perspective: No, i wouldn't notice a difference, my memories would maybe have a blind spot lacking the memory of what happened on the day before, but contain no trace of your memories.
Answer from a realistic perspective: Since we know each other now, or could have had contact, like this one before, or even more intimate, the logical answer could be criticized.
There appears to be no true paradox within the question.