So the OP can really be translated to "Was there a first moment of time, and if so, when was it? How far back do we need to go to reach it?"
The answer is that there cannot be a first or last moment of time. That is not the nature of time, in spite of how we like to cognize it when we insist on a "beginning" or an "ending". No matter how far back you go in time, you can always imagine a time before that. And no matter how far ahead you go in time, you can always imagine a time after that. Our cognition of time reveals that it cannot begin or end, and since time is an inherent property of the Universe as we know it, we must conclude that it too cannot begin or end.
So our relation to this question of when was the first moment of time (when did the Universe begin) would be akin to a bunch of "stupid scientists" travelling around a circle and asking themselves what point on the circle might be the beginning point, and what point is the ending point. So backward they go on the circle, on and on, as they wonder when they will "arrive" at the starting point; and forward they go on the circle, on and on, wondering when they will "arrive" at the ending point.
The dilemma is resolved when the scientists realize that their "time" is really a circle, and not a line. And so too will our dilemma be resolved when we realize this "circular", or cyclical, nature of time, which is also the nature of our Universe as a whole since time is an integral and inherent aspect of it.