The gemara is a shorthand protocol of the discussion in the beit midrash.
So did they talked like that? Part yes and part no.
But as for 'if not now, when?' it was a proverb he was using frequently. As that part of avot quotes from the leaders of each generation.
Oops.