I have a theory that Wit is not exactly that old. He even says that:
I think when he is not acting he is sleeping/hibernating for hundreds/thousands of years somewhere to accumulate Luck. Maybe he is a feruchemist.
He does not need the breaths to store his extra memories. Because he does not have extra memories. He was just pretending.