The downfall of the aspects did seem pretty fast, but I think contacting Sandra was the catalyst for that. We get a bunch of hints, mostly from Ivy, that meeting Ivy would doom the aspects. Ivy seems to blame the loss of Ignacio and the other guy on Sandra, implying that meeting up with her would cause more aspects to go away.
Stephen was already getting worse and subconsciously created Jenny to prepare for this downfall, but Armando doesn't go nightmare until after contact with Sandra. Once Sandra texts, Stephen's subconscious knocks the first domino down, starting the downward spiral.
Also, the cosmere is a Virtual Reality that Stephen's aspects inserted into the code. Leeds is Adonalsium and 16 aspects took over control from him. Hoid is J.C's interdimensional time ranger aspect trying to wake Leeds back up in that [redacted] wareshouse.