This really depends on the individual. For somebody like Shallan in the Stormlight Archive, who bases her entire life around secrets and lies, I could see Malatium being something much more invasive. There are several people out there that have secrets they want to keep hidden, that something like Malatium could reveal to someone who was skilled in its use. Most of these lies don't even have to go as deep as Shallan's. Take Kalladin, for example. How would he feel if someone used Malatium on him, looking at him during his darkest moment, when he was contemplating his suicide? Even Vin, I think, would be made uncomfortable with someone seeing who she was before she became a Mistborn.
That's not to say that Brass and Zinc aren't invasive. They are. For those who are more open about who they are and who they were, these would be the most invasive of the options. As other have said, though, they can be prepared for and guarded against. Their influences also aren't particularly strong. The exception, of course, is when it's Duralumin-enhanced. That's just scary.