So, my first response is a cheat: Amazon. Seriously. They have pure metals, too.
Aaaanyway...
Cadmium can be found in batteries. Extracting it would probably be hazardous, though.
Copper is in wiring. You can stop by Lowe's or Home Depot or whatever to grab some. Also, other electrical things.
Gold can obviously be found in jewelry, though (despite the OP) I feel it's necessary to say that most gold jewelry is less than 75% gold. One could also very meticulously and slowly get gold from electrical connectors in devices.