Multi-particle theory of the optical and electronic properties of semiconductors and metal clusters; spin-dependent charge carrier dynamics and spin transport in semiconductors and metals