In games this simply means the color texture.
In offline rendering (movies, commercials, etc.) Diffuse Map can mean a separate effect than a color map, it controls the diffusion of light that's reflected off the surface.
