How to get colored pictures with a pinhole camera?

I took a few photography classed/courses and we never did color pin hole photographs, but I'm pretty sure it's the photo paper you put in the camera.