We present the generation of terahertz pulses from a bulk GaP emitter fabricated with a micro-pyramid anti-reflection output coupling layer. The anti-reflection layer is designed by the graded effective refractive index principle. The micro-pyramid structure is manufactured by micro fabrication technique. The experimental results demonstrate that the micro structure layer can not only increase the output coupling efficiency but also scatter the transmitted pump power.