The immense luminosities of gamma-ray bursts means that in principle they can be detected to very high redshifts. They pinpoint their faint host galaxies and can be used to probe the gas and dust in their immediate environments and in the intergalactic medium. I will review what we are already learning about high redshift star formation from GRBs, and consider prospects for the future.