One of the most significant discoveries made by the ESA Herschel Space Observatory has been the population of strong gravitational lens systems, selected by Herschel with a spectacular ~100% efficiency. I will review some of the progress made by the Herschel ATLAS key project in the discovery and follow-up of these systems, and describe our immediate plans and longer term aspirations.