>1200: Pre-Inca Times
Some of the first evidence of human habitation in Peru was discovered by the late American archaeologist Richard MacNeish in the 1960s.
In the Pikimachay cave in Ayacucho, MacNeish found what he called “the Pacaicasa man” which lived there 20,000 - 13,000 BCE. However, this is certainly long before the first civilizations left complete cities for us to study.
The oldest city that has been found in Peru is Caral-Supe, which was first inhabited around 3000 BCE.
Other important pre-Inca cultures were the Moche, who left us the Lord of Sipan, the Chimú who left us Chan Chan, the Chachapoyas culture who left us Kuélap and the Chavín who left Chavín de Huántar.
Further reading
There are more books about Inca history than pre-Inca history, but here are a few good ones.
Focusing on the north coast of Peru, Ritual Violence in the Ancient Andes explores the pre-Inca cultures Moche and Chimú, albeit through the lens of violence and human sacrifices.
A book that includes both pre-Inca and Inca history is Peruvian Prehistory: An Overview of Pre-Inca and Inca Society, focusing on the Chavín, Tiwanaku, Huari, Moche, and Nazca cultures.