The scandal that brought down CIA Director David Petraeus started with harassing emails sent by his biographer and paramour, Paula Broadwell, to another woman, and eventually led the FBI to discover the affair, U.S. officials said on Saturday.