Or rather, E is for et from which comes the ampersand symbol.
Over at Adobe they explain the origin of the name, as well as providing many more handwritten and typeset examples.
E is also for ellipsis (…)
And for Erik Spiekermann, father of fonts, whose knighting on 1 April prompted a rare typographical joke from the Queen as well as some unsolicited photoshop tutorials for the reporter.