Kiss's parents and two older siblings emigrated from Hungary to the United States in 1956 following the Hungarian Revolution. Kiss was born in New York City and gained her undergraduate degree in 1983 from Davidson College in North Carolina, where she graduated Omicron Delta Kappa. She was elected a Rhodes Scholar in 1983, studied at Balliol College and received a D.Phil. from the University of Oxford in 1990.