Integrate the Taylor series for ex2 term by term. Does this look like a familiar series?
When a function has a well-behaved Taylor series, we can find a Taylor series for some integrals by integrating term by term (proving that these integrals converge to the correct answer requires methods from more advanced courses).