If I buy the fastest processor, does that always ensure the best performance for my computer?

Yes. Having the fastest processor will ensure that you get the best performance from your computer.

Yes. Speed is all that matters for performance.

Apart from a fast processor, just make sure you get a large hard drive to ensure best performance.

Not necessarily. A computer's overall performance depends on many other factors than just the processing speed.