You can select two types of hardware accelerators.
Without a hardware accelerator, you will get:
But, with GPUs:
So it gets about six times faster with a GPU.
A sample program provided by Google shows twenty times acceleration with GPUs.
Another sample program shows the throughput of 162.58 TFlops with TPUs.