Exam Professional Machine Learning Engineer topic 1 question 183 discussion

A common reason for underutilized TPUs is a small batch size. TPUs are designed for high throughput, and feeding them small batches doesn't leverage their full potential. Try increasing the batch size while monitoring model performance. A larger batch size can lead to faster training but might also affect accuracy. Experiment to find the optimal balance.

D taking big batch size allows to use more memory and decrease the train time

Batch size is too small because of sharding https://cloud.google.com/tpu/docs/performance-guide

D, the bigger the batch size, the more resource is taken up