need help understanding profiler in deespeed mio

 The _num_generated_tokens is always 100. To understand if its storing tokens from previous sample, I deleted the pipeline and created a new one for every sample. Still the _num_generated_token is about 100. Can you please help me understand , how _num_generated_tokens is calculated?