According to the InfoGAN,the latent codes is really useful.
But in your code,the latent code just act as a "int".I think the code is wrong.And thus the result is wrong.It can not reproduce the ADE and FDE you said in your paper.
Hope to get your respond.