I have read the paper, the theory is so wonderful. In "6.2 Inverse Rendering of Geometry", a single-bounce forward rendering is done with known pointlights and a known diffuse-Phong BRDF. It means that the lights and BRDF are known. And the rendered result are only 1-channel values of meshes without RGB colors.
IDR works well for calibrated RGB images without known lights and BRDF, then does NIE work well in the same case?