Sparsity Runtime Integration with TF/TFLite for Latency Improvements

[alanchiao]

As suggested here, model pruning currently only provides benefits in model compression/size reduction. Further framework support is necessary to provide latency improvements in TF/TFLite.

[sujoyrc]

When do you think this will be included in tensorflow / TFLite release ? Is there a targeted timeline ? We are planning to do an internal development if this is not expected within this year (2020) based on this.

[raziel]

Hi.
We're expecting a Q2/Q3 release date, though full TFLite kernel support will be an ongoing process after that (i.e. not all TFLite kernels will have sparse execution support).

Also, we're hoping the current working-from-home situation won't affect things further.

Thanks

[sujoyrc]

Thank you

[sujoyrc]

Why is this closed ? will this be integrated in next version ?

[alanchiao]

Reopened. Will not be integrated necessarily in next release.