Does hls4ml currently support transform architectures?

[LmDeng0]

Does hls4ml currently support transform architectures now?
I saw in the paper Ultra Fast Transformers on FPGAs for Particle Physics Experiments that MHA support will be made available in the near future.

[JanFSchulte]

It's not available yet, we expect a pull request integrating this code in the next weeks.

[LmDeng0]

I'm looking forward to it, thank you!

[vmayoral]

Greetings @JanFSchulte, any chance this integration has happened already since Oct? Thanks

[ChloeCarbonniere]

Hello,

Has the integration happened since October 2024?

[bo3z]

Some experimental support in PRs: #1163 for multi-head attention and #1110 for LayerNorm.