Skip to content

Support grouping of Transformer Architecture Encoder-Decoder building blocks #822

@GeorgeS2019

Description

@GeorgeS2019

The more complex transformer architecture (e.g. from ONNX) consists of a stacking of either encoder or decoder building blocks. It will help if the Netron community can feedback how to make such complex graph network more intuitive to visualize with an overview of these building blocks.

Ideally these higher level building blocks are defined within the ONNX during export.

Is there graph layout methods that can help in identifying these building blocks?

Recently, a Work-In-Progress attempt has been made on such feature. Here is a WIP output using gpt2.onnx

image

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions