Update repoagent documentation #2499
Conversation
|
@GuanLuo read carefully the triton steps listed in this doc, especially the forward and reverse orders. I don't think this matches the implementation so we may need to discuss. |
|
|
||
| * Load the model's configuration file (config.pbtxt) and extract the | ||
| *ModelRepositoryAgents* settings. Even if a repository agent | ||
| modifies the config.pbtxt file, the repository agent settings from |
There was a problem hiding this comment.
@deadeyegoodwin Does this imply the model will be loaded using the config.pbtxt file in the final model location? i.e. after all agents are invoked, Triton will read the config again from the location that the last agent points to.
The reverse order is not implemented right now, but it should be a trivial change as the agent models are not depending to each other except during TRITONREPOAGENT_ACTION_LOAD
There was a problem hiding this comment.
Yes, initially the repository manager should only need the repoagent part of the initial config to determine which (if any) repo agents are specified for the model. After invoking all the repoagents with LOAD successfully then the repository manager should treat the final repository location as if it was directly presented by the user. So config.pbtxt should be used, etc.
I will file a ticket for the reverse order change
No description provided.