[misc][plugin] add plugin system implementation

[youkaichao]

follows #7131

[github-actions]

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which consists a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of default ones by unblocking the steps in your fast-check build on Buildkite UI.

Once the PR is approved and ready to go, please make sure to run full CI as it is required to merge (or just use auto-merge).

To run full CI, you can do one of these:

• Comment /ready on the PR
• Add ready label to the PR
• Enable auto-merge.

🚀

[youkaichao]

@DarkLight1337 this pr should be much simplier now, I moved the opt model files to dynamic download, without adding it to our codebase.

[simon-mo]

A very quick README in vllm/plugins will be useful. Also i do find the term general to be not very informative. just call it VLLM_PLUGINS is good enough. But leaving it all to you. The code itself looks fine for me. I also like the fact that it doesn't break existing OOT registration flow rather sit on top of it.

[youkaichao]

Also i do find the term general to be not very informative. just call it VLLM_PLUGINS is good enough

@simon-mo changed in b03ab18

[youkaichao]

A very quick README in vllm/plugins will be useful.

doc change will come later.

[Pinkypoopoo]

Unsubscribe

…

On Wed, 14 Aug, 2024, 4:19 am youkaichao, ***@***.***> wrote: A very quick README in vllm/plugins will be useful. doc change will come later. — Reply to this email directly, view it on GitHub <#7426 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BCU643VUQYGOS53JUTWTPMDZRKEQ7AVCNFSM6AAAAABMMSSDJ6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBXGMYDSMJRGE> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[youkaichao]

fixes #5657