Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VLlama vision model ISQ support #928

Merged
merged 2 commits into from
Nov 23, 2024
Merged

VLlama vision model ISQ support #928

merged 2 commits into from
Nov 23, 2024

Conversation

EricLBuehler
Copy link
Owner

@EricLBuehler EricLBuehler commented Nov 23, 2024

  • Implement the ISQ
  • Update the residual tensors list query and in loader to support UQFF
  • Update the UQFF model cards

Copy link

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           35           28            0            7
 Dockerfile              1           41           22           10            9
 Happy                   1          442          369            0           73
 JSON                   12          105          104            0            1
 Python                 53         2274         1949           63          262
 Shell                   1           57           22           18           17
 TOML                   18          583          520            2           61
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       4            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          196          169            1           26
 (Total)                            273          201           32           40
-------------------------------------------------------------------------------
 Markdown               40         3009            0         2286          723
 |- BASH                 6          101           98            0            3
 |- JSON                 1           12           12            0            0
 |- Python               6          114          102            0           12
 |- Rust                10          361          306            0           55
 |- TOML                 2           75           63            0           12
 (Total)                           3672          581         2286          805
-------------------------------------------------------------------------------
 Rust                  280        84940        76213         1764         6963
 |- Markdown           136         1436           25         1307          104
 (Total)                          86376        76238         3071         7067
===============================================================================
 Total                 415        91507        79246         4145         8116
===============================================================================
  

@EricLBuehler EricLBuehler merged commit 81a218d into master Nov 23, 2024
12 checks passed
@EricLBuehler EricLBuehler deleted the vllama_vision_isq branch November 23, 2024 17:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant