Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor the API for quant method argument for quantize function #400

Merged
merged 1 commit into from
Jun 21, 2024

Conversation

jerryzh168
Copy link
Contributor

@jerryzh168 jerryzh168 commented Jun 19, 2024

Summary:
Addressing feedback from #384 and #375

  • expanded function api names, e.g. int4_weight_only
  • removed string API

Test Plan:
regression tests

python test/quantization/test_quant_api.py
python test/integration/test_integration.py

Reviewers:

Subscribers:

Tasks:

Tags:

Copy link

pytorch-bot bot commented Jun 19, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/400

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 20a2938 with merge base 512b5d6 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 19, 2024
int8da_int8w,
int4_weight_only,
int8_weight_only,
int8_dynamic_act_int8_weight,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we expand out act into activation as well? Might as well since we hardly have any abbreviations left

Copy link
Member

@msaroufim msaroufim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cool!

@supriyar
Copy link
Contributor

can you also include the update to the main README as well in this PR - specifically the snippet in https://github.com/pytorch/ao?tab=readme-ov-file#without-intrusive-code-changes

@jerryzh168 jerryzh168 force-pushed the api-refactor branch 2 times, most recently from 28680ff to e27b898 Compare June 19, 2024 04:41
Copy link
Collaborator

@vayuda vayuda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yea i think these function names are more clear and definitely better than the string api

@jerryzh168 jerryzh168 force-pushed the api-refactor branch 2 times, most recently from 5fb966d to 91a6dc5 Compare June 20, 2024 00:08
Summary:
Addressing feedback from pytorch#384 and pytorch#375

Test Plan:
regression tests

python test/quantization/test_quant_api.py
python test/integration/test_integration.py

Reviewers:

Subscribers:

Tasks:

Tags:
@jerryzh168 jerryzh168 merged commit 7a3f5a0 into pytorch:main Jun 21, 2024
13 checks passed
@jerryzh168 jerryzh168 deleted the api-refactor branch June 21, 2024 20:30
jerryzh168 added a commit to jerryzh168/ao that referenced this pull request Jun 25, 2024
Summary:
* added repr for TensorCoreTiledAQTLayoutTensor: pytorch#397
* removed the str -> apply_tensor_class map that was used to implement string APIs, which is removed in pytorch#400

Test Plan:
CI

Reviewers:

Subscribers:

Tasks:

Tags:
jerryzh168 added a commit to jerryzh168/ao that referenced this pull request Jun 25, 2024
Summary:
* added repr for TensorCoreTiledAQTLayoutTensor: pytorch#397
* removed the str -> apply_tensor_class map that was used to implement string APIs, which is removed in pytorch#400

Test Plan:
CI

Reviewers:

Subscribers:

Tasks:

Tags:
jerryzh168 added a commit that referenced this pull request Jun 26, 2024
Summary:
* added repr for TensorCoreTiledAQTLayoutTensor: #397
* removed the str -> apply_tensor_class map that was used to implement string APIs, which is removed in #400

Test Plan:
CI

Reviewers:

Subscribers:

Tasks:

Tags:
dbyoung18 pushed a commit to dbyoung18/ao that referenced this pull request Jul 31, 2024
…orch#400)

Summary:
Addressing feedback from pytorch#384 and pytorch#375

Test Plan:
regression tests

python test/quantization/test_quant_api.py
python test/integration/test_integration.py

Reviewers:

Subscribers:

Tasks:

Tags:
dbyoung18 pushed a commit to dbyoung18/ao that referenced this pull request Jul 31, 2024
Summary:
* added repr for TensorCoreTiledAQTLayoutTensor: pytorch#397
* removed the str -> apply_tensor_class map that was used to implement string APIs, which is removed in pytorch#400

Test Plan:
CI

Reviewers:

Subscribers:

Tasks:

Tags:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants