-
Notifications
You must be signed in to change notification settings - Fork 649
Only support int8 and quant dtypes for quant operators #11685
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11685
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New Failure, 3 Unrelated FailuresAs of commit b0d9e08 with merge base ec67249 ( NEW FAILURE - The following job has failed:
BROKEN TRUNK - The following jobs failed but were present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
@mcr229 @digantdesai I'm running into some issues creating tests. Could you please provide some guidance on some reference files, etc.? |
@@ -220,9 +225,12 @@ def _check_node_has_valid_dtype(self, node): | |||
valid_dtypes = { | |||
torch.float32, | |||
torch.float16, | |||
torch.int8, | |||
torch.qint8, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what about this guy here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That makes sense, I've moved it into the conditional check and added other quant dtypes.
@GregoryComer can you point how to run the int8 tests that were failing in the new backend tester? Aside from that as long as existing tests are passing this change should be fine. |
rebased and fixed lint |
@GregoryComer does this fix your test? |
@digantdesai @mcr229 is there anything needed on my end to support this? |
@digantdesai has imported this pull request. If you are a Meta employee, you can view this in D79721107. |
@digantdesai has imported this pull request. If you are a Meta employee, you can view this in D79721107. |
Summary
Fixes #11581. Check that node is a quant op before including
int8
and other quantdtypes
invalid_dtypes
.Test plan
Still working on creating tests.