Skip to content

Issues: pytorch/executorch

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
29 Open 20 Closed
29 Open 20 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Benchmark Issue]IPHONE MAX PRO 15 failure investigation [May 22 2025] module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#11083 opened May 22, 2025 by yangw-dev
@yangw-dev
2
Bug in Benchmark Dash UI display module: benchmark Issues related to the benchmark infrastructure
#10524 opened Apr 28, 2025 by guangy10
@huydhn @yangw-dev
Move benchmarking workflow cli from testinfra to executorch CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: benchmark Issues related to the benchmark infrastructure module: dev infra Issues related to developer infrastructure (other than CI, which is module: ci) topic: not user facing
#10162 opened Apr 14, 2025 by Camyll Loading…
21
Report device health metrics for AWS leased devices module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#10141 opened Apr 14, 2025 by guangy10
@huydhn @yangw-dev
Track model pte size in the benchmark dashboard module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8810 opened Feb 28, 2025 by jackzhxng
@huydhn @guangy10
Benchmark: Fix metrics high variability from run-to-run enhancement Not as big of a feature, but technically not a bug. Should be easy to fix high priority module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triage review Items require an triage review triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8603 opened Feb 20, 2025 by guangy10 0.6.0
@shoumikhin @guangy10 @kirklandsign
44
Resolve the discrepancy of latency report between LLMs and non-LLMs enhancement Not as big of a feature, but technically not a bug. Should be easy to fix module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8576 opened Feb 19, 2025 by guangy10 0.6.0
@shoumikhin @huydhn
@kirklandsign @yangw-dev
6
Add benchmark for Llama3.2 1B w/ MPS 8da4w module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8473 opened Feb 13, 2025 by guangy10
@manuelcandales
OSS Android Benchmarking: minibench and microbench module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8402 opened Feb 12, 2025 by kirklandsign
3 tasks
@kirklandsign
9
[Android benchmarking] Add support to benchmark individual op module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8385 opened Feb 11, 2025 by kirklandsign
@kirklandsign
Run critical models & recipes on pull request enhancement Not as big of a feature, but technically not a bug. Should be easy to fix module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8348 opened Feb 10, 2025 by guangy10
@guangy10
Benchmark Hugging Face models via Optimum integration module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8294 opened Feb 6, 2025 by guangy10 0.6.0
@guangy10
1
Add Vulkan Delegate Benchmarks for Llama 3.2 (1B and 3B) and MobileNet module: benchmark Issues related to the benchmark infrastructure module: vulkan Issues related to the Vulkan delegate and code under backends/vulkan/ triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8293 opened Feb 6, 2025 by SS-JIA 0.6.0
@SS-JIA
Prototype benchmarking with private/custom devices that are not leased via AWS module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8251 opened Feb 6, 2025 by guangy10
@huydhn
2
Support benchmark with arbitrary binaries on Android module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8250 opened Feb 6, 2025 by guangy10
@kirklandsign
1
Support benchmark with arbitrary binaries on iOS module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8249 opened Feb 6, 2025 by guangy10
@shoumikhin
1
DevX: Track the benchmark infra health and usage enhancement Not as big of a feature, but technically not a bug. Should be easy to fix module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8247 opened Feb 6, 2025 by guangy10 0.6.0
@yangw-dev
8
Support benchmark using prebuilt artifacts module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8246 opened Feb 6, 2025 by guangy10
@huydhn
7
Support scheduling benchmark jobs via scripts module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8245 opened Feb 6, 2025 by guangy10 0.6.0
@huydhn @Camyll
1
Enable workflow time profiling module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8244 opened Feb 6, 2025 by guangy10 0.6.0
@guangy10
Enable framegraphs for benchmarking on iOS module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8243 opened Feb 6, 2025 by guangy10 0.6.0
@shoumikhin
Enable framegraphs for benchmarking on Android module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8242 opened Feb 6, 2025 by guangy10 0.6.0
@kirklandsign
4
Integrate mem profiler to benchmark infra module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8241 opened Feb 6, 2025 by guangy10 0.6.0
@kirklandsign
Integrate ETdump to benchmark infra module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8240 opened Feb 6, 2025 by guangy10 0.6.0
@kirklandsign
1
Support auto regression detection and bisect module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8239 opened Feb 6, 2025 by guangy10 0.6.0
@huydhn @wdvr @yangw-dev
2
ProTip! no:milestone will show everything without a milestone.