Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add YoloV4 inference server #52

Merged
merged 11 commits into from
Dec 23, 2024
+533 −0
Merged

Add YoloV4 inference server #52

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
2dc6ec8
Setup Dockerfile, docker-compose.yaml - TODO - Add instructions to RE…
bgoelTT Dec 6, 2024
14bd2bd
Add instructions to README - TODO - add locust test
bgoelTT Dec 6, 2024
5555914
Fix env var interpolation in docker-compose.yaml and update README
bgoelTT Dec 6, 2024
f3334c3
Add load test and instructions to README - TODO - add eval test
bgoelTT Dec 7, 2024
b71bbe2
Remove test image from commit history, pull from internet at runtime
bgoelTT Dec 12, 2024
4c0a277
Change YoloV4 to YOLOv4 in README
bgoelTT Dec 13, 2024
be8d0bf
Remove superfluous comment
bgoelTT Dec 13, 2024
9d79724
Modify .gitignore to track requirements-test.txt and add file
bgoelTT Dec 13, 2024
56f18c2
Add locust to requirements-test.txt
bgoelTT Dec 18, 2024
8a52699
Add class label to returned items
bgoelTT Dec 18, 2024
5733897
Use full core grid for all wormhole devices (n150 and n300)
bgoelTT Dec 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove superfluous comment
  • Loading branch information
@bgoelTT
bgoelTT committed Dec 13, 2024
commit be8d0bf52fd56c13b5b718cdee7a4f43042a9796
1 change: 0 additions & 1 deletion tt-metal-yolov4/server/fast_api_yolov4.py
View file
Original file line number Diff line number Diff line change
@@ -36,7 +36,6 @@ async def root():
def get_dispatch_core_type():
# TODO: 11059 move dispatch_core_type to device_params when all tests are updated to not use WH_ARCH_YAML env flag
dispatch_core_type = ttnn.device.DispatchCoreType.WORKER
# if ("WH_ARCH_YAML" in os.environ) and os.environ["WH_ARCH_YAML"] == "wormhole_b0_80_arch_eth_dispatch.yaml":
if os.environ["WH_ARCH_YAML"] == "wormhole_b0_80_arch_eth_dispatch.yaml":
dispatch_core_type = ttnn.device.DispatchCoreType.ETH
return dispatch_core_type