SAM2.1 and example README (#1048)

cpuhrsch · web-flow · commit 9b748dee1cf2 · 2024-10-24T15:33:16.000-07:00
* Examples readme

* Example image

* curl command

* checkpoint_path argument

* SAM 2.1
diff --git a/examples/README.md b/examples/README.md
@@ -0,0 +1,3 @@
+# Examples
+
+Various example scripts and applications of torchao and PyTorch in general.
diff --git a/examples/sam2_amg_server/README.md b/examples/sam2_amg_server/README.md
@@ -1,5 +1,4 @@
-To run this example you need to download the vit_h checkpoint and put it into a local folder named checkpoints
-
-You can find the checkpoint for vit_h here: https://dl.fbaipublicfiles.com/segment_anything/sam_vit_h_4b8939.pth
-
-To read the image you also need to install opencv-python: https://pypi.org/project/opencv-python/
+## Example curl command
+```
+curl -X POST http://127.0.0.1:5000/upload -F 'image=@/path/to/file.jpg' --output path/to/output.png
+```
diff --git a/examples/sam2_amg_server/dog.jpg b/examples/sam2_amg_server/dog.jpg
diff --git a/examples/sam2_amg_server/example.html b/examples/sam2_amg_server/example.html
@@ -1,4 +1,4 @@
-!DOCTYPE html>
+<!DOCTYPE html>
 <html lang="en">
 <head>
     <meta charset="UTF-8">
diff --git a/examples/sam2_amg_server/sam2_hiera_l.yaml b/examples/sam2_amg_server/sam2_hiera_l.yaml
diff --git a/examples/sam2_amg_server/server.py b/examples/sam2_amg_server/server.py
@@ -53,19 +53,19 @@ class GenerateRequest(BaseModel):
     num_steps: Optional[int] = 30
     seed: Optional[int] = 42
 
-def main():
+def main(checkpoint_path):
 
     from sam2.build_sam import build_sam2
     from sam2.automatic_mask_generator import SAM2AutomaticMaskGenerator
     
     device = "cuda"
-    sam2_checkpoint = "checkpoints/sam2_hiera_large.pt"
-    model_cfg = "sam2_hiera_l.yaml"
+    from pathlib import Path
+    sam2_checkpoint = Path(checkpoint_path) / Path("sam2.1_hiera_large.pt")
+    model_cfg = "configs/sam2.1/sam2.1_hiera_l.yaml"
     logging.basicConfig(level=logging.INFO)
     
-    logging.info(f"Loading model: {sam2_checkpoint}")
+    logging.info(f"Loading model {sam2_checkpoint} with config {model_cfg}")
     sam2 = build_sam2(model_cfg, sam2_checkpoint, device=device, apply_postprocessing=False)
-    sam2.to(device=device)
 
     mask_generator = SAM2AutomaticMaskGenerator(sam2) #, points_per_batch=None)
 

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,3 @@`
	`1`	`+# Examples`
	`2`	`+`
	`3`	`+Various example scripts and applications of torchao and PyTorch in general.`
Original file line number	Diff line number	Diff line change
`@@ -1,4 +1,4 @@`
`1`		`-!DOCTYPE html>`
	`1`	`+<!DOCTYPE html>`
`2`	`2`	`<html lang="en">`
`3`	`3`	`<head>`
`4`	`4`	`<meta charset="UTF-8">`