Skip to content

Commit

Permalink
Add min_sqnr to torchao/_models (#1502)
Browse files Browse the repository at this point in the history
* Add min_sqnr to torchao/_models

Summary:
att, this allows us to run benchmarks with different min_sqnr to control the accuracy
loss of the model

Test Plan:
```
export CHECKPOINT_PATH=checkpoints
export MODEL_REPO=meta-llama/Meta-Llama-3.1-8B
python torchao/_models/llama/generate.py --checkpoint_path "${CHECKPOINT_PATH}/${MODEL_REPO}/model.pth" --compile --compile_prefill --quantization autoquant-all --output_json_path benchmark-results.json --outpu\t_json_local --min_sqnr 40

python torchao/_models/sam/eval_combo.py --coco_root_dir datasets/coco2017 --coco_slice_name val2017 --sam_checkpoint_base_path checkpoints --sam_model_type vit_h --point_sampling_cache_dir tmp/sam_coco_mask_ce\nter_cache --mask_debug_out_dir tmp/sam_eval_masks_out --batch_size 32 --num_workers 8 --use_compile max-autotune --use_half bfloat16 --device cuda --compress autoquant-all --output_json_path benchmark-results.json\ --output_json_local --min_sqnr 40

cd examples/sam2_amg_server
python server.py ../../${CHECKPOINT_PATH}/sam2 large --port 4000 --host localhost --fast --use_autoquant --benchmark --dry --output_json_path ../../benchmark-results.json --output_json_local --min_sqnr 40
```

Reviewers:

Subscribers:

Tasks:

Tags:

* change origins

* add min_sqnr to result

* add min_sqnr to result

* cleanup
  • Loading branch information
jerryzh168 authored Jan 8, 2025
1 parent d42a382 commit e1d8899
Show file tree
Hide file tree
Showing 6 changed files with 605 additions and 320 deletions.
Loading

0 comments on commit e1d8899

Please sign in to comment.