File tree Expand file tree Collapse file tree 1 file changed +1
-13
lines changed 
.ci/scripts/benchmark_tooling Expand file tree Collapse file tree 1 file changed +1
-13
lines changed Original file line number Diff line number Diff line change @@ -58,7 +58,7 @@ python3 get_benchmark_analysis_data.py \
5858--models ' meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8' ' mv3' 
5959``` 
6060
61- this fetches all the private iphone table data that has model ` llama-3.2-1B `  and ` mv3 ` , and associated public iphone data 
61+ this fetches all the private iphone table data that has model ` llama-3.2-1B `  and ` mv3 ` , and associated public iphone
6262``` bash 
6363python3 get_benchmark_analysis_data.py \
6464--startTime " 2025-06-01T00:00:00" 
@@ -122,18 +122,6 @@ dict_results = fetcher.to_dict()
122122results =  fetcher.output_data(output_type = " excel" output_dir = " ./results" 
123123``` 
124124
125- ### analyze_benchmark_stability.py  
126- 
127- This script analyzes the stability of benchmark data, comparing the results of private and public devices.
128- 
129- #### Quick Start  
130- 
131- ``` bash 
132- python .ci/scripts/benchmark_tooling/analyze_benchmark_stability.py \
133-     " Benchmark Dataset with Private AWS Devices.xlsx" 
134-     --reference_file " Benchmark Dataset with Public AWS Devices.xlsx" 
135- ``` 
136- 
137125## Running Unit Tests  
138126
139127The benchmark tooling includes unit tests to ensure functionality.
 
 
   
 
     
   
   
          
    
    
     
    
      
     
     
    You can’t perform that action at this time.
  
 
    
  
    
      
        
     
       
      
     
   
 
    
    
  
 
  
 
     
    
0 commit comments