Add Model Profiling Automation Script (#13493)

### Summary
Added profile_model.sh to automate the ExecutorTorch model profiling
workflow. The script streamlines building executor_runner with profiling
enabled, running model inference with ETDump collection, and generating
CSV profiling reports. It accepts model and ETDump paths as arguments
with sensible defaults, consolidating what was previously a multi-step
manual process into a single executable script.

### Test plan
Manually ran script on llama3.pte and confirmed csv and dump generation

Co-authored-by: Gasoonjia <[email protected]>

Author: leafs1

.gitignore

@@ -20,6 +20,7 @@ dist/
 ethos-u-scratch/
 executorch.egg-info
 pip-out/
+build-profiling/
 
 # Any exported models and profiling outputs
 *.bin
@@ -60,6 +61,7 @@ xcuserdata/
 /share/
 /version.py
 *.csv
+*_etdump
 
 # Android
 *.aar

devtools/scripts/generate_profiling_csv.py

@@ -0,0 +1,62 @@
+# Copyright (c) Meta Platforms, Inc. and affiliates.
+# Copyright 2024-25 Arm Limited and/or its affiliates.
+# All rights reserved.
+#
+# This source code is licensed under the BSD-style license found in the
+# LICENSE file in the root directory of this source tree.
+
+import argparse
+
+from executorch.devtools import Inspector
+
+
+def generate_csv(etdump_path, output):
+    """
+    Generate a CSV file from ETDump profiling data.
+
+    Args:
+        etdump_path (str): Path to the ETDump file generated by executor_runner
+        output (str): Path for the output CSV file
+    """
+    inspector = Inspector(etdump_path)
+    df = inspector.to_dataframe()
+    df.to_csv(output)
+
+
+def main():
+    """
+    Main function to parse command line arguments and generate profiling CSV.
+
+    Usage:
+        python generate_profiling_csv.py --etdump_path="my_etdump" --output="profiling.csv"
+
+    Example:
+        python generate_profiling_csv.py --etdump_path="llama3_etdump" --output="op_profiling.csv"
+    """
+    parser = argparse.ArgumentParser(
+        description="Generate profiling CSV from a model's etdump"
+    )
+    parser.add_argument(
+        "--etdump_path",
+        type=str,
+        default="./model.etdump",
+        help="Path to the etdump file",
+        required=False,
+    )
+
+    parser.add_argument(
+        "--output",
+        type=str,
+        default="./model_profiling.csv",
+        help="Path to the output CSV file",
+        required=False,
+    )
+
+    args = parser.parse_args()
+    print(f"Generating CSV from {args.etdump_path}")
+    generate_csv(args.etdump_path, args.output)
+    print(f"Saved CSV to {args.output}")
+
+
+if __name__ == "__main__":
+    main()

devtools/scripts/profile_model.sh

@@ -0,0 +1,51 @@
+# Copyright (c) Meta Platforms, Inc. and affiliates.
+# Copyright 2024-25 Arm Limited and/or its affiliates.
+# All rights reserved.
+#
+# This source code is licensed under the BSD-style license found in the
+# LICENSE file in the root directory of this source tree.
+
+#!/bin/bash
+
+# ExecutorTorch Model Profiling Script
+#
+# This script automates the process of building executor_runner with profiling enabled,
+# running model inference with ETDump collection, and generating CSV profiling reports.
+#
+# Usage:
+#   ./devtools/scripts/profile_model.sh [model_path] [etdump_path]
+#
+# Arguments:
+#   model_path  - Path to the .pte model file (default: "my_model")
+#   etdump_path - Path for ETDump output file (default: "path_to_et_dump")
+#
+# Examples:
+#   ./devtools/scripts/profile_model.sh
+#   ./devtools/scripts/profile_model.sh llama3.pte llama3_etdump
+#
+# Note: This script must be run from the top-level executorch directory.
+
+set -e
+
+echo "Building executor_runner with profiling enabled..."
+
+cmake --preset profiling -B build-profiling -DCMAKE_BUILD_TYPE=Release
+cmake --build build-profiling --target executor_runner
+
+echo "Build completed successfully!"
+
+MODEL_PATH=${1:-"my_model"}
+ETDUMP_PATH=${2:-"path_to_et_dump"}
+
+echo "Running and profiling model: $MODEL_PATH"
+echo "ETDump output path: $ETDUMP_PATH"
+
+./build-profiling/executor_runner --model_path="$MODEL_PATH" --etdump_path="$ETDUMP_PATH"
+
+echo "Profiling run completed!"
+
+echo "Generating profiling CSV..."
+python devtools/scripts/generate_profiling_csv.py --etdump_path="$ETDUMP_PATH" --output="op_profiling.csv"
+
+echo "Profiling CSV generated: op_profiling.csv"
+echo "Profiling workflow completed successfully!"