Skip to content

[ExecuTorch] FFHT: ARM NEON port #5188

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 67 commits into from
Closed

[ExecuTorch] FFHT: ARM NEON port #5188

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
0f4caa1
[flamingo] Update preproc imports (#5160)
lucylq Sep 9, 2024
2dee34e
Refactor namespace usage in module tests.
shoumikhin Sep 9, 2024
647bfd4
Add an overload to skip dtype and sizes.
shoumikhin Sep 9, 2024
b52d4b6
Enable Llama3 Multi-turn conversation
cmodi-meta Sep 9, 2024
cd9d536
Make convert to linear an export pass
mcr229 Sep 9, 2024
b69ae0c
Hide and simplify operator registry internals
dbort Sep 9, 2024
6b1e328
[ExecuTorch] Support BFloat16 in CPUBlas gemm
swolchok Sep 9, 2024
72f9227
[ExecuTorch] FFHT: ARM NEON port
swolchok Sep 9, 2024
eca9ed5
q to s start ops | add dim order sanity check
Gasoonjia Sep 9, 2024
85410e4
Qualcomm AI Engine Direct - Optimization and fix mutable buffer issue…
shewu-quic Sep 9, 2024
279adc6
Update base for Update on "[ExecuTorch] FFHT: ARM NEON port"
swolchok Sep 9, 2024
d106da2
Update on "[ExecuTorch] FFHT: ARM NEON port"
swolchok Sep 9, 2024
d2014e3
Add a target rule for ops_registrations (#5083)
LeeOHzzZ Sep 9, 2024
b23ee01
Register LLM prefill native method in JNI
kirklandsign Sep 9, 2024
28beeff
Clean up devtools/etdump
dbort Sep 9, 2024
7f3f146
Update base for Update on "[ExecuTorch] FFHT: ARM NEON port"
swolchok Sep 9, 2024
58c70de
Update on "[ExecuTorch] FFHT: ARM NEON port"
swolchok Sep 9, 2024
6ce9f52
t to z start ops | add dim order sanity check
Gasoonjia Sep 9, 2024
542ecb5
Add Echo parameter to multimodal runner (llava) and jni layer (#5181)
cmodi-meta Sep 9, 2024
59d9bad
Use c++17 for size test
lucylq Sep 9, 2024
7650667
Add a default delegate time scale converter
Olivia-liu Sep 10, 2024
f412630
Qualcomm AI Engine Direct - Uplevel QNN version for ci test (#5174)
shewu-quic Sep 10, 2024
c5a385e
Update schema to include infinity for double values
lucylq Sep 10, 2024
f471556
Partition Mutable Buffer as Core ML State (#5165)
YifanShenSZ Sep 10, 2024
67ae762
Qualcomm AI Engine Direct - Add the argument to specify soc model (#5…
shewu-quic Sep 10, 2024
63e794a
Add pass to convert special case of mean.dim to averagepool2d
per Sep 10, 2024
370f304
Add slice_scatter test: large end value
manuelcandales Sep 10, 2024
083b9e6
[ET-VK] Fix gpuinfo CI
junpi3 Sep 10, 2024
1eeded1
Let the app check "aatp/data" subdir for AWS.
shoumikhin Sep 10, 2024
126abb5
Update the API of registering fake kernels to new standard (#5084)
LeeOHzzZ Sep 10, 2024
657789e
Qualcomm AI Engine Direct - Apply spin quant R1 and R2 (#5175)
shewu-quic Sep 10, 2024
549f14b
Restore constant segment
lucylq Sep 10, 2024
e826de3
Add Half/BFloat16 tests for op_mul
manuelcandales Sep 10, 2024
43e2f2d
Qualcomm AI Engine Direct - support skip quantization (#5070)
haowhsu-quic Sep 10, 2024
30acae5
Switch over backend tests to export_for_training
tarun292 Sep 10, 2024
db34239
[LLava] Fix stats for C++ runner
digantdesai Sep 10, 2024
02304d7
Update bundled_program to use new namespace
dbort Sep 10, 2024
c76b22f
Qualcomm AI Engine Direct - Fixed the order of the transforms for lla…
shewu-quic Sep 10, 2024
d38ca81
Android refactor cmake build
kirklandsign Sep 10, 2024
a4d67e2
Android: Leverage prefillPrompt and prefillImage on Llava
Riandy Sep 10, 2024
b54206d
Update the minimum C++ version to C++17
dbort Sep 10, 2024
4ce0f9d
Introduce PlatformMemoryAllocator
manuelcandales Sep 10, 2024
2b50c76
Use dynamic bound by default.
shoumikhin Sep 10, 2024
ced40f4
Fix models in benchinfra (#5226)
guangy10 Sep 10, 2024
e245590
App side change
kirklandsign Sep 10, 2024
4cce620
Minor fix: Create root dir when it doesn't exist. (#5075)
freddan80 Sep 10, 2024
ab6d91c
Fix internal executorch_llama_jni
kirklandsign Sep 10, 2024
f07e4d5
Update setup-with-qnn.sh with runner util flag (#5210)
WuhanMonkey Sep 10, 2024
cac2c05
[ET-VK] Integrate axis mapping into optimized matrix multiplication s…
SS-JIA Sep 10, 2024
cba5bee
fbshipit-source-id: f63634ba171da01328849d84552b125b829403e8
facebook-github-bot Sep 11, 2024
ca889fb
Minibench use model_dir instead (#5250)
kirklandsign Sep 11, 2024
e4d72ce
Update setup.sh for LlamaDemo (#5235)
kirklandsign Sep 11, 2024
d423131
Android app UI/flow improvements (#5241)
Riandy Sep 11, 2024
7942d2c
Allow core aten op exception list (#5237)
larryliu0820 Sep 11, 2024
69aed24
link whole quantized_ops_lib (#5253)
kirklandsign Sep 11, 2024
41bc1ce
spinquant in eager mode (#5125)
Sep 11, 2024
d7a7ec6
Updated the workflow to upload models to S3 (#5232)
Sep 11, 2024
7e374d7
Add model execution scripts and runner (#5217)
neuropilot-captain Sep 11, 2024
af80804
Debug event populates event name (#5142)
Olivia-liu Sep 11, 2024
68397af
Optimized op_mm using CPUBlas gemm (#5242)
swolchok Sep 11, 2024
d73a653
Add optimized op_linear (#5243)
swolchok Sep 11, 2024
3171ede
Add scalar tensor tests. (#5260)
shoumikhin Sep 11, 2024
4da3c5d
Add CoreML Quantize (#5228)
Sep 11, 2024
d6b800b
Add helper function to create empty, full, ones and zeros tensors. (#…
shoumikhin Sep 11, 2024
75a56a2
Add helper function to create random tensors. (#5266)
shoumikhin Sep 11, 2024
dc3c426
Update base for Update on "[ExecuTorch] FFHT: ARM NEON port"
swolchok Sep 11, 2024
405f84b
Update on "[ExecuTorch] FFHT: ARM NEON port"
swolchok Sep 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 0 additions & 38 deletions extension/llm/custom_ops/spinquant/FFHT/fht.h
View file
Open in desktop

This file was deleted.

32 changes: 0 additions & 32 deletions extension/llm/custom_ops/spinquant/FFHT/fht_impl.h
View file
Open in desktop

This file was deleted.

Loading