feat: Support granite 4 preview architecture for MoE kernels, EP, and fast kernels

[kmehant]

Extend support to GraniteMoeHybridForCausalLM for all the fast moe (fast kernels, and EP) features and padding free.

Summary of changes

• extend support to GraniteMoeHybridForCausalLM
• update a100_80gb_moe.csv | updated based on new bench results and new GraniteMoeHybridForCausalLM model
• update a100_80gb_moe.csv | bench for mixtral
• update requirements_moe.txt
• regression test for the above runs.
• report parity charts
• report outliers
• raise issue for failed runs in the new benchmark (see: test: regression tests show higher memory, throughput and loss values for some settings and models #147)
• raise issue for loss regression (see: test: regression tests show higher memory, throughput and loss values for some settings and models #147)

Final reg plots that includes past models

memory increased	loss	throughput increased

Outliers

3 classes of outliers can be identified

1. increased throughput
2. increased memory consumption
3. increased loss

issue: #147

Loss regression

Models ibm-granite/granite-3.0-3b-a800m-instruct and ibm-research/moe-7b-1b-active-shared-experts all padding-free runs regressed from previous bench loss showing larger losses than previous bench loss. However, its not clear if it has to do with padding-free since other models in the benchmark set didn't regress with padding free on.

All outliers

Additional failed runs compared to previous benchmark

Reason: OOM

Granite 4 preview acceleration over baselines (mamba kernels + accelerations added as part of this PR.)

[fabianlim]

in this case isnt it better to just lower bound? and if so this line exact version is used since upper bound is not known is not needed

[kmehant]

Fixed @fabianlim

[fabianlim]

better not to have mamba installs by default

[fabianlim]

Im ok with the changes. Just wondering what caused the loss regressionl

[willmj]

LGTM

[kmehant]

Just wondering what caused the loss regressionl

It was happening only on old models and padding free setting, also not for newer models with padding free on, so needs investigation, we will check it based on available cycles and update it on the attached issue.