2p2d support #1951

Closed

hsubramony wants to merge 55 commits intohabana_mainfrom

libint/debug_ttft

Commits on Jul 1, 2025

merge ace w/o merged_prefill_for_v1 changes
shepark
committed

Commits on Jul 23, 2025

first nixl version
bukeao
committed

Commits on Jul 24, 2025

add logger.info to indicate the completion of kv transfer
bukeao
committed

Commits on Jul 31, 2025

add perf_counter to kv cache transfer
bukeao
committed

Commits on Aug 4, 2025

disable caching in kv_manager to fix second identical request failed error
bukeao
committed

Commits on Aug 5, 2025

Commits on Aug 6, 2025

Commits on Aug 11, 2025

fix accuracy issue
bukeao
committed

Commits on Aug 13, 2025

Commits on Aug 15, 2025

temperary code to fix the input_batch.req_type has the right flag; tested in high concurret requests
bukeao
committed

Commits on Aug 16, 2025

Fix D node processing prompt
libinta
committed

Commits on Aug 19, 2025

Commits on Aug 21, 2025

Commits on Aug 22, 2025

rewrite copy function and add benchmark profile
libinta
committed

Commits on Aug 27, 2025

test
libinta
committed
fix log
libinta
committed

Commits on Aug 28, 2025

add more log
libinta
committed

Commits on Aug 29, 2025

Commits on Sep 5, 2025

enable GDR
bukeao
committed
indent typo
bukeao
committed

Commits on Sep 10, 2025

fix assertion for non-pd case
libinta
authored

Commits on Sep 18, 2025

add hpu p2d4
libinta
committed

Commits on Sep 24, 2025

clean up copy_kv_blocks
skaulintel
authored

Commits on Sep 27, 2025

Update requirements.txt
libinta
authored

Commits on Sep 29, 2025

pull PR 1711 and 1738 for performance improvement
libinta
committed

Commits on Oct 6, 2025

add fetch_from_cache_prompt
libinta
committed

Commits on Oct 8, 2025

Commits on Oct 9, 2025