Jiang-Jia-Jun 92c2cfa2e7 Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

..

build_wheel_pipeline_cu123.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

convert_ep_state_from_ep8.py

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

convert_ep_state_from_ep8.sh

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

convert_ep_state_from_tp8.py

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

convert_ep_state_from_tp8.sh

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

convert_ep_to_safetensor.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

extract_mtp_weight_from_safetensor.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

get_rdma_nics.sh

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

merge_cache_scale.py

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

run_prediction_ep_decoder_multi_node_perf.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

run_prediction_ep_decoder_multi_node.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

run_prediction_ep_decoder_single_node_perf.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

run_prediction_ep_prefill_perf.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

run_unittest.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

tune_cublaslt_int8_gemm.py

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

tune_cutlass_fp8_gemm.py

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

tune_scaled_gemm_f8_i4_f16.py

[LLM] First commit the llm deployment code

2025-06-16 00:04:48 +08:00

vit_model_split.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

vit_model_split.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00