Skip to content

TheTatane/llm_benchmark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

The goal of this benchmark is to compare:

  • RTX 5090 and Radeon Pro 9700
  • ROCm and Vulkan

Benchmarks will be done on Ollama and vLLM

Theses benchmarks are provided for informational purposes only and may not be accurate for other configurations.

About

Benchmark of LLM using Ollama or vLLM on AMD and Nvidia GPU

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages