Files
myhloli 0b05dff74f perf(inference): adjust batch ratio for high GPU memory
- Increase batch ratio to 8 for GPU memory >=16GB
- Improve inference performance on systems with higher GPU memory
2025-03-03 17:30:02 +08:00
..
2025-02-24 10:56:07 +08:00
2024-03-01 16:07:51 +08:00