Forums

> The limitations of GPU memory and model size as well as the policy of LLM models

Dear organizers,

Does this competation impose limitations on GPU memory usage and model size? Furthermore, does this competation restrict the utilization of large multi-modality models (LLM), which might occupy a significant GPU memory and have a large model size, but still meet the runtime requirement when sampling sparse video frames?