resources needed

#22
by himanshuyadav62 - opened

how much minimum ram is needed to run this model , on cpu

Hi @himanshuyadav62 ,

Running the Gemma-2-2B model on a CPU typically requires more system RAM than running it on a GPU due to the lack of hardware optimizations that GPUs offer. In a CPU environment, the minimum system RAM required is around 12.7 GB, as demonstrated in Google Colab with a CPU runtime. However, it's advisable to have more RAM to ensure smooth performance, especially when working with larger models or during intensive tasks.

Thank you.

•
This comment has been hidden

Sign up or log in to comment