Repository navigation
Browser Memory Limit #1077
Browser Memory Limit
#1077
|
Hi, I mean since we might run multiple browsers (e.g. 8), it will give us a limit of 16 GB, and probably running server has 16 GB, so that's why you might have chosen 1.5 GB? Thanks |
Answered by
vringar
Dec 8, 2023
Replies: 1 comment
|
Iirc this was the ratio between cores and memory that we had in our servers, so 1,5GB of RAM/core. |
0 replies
Answer selected by
MohammadMahdiJavid
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Iirc this was the ratio between cores and memory that we had in our servers, so 1,5GB of RAM/core.
But is has been quite a while since I ran large scale crawls so there might be a different optimal ratio.
More ram per browser doesn't have any downsides that I'm aware of. More ram > the profile can grow bigger> fewer restarts due to memory watchdog > better crawl speed