Node going in a infinite loop every x hours

[Edwin Veldhuizen 0]

Hi all,

Not sure if this is the right place, but anyway.

I was running a node on a 4GB 240GB 2x2.4GHz Ubuntu 18.04 VPS, but every +/- 1 hour it was jumping to 99% memory and then restarting the node after a few minutes:

After I upped the ram to 16GB, just to check it out, and now it seemed to take 6 hours until the same happend:

Is this normal?

[Edwin Veldhuizen 0]

Seems to have been resolved after the changes below and when the sync was done.

I noticed the syslog was getting massive, so in

nano /etc/systemd/system/elrond-node-%INDEX%.service

changed

-log-level *:DEBUG

to

-log-level *:INFO

 

 

Also, just in case I want to set it back to `*:DEBUG` the rotation of the syslog can use some improvements on a clean install:

nano /etc/logrotate.d/rsyslog

Add `maxsize 1G` in both blocks:

/var/log/syslog
{
        rotate 7
        daily
        maxsize 1G
        missingok
        notifempty
        delaycompress
        compress
        postrotate
                /usr/lib/rsyslog/rsyslog-rotate
        endscript
}

/var/log/mail.info
/var/log/mail.warn
/var/log/mail.err
/var/log/mail.log
/var/log/daemon.log
/var/log/kern.log
/var/log/auth.log
/var/log/user.log
/var/log/lpr.log
/var/log/cron.log
/var/log/debug
/var/log/messages
{
        rotate 4
        weekly
        maxsize 1G
        missingok
        notifempty
        compress
        delaycompress
        sharedscripts
        postrotate
                /usr/lib/rsyslog/rsyslog-rotate
        endscript
}

 

[Marius Grigoras 19]

On 4/5/2021 at 11:21 AM, Edwin Veldhuizen said:

Seems to have been resolved after the changes below and when the sync was done.

I noticed the syslog was getting massive, so in

nano /etc/systemd/system/elrond-node-%INDEX%.service

changed

-log-level *:DEBUG

to

-log-level *:INFO

 

 

Also, just in case I want to set it back to `*:DEBUG` the rotation of the syslog can use some improvements on a clean install:

nano /etc/logrotate.d/rsyslog

Add `maxsize 1G` in both blocks:

/var/log/syslog
{
        rotate 7
        daily
        maxsize 1G
        missingok
        notifempty
        delaycompress
        compress
        postrotate
                /usr/lib/rsyslog/rsyslog-rotate
        endscript
}

/var/log/mail.info
/var/log/mail.warn
/var/log/mail.err
/var/log/mail.log
/var/log/daemon.log
/var/log/kern.log
/var/log/auth.log
/var/log/user.log
/var/log/lpr.log
/var/log/cron.log
/var/log/debug
/var/log/messages
{
        rotate 4
        weekly
        maxsize 1G
        missingok
        notifempty
        compress
        delaycompress
        sharedscripts
        postrotate
                /usr/lib/rsyslog/rsyslog-rotate
        endscript
}

 

Hi Edwin,

Please join our telegram Validators community group [1] to discuss more around your setup and possible problems (if any).
We're a pretty big community very willing to help.

Thank you,

Marius

[1] https://t.me/ElrondValidators