[Date Prev] [Date Index] [Date Next] [Thread Prev] [Thread Index] [Thread Next]

RE: Question about limiting rate of conserver output

ronaldo.mercado ronaldo.mercado@diamond.ac.uk
Fri, 16 Jan 2015 09:15:09 GMT


Hi John, 

Thanks for replying.

> So are you wanting to discard output and just write every third line or
> something?  Just slowing down the output isn't going to address the
> problem here, which is too small space for logs.

The underlying problem is the service writing out too many errors. I am the guy in charge of fixing it. 
A sustained message storm broke past a few protection mechanisms of log rotating and disk space monitoring over several days finally caused problems in other systems. 
Limiting the rate could offer additional protection.

> How about using the 'logfilemax' parameter from conserver.cf (see the man
> page) and then have a cronjob which copies old log files over the network
> to another system with more disk space.

Effectively I want "logfilemax" that throws away messages in case of a sustained message storm. 
I prefer throwing away messages because they tend to be repeated anyway. The system will be fixed eventually and the service restarted. 
Logging can continue from where it left off.

There is a cronjob rotating log files at midnight already. I did not realise there are similar facilities in conserver.

Ronaldo

-- 
This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. 
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom