...
A missing upgrade to the DB backend of Sensu started causing misbehavior in our monitoring backend and agents and drove us to investigate the issue on several VMs, comparable to our Sensu server.
To solve this issue a Puppet module upgrade an upgrade of the puppet module was required, with the problem being, this module is shared among several applications and the upgrade procedure involves either Sensu, Poller, and Brian.
Brian is using its implementation of Sensu, and I had to verify if it was showing the same issue and if the new puppet module would have impacted Sensu. The effort that was put in to solve the issue was huge (the new puppet module had several differences and the perimeter firewall was denying access to Sensu API) and while attempting to fix the issue on several servers, InfluxDB received a major upgrade (from version 1.8 to version 2.0).
...
Package pinning is always a good practice for our core applications.
The Influx DB packages package is now pinned everywhere now and and further upgrades must be deliberately applied, by changing the version number in puppet.
Further investigation on other packages will be conducted with the action described in the following ticket:
Jira | ||||||
---|---|---|---|---|---|---|
|