|Don't ask to ask, just ask|
Simple Perl NMS Polling Engineby mmoorreett (Acolyte)
|on Jun 27, 2020 at 02:41 UTC||Need Help??|
mmoorreett has asked for the wisdom of the Perl Monks concerning the following question:
I'm looking for some high level/framework advice on how to best develop a solution to build a *simple* network polling engine. I'm not looking to re-invent the wheel or want to implement a full blown NMS, just build something thats light weight and fast/efficient to plug a gap we have at the moment. Since being tasked with this, I have researched various frameworks I have not used before for multitasking/parallelism. E.g, threads, forks, event loop frameworks, such as POE, AnyEvent, IO:Async. I've used Perl periodically for various applications but not for something like this. I've started playing with the mentioned modules/frameworks and developed some samples, but I am unsure what is the best one. At a high level I need to:
Periodically query an external data source for device data
ICMP Ping poll on a configurable schedule (5 minute), potentially a couple of thousand devices, in parallel, return results for further processing
Separate to ICMP poll, collect SNMP data on a configurable schedule (5 minute), potentially a couple of thousand devices, in parallel, return results for further processing
Each poll thread/cycle needs a "TTL", that is, each poll thread must complete by X seconds, (not talking about an ICMP/SNMP timeout)
Needs to run on Windows and Nix perl.
Not sure what the best approach to take is. Having looked at a couple of open source NMS solutions i found built in perl, threads/forks were used, but these are over a decade old so I'm not sure if the event loop frameworks were considered or suitable.
Looking to get some guidance on the most appropriate path to take so I don't need to re-invent the wheel, again :).
Thanks in advance.