ViPullStatistics very slow on HostSystem.runtime

[vmwiz]

I'm getting very slow statistics gathering while the following requests are executed:

REQUEST: $VAR1 = '<?xml version="1.0" encoding="UTF-8"?>
   <soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
                     xmlns:xsd="http://www.w3.org/2001/XMLSchema"
                     xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
   <soapenv:Body>
<RetrieveProperties xmlns="urn:vim25"><_this type="PropertyCollector">propertyCollector</_this>
<specSet><propSet><type>HostSystem</type><all>0</all><pathSet>runtime</pathSet></propSet><objectSet><obj type="HostSystem">host-12052</obj>
</objectSet></specSet></RetrieveProperties></soapenv:Body></soapenv:Envelope>
';

The whole ViPullStatistics take ~20min to complete on a single vcenter (two clusters, 4 esx per cluster, 200 VMs in total).

Any idea how to improve the execution time?

[rschitz]

could you send us the /var/log/sexigraf/ViPullStatistics.log file?

[vmwiz]

Here's an excerpt of the logs

[2016/03/09 21:30:02] /root/ViPullStatistics.pl line96 - [INFO] vCenter vcenter01 session file saved
[2016/03/09 21:30:03] /root/ViPullStatistics.pl line144 - [INFO] Processing vCenter vcenter01 datacenters
[2016/03/09 21:30:03] /root/ViPullStatistics.pl line151 - [INFO] Processing vCenter vcenter01 clusters in datacenter dc01
[2016/03/09 21:30:07] /root/ViPullStatistics.pl line365 - [INFO] Processing vCenter vcenter01 standalone hosts in datacenter dc01
[2016/03/09 21:30:07] /root/ViPullStatistics.pl line151 - [INFO] Processing vCenter vcenter01 clusters in datacenter dc02
[2016/03/09 21:54:32] /root/ViPullStatistics.pl line365 - [INFO] Processing vCenter vcenter01 standalone hosts in datacenter dc02
[2016/03/09 21:54:32] /root/ViPullStatistics.pl line476 - [INFO] End processing vCenter vcenter01

I'm also attaching part of the logfile when the job timeout and gives SOAP errors
ViPullStatistics.txt

[vmwiz]

My bad, the problem was caused by LWP I downgraded the module from 6.15 to 5.837 (same version as on the appliance) and stats are now gathered in 30 sec :)