Yes, it was the bridge plugin. It seems to time out in about 4 seconds... Here's some debug output:
2011-11-14 21:50:01,476 [INFO plugins.oidprofiler.oidprofiler] [profiling sw01-3750.] profile update: add 1 / del 0
2011-11-14 21:50:01,477 [DEBUG jobs.jobhandler.queue] [profiling sw01-3750.] [(59575120,
NetboxSnmpOid(netbox=Netbox(id=17, sysname=u'sw01-3750.', up_to_date=True), frequency=3600)),
Netbox(id=17, sysname=u'sw01-3750.', up_to_date=True))]
2011-11-14 21:50:01,488 [DEBUG jobs.jobhandler.queue] [profiling sw01-3750.] containers after save: ContainerRepository({<class 'nav.ipdevpoll.shadows.Netb
ox'>: {None: Netbox(id=17, sysname=u'sw01-3750.', up_to_date=True)}, <class 'nav.ipdevpoll.shadows.NetboxSnmpOid'>: {33: NetboxSnmpOid(id=2718L, netbox=Net
box(id=17, sysname=u'sw01-3750.', up_to_date=True), frequency=3600)}})
2011-11-14 21:50:01,489 [DEBUG jobs.jobhandler] [profiling sw01-3750.] Storing to database complete (11.542 ms)
2011-11-14 21:50:01,489 [DEBUG jobs.jobhandler] [profiling sw01-3750.] Running cleanup routines for 2 classes ([<class 'nav.ipdevpoll.shadows.Netbox'>, <cl
ass 'nav.ipdevpoll.shadows.NetboxSnmpOid'>])
2011-11-14 21:50:01,489 [INFO jobs.jobhandler] [profiling sw01-3750.] Job profiling for sw01-3750. done.
2011-11-14 21:50:01,489 [DEBUG jobs.jobhandler.timings] [profiling sw01-3750.] Job 'profiling' timings for sw01-3750.:
2011-11-14 21:50:01,490 [INFO schedule.netboxjobscheduler] [profiling sw01-3750.] Next 'profiling' job for sw01-3750. will be in 275 seconds
(2011-11-14 21:54:37.156020)
2011-11-14 21:54:37,158 [DEBUG jobs.jobhandler] [profiling sw01-3750.] Job 'profiling' initialized with plugins: ['oidprofiler']
2011-11-14 21:54:37,159 [DEBUG jobs.jobhandler] [profiling sw01-3750.] AgentProxy created for sw01-3750.: <nav.ipdevpoll.snmp.pynetsnmp.Agen
tProxy instance at 0x20705f0>
2011-11-14 21:54:37,159 [DEBUG jobs.jobhandler] [profiling sw01-3750.] Plugin oidprofiler wouldn't handle sw01-3750.
2011-11-14 21:54:37,159 [DEBUG jobs.jobhandler] [profiling sw01-3750.] No plugins for this job
2011-11-14 21:54:37,159 [INFO schedule.netboxjobscheduler] [profiling sw01-3750.] Next 'profiling' job for sw01-3750. will be in 299 seconds
(2011-11-14 21:59:37.158798)
2011-11-14 21:57:46,567 [DEBUG plugins.bridge.bridge] [inventory sw01-3750.] Collecting bridge data
2011-11-14 21:57:46,843 [DEBUG plugins.bridge.bridge] [inventory sw01-3750.] Alternate BRIDGE-MIB instances: [(...SNMP COMMUNITIES AND VLANS...)]
2011-11-14 21:57:46,844 [DEBUG plugins.bridge.bridge] [inventory sw01-3750.] Querying the following alternative instances: ['vlan50', 'vlan132', 'vlan52',
'vlan150', 'vlan30', 'vlan801', 'vlan32', 'vlan998', 'vlan39', 'vlan61', 'vlan41', 'vlan99', 'vlan1', 'vlan127', 'vlan1004', 'vlan130', 'vlan1003', 'vlan42', 'vlan11', 'v
lan48', 'Catalyst 29xx/35xx/37xx', 'vlan51', 'vlan141', 'vlan20', 'vlan400', 'vlan31', 'vlan997', 'vlan33', 'vlan999', 'vlan40', 'vlan98', 'vlan126', 'vlan1002', 'vlan128
', 'vlan100', 'vlan1005', 'vlan131', 'vlan10', 'vlan43', 'vlan49']
2011-11-14 21:57:46,844 [DEBUG plugins.bridge.bridge] [inventory sw01-3750.] Now querying None
2011-11-14 21:57:50,150 [DEBUG plugins.bridge.bridge] [inventory sw01-3750.] Now querying 'vlan50'
2011-11-14 21:57:54,441 [ERROR jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' for sw01-3750. aborted: User timeout caused connection failure.
2011-11-15 17:31:43,387 [ERROR jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' for sw01-3750. aborted: User timeout caused connection failure.
2011-11-15 17:37:00,211 [ERROR jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' for sw01-3750. aborted: User timeout caused connection failure.
2011-11-15 17:45:10,271 [ERROR jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' for sw01-3750. aborted: User timeout caused connection failure.
2011-11-15 17:50:55,175 [ERROR jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' for sw01-3750. aborted: User timeout caused connection failure.
2011-11-15 17:51:59,675 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' initialized with plugins: ['dnsname', 'typeoid', 'modules', 'bridge', 'interfaces', 'dot1q', 'ciscovlan', 'extremevlan', 'prefix', 'lastupdated']
2011-11-15 17:51:59,676 [DEBUG jobs.jobhandler] [inventory sw01-3750.] AgentProxy created for sw01-3750.: <nav.ipdevpoll.snmp.pynetsnmp.AgentProxy instance at 0x213df38>
2011-11-15 17:51:59,676 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Plugins to call: DnsName,TypeOid,Modules,Bridge,Interfaces,Dot1q,CiscoVlan,ExtremeVlan,Prefix,LastUpdated
2011-11-15 17:51:59,676 [INFO jobs.jobhandler] [inventory sw01-3750.] Starting job 'inventory' for sw01-3750.
2011-11-15 17:51:59,676 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Now calling plugin: nav.ipdevpoll.plugins.dnsname.DnsName(u'sw01-3750.')
2011-11-15 17:51:59,720 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Now calling plugin: nav.ipdevpoll.plugins.typeoid.TypeOid(u'sw01-3750.')
2011-11-15 17:51:59,754 [DEBUG jobs.jobhandler] [profiling sw01-3750.] Job 'profiling' initialized with plugins: ['oidprofiler']
2011-11-15 17:51:59,754 [DEBUG jobs.jobhandler] [profiling sw01-3750.] AgentProxy created for sw01-3750.: <nav.ipdevpoll.snmp.pynetsnmp.AgentProxy instance at 0x213f830>
2011-11-15 17:51:59,754 [DEBUG jobs.jobhandler] [profiling sw01-3750.] Plugin oidprofiler wouldn't handle sw01-3750.
2011-11-15 17:51:59,755 [DEBUG jobs.jobhandler] [profiling sw01-3750.] No plugins for this job
2011-11-15 17:51:59,789 [DEBUG jobs.jobhandler] [logging sw01-3750.] Job 'logging' initialized with plugins: ['arp']
2011-11-15 17:51:59,790 [DEBUG jobs.jobhandler] [logging sw01-3750.] AgentProxy created for sw01-3750.: <nav.ipdevpoll.snmp.pynetsnmp.AgentProxy instance at 0x22ab6c8>
2011-11-15 17:51:59,790 [DEBUG jobs.jobhandler] [logging sw01-3750.] Plugins to call: Arp
2011-11-15 17:51:59,790 [INFO jobs.jobhandler] [logging sw01-3750.] Starting job 'logging' for sw01-3750.
2011-11-15 17:51:59,790 [DEBUG jobs.jobhandler] [logging sw01-3750.] Now calling plugin: nav.ipdevpoll.plugins.arp.Arp(u'sw01-3750.')
2011-11-15 17:51:59,968 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Now calling plugin: nav.ipdevpoll.plugins.modules.Modules(u'sw01-3750.')
2011-11-15 17:52:01,613 [DEBUG jobs.jobhandler.queue] [logging sw01-3750.] [(36345616, Netbox(id=17, sysname=u'sw01-3750.'))]
2011-11-15 17:52:01,618 [DEBUG jobs.jobhandler.queue] [logging sw01-3750.] containers after save: ContainerRepository({<class 'nav.ipdevpoll.shadows.Netbox'>: {None: Netbox(id=17, sysname=u'sw01-3750.')}})
2011-11-15 17:52:01,618 [DEBUG jobs.jobhandler] [logging sw01-3750.] Storing to database complete (4.845 ms)
2011-11-15 17:52:01,618 [DEBUG jobs.jobhandler] [logging sw01-3750.] Running cleanup routines for 1 classes ([<class 'nav.ipdevpoll.shadows.Netbox'>])
2011-11-15 17:52:01,698 [INFO jobs.jobhandler] [logging sw01-3750.] Job logging for sw01-3750. done.
2011-11-15 17:52:01,698 [DEBUG jobs.jobhandler.timings] [logging sw01-3750.] Job 'logging' timings for sw01-3750.:
2011-11-15 17:52:05,384 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Now calling plugin: nav.ipdevpoll.plugins.bridge.Bridge(u'sw01-3750.')
2011-11-15 17:52:12,867 [DEBUG jobs.jobhandler] [inventory sw01-3750.] Plugin nav.ipdevpoll.plugins.bridge.Bridge(u'sw01-3750.') reported a timeout
2011-11-15 17:52:12,867 [DEBUG jobs.jobhandler.timings] [inventory sw01-3750.] Job 'inventory' timings for sw01-3750.:
2011-11-15 17:52:12,868 [ERROR jobs.jobhandler] [inventory sw01-3750.] Job 'inventory' for sw01-3750. aborted: User timeout caused connection failure.
SNMP is configured properly on the 3750. What do you think?
On Mon, 14 Nov 2011 11:40:45 -0600 Greg Cooper <gwc2004@gmail.com> wrote:Glad to hear that :-)
> I'm having the same issue. I'm a consultant, and I have several customers
> who want a great network management/monitoring tool. I recommend NAV to
> them, since I've used it for a long time.
This is an SNMP timeout. It means your device may be too slow to
> However, they almost all have 3750 stacks. At this one particular
> customer, I'm not getting really any inventory info from ipdevpoll when it
> talks to a 3750 stack. I see:
>
> 2011-11-14 18:31:10,711 [ERROR jobs.jobhandler] [inventory sw01-3750] Job
> 'inventory' for evv-sw01-3750.brake.local aborted: User timeout caused
> connection failure.
answer some SNMP requests, or it didn't send an answer at all.
Now, I've been gone a while, but IIRC, there may be some issue with
timeouts in the bridge plugin when working with Cisco devices (or when
it thinks it's working with Cisco devices), so it would be helpful if
you configured debug logging so we could see which plugin reported the
timeout.
If you don't have the logging.conf file (not logger.conf) in your NAV
config directory, please add it and insert the following two lines:
[levels]
nav.ipdevpoll.jobs = DEBUG
Then restart ipdevpoll.
--
Morten Brekkevold
UNINETT