Hello, I just installed nav system from source, so I have 4.0b5 up and running. I tried so far only few Cisco boxes of these two types - Catalyst 6504 - Catalyst 4506 Even on these I'm unable to obtain software version, modules etc. It shows serial numbers and ports (but not switch ports or router ports) I tried to find out, how to troubhleshoot the proces, but nothing was usefull. Can you please advise me, what can I do to make it work? brgds Mat
On Wed, 19 Mar 2014 17:13:14 +0100 (CET) <martin.jaburek@cah.cz> wrote:
Hello, I just installed nav system from source, so I have 4.0b5 up and running.
I tried so far only few Cisco boxes of these two types - Catalyst 6504 - Catalyst 4506
Even on these I'm unable to obtain software version, modules etc. It shows serial numbers and ports (but not switch ports or router ports)
I tried to find out, how to troubhleshoot the proces, but nothing was usefull.
Can you please advise me, what can I do to make it work?
Well, NAV shouldn't have a problem with the abovementioned device types. Some questions: - What category device did you add them as? - If you browse the devices in NAV, what does their job status look like, are all the jobs greenlighted? - Are there any recent alerts listed when browsing the devices? - Are there error messages related to these devices in `ipdevpoll.log`? -- Morten Brekkevold UNINETT
Hi, See attached picture of 3750-recognized device and 2960G-unrecognized. There are actually some problems in ipdevpoll.log, but I think it should be related to graphite not listening on UDP(1minstats and 5minstats). I forget to start the carbon cache. After starting carbon there are no errors (half an hour) The jobs are all green. As it does show no switchports, the ports tab is empty. Any ideas? brgds Mat -----Original Message----- From: Morten Brekkevold [mailto:morten.brekkevold@uninett.no] Sent: Thursday, March 20, 2014 12:07 PM To: JABUREK Martin Cc: nav-users@uninett.no Subject: Re: New to nav system On Wed, 19 Mar 2014 17:13:14 +0100 (CET) <martin.jaburek@cah.cz> wrote:
Hello, I just installed nav system from source, so I have 4.0b5 up and running.
I tried so far only few Cisco boxes of these two types - Catalyst 6504 - Catalyst 4506
Even on these I'm unable to obtain software version, modules etc. It shows serial numbers and ports (but not switch ports or router ports)
I tried to find out, how to troubhleshoot the proces, but nothing was usefull.
Can you please advise me, what can I do to make it work?
Well, NAV shouldn't have a problem with the abovementioned device types. Some questions: - What category device did you add them as? - If you browse the devices in NAV, what does their job status look like, are all the jobs greenlighted? - Are there any recent alerts listed when browsing the devices? - Are there error messages related to these devices in `ipdevpoll.log`? -- Morten Brekkevold UNINETT
On Thu, 20 Mar 2014 15:26:18 +0000 "Martin.Jaburek@cah.cz" <Martin.Jaburek@cah.cz> wrote:
See attached picture of 3750-recognized device and 2960G-unrecognized.
There are actually some problems in ipdevpoll.log, but I think it should be related to graphite not listening on UDP(1minstats and 5minstats). I forget to start the carbon cache. After starting carbon there are no errors (half an hour)
The jobs are all green.
As it does show no switchports, the ports tab is empty.
Any ideas?
Yes, you need to check your `ipdevpoll.log` more closely. For some reason, the inventory job has not run at all (neither success or failure has been logged in your jobs listing) for the devices you posted in your screenshots, but other jobs have run. The inventory job will, as the name implies, collect all kinds of inventory information about your devices - switch- and router ports, modules, serial numbers, etc. Any reference to the inventory job in the logs would be interesting. Also, the default log level is a bit high; you would to well to lower it somewhat: Add a new file called `logging.conf` to your NAV config directory and add the following two lines, then restart ipdevpoll: [levels] nav = INFO -- Morten Brekkevold UNINETT
Hi, Finally the problem solved itself - I had to restart nav services, (Maybe it was due to previous problems with connectivity to carbon backend). Now I have all the information needed from supported devices (3750 and 6504) My ipdevpoll.log now only displays these errors: 2014-03-21 15:55:11,057 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.875) 2014-03-21 15:55:11,084 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.875) 2014-03-21 15:55:11,086 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.874) 2014-03-21 15:55:11,087 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.874) 2014-03-21 15:55:11,088 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.696) These are also cisco so I expect that it should be only needed to insert some mapping to database? I would be also interested to insert some Juniper and checkpoint firewalls (because of MAC/IP mapping) is it possible? Thank you so far Mat -----Original Message----- From: Morten Brekkevold [mailto:morten.brekkevold@uninett.no] Sent: Friday, March 21, 2014 3:09 PM To: JABUREK Martin Cc: nav-users@uninett.no Subject: Re: New to nav system On Thu, 20 Mar 2014 15:26:18 +0000 "Martin.Jaburek@cah.cz" <Martin.Jaburek@cah.cz> wrote:
See attached picture of 3750-recognized device and 2960G-unrecognized.
There are actually some problems in ipdevpoll.log, but I think it should be related to graphite not listening on UDP(1minstats and 5minstats). I forget to start the carbon cache. After starting carbon there are no errors (half an hour)
The jobs are all green.
As it does show no switchports, the ports tab is empty.
Any ideas?
Yes, you need to check your `ipdevpoll.log` more closely. For some reason, the inventory job has not run at all (neither success or failure has been logged in your jobs listing) for the devices you posted in your screenshots, but other jobs have run. The inventory job will, as the name implies, collect all kinds of inventory information about your devices - switch- and router ports, modules, serial numbers, etc. Any reference to the inventory job in the logs would be interesting. Also, the default log level is a bit high; you would to well to lower it somewhat: Add a new file called `logging.conf` to your NAV config directory and add the following two lines, then restart ipdevpoll: [levels] nav = INFO -- Morten Brekkevold UNINETT
On Fri, 21 Mar 2014 15:44:38 +0000 "Martin.Jaburek@cah.cz" <Martin.Jaburek@cah.cz> wrote:
Finally the problem solved itself - I had to restart nav services, (Maybe it was due to previous problems with connectivity to carbon backend).
Yes, it could be. We haven't tested enough how our code handles a missing Graphite backend.
Now I have all the information needed from supported devices (3750 and 6504)
My ipdevpoll.log now only displays these errors:
2014-03-21 15:55:11,057 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.875)
These aren't errors, they are warnings. They should probably be INFO level messages, though. These are just to assert that the device appears to have been replaced with another type of device; you will see this on the first run for all devices, since their type is, by definition, unknown before we query them.
These are also cisco so I expect that it should be only needed to insert some mapping to database?
The message says the new type is unknown, as the 1.3.6.1.4.1.9.1.875 sysObjectID was not previously registered in your database. ipdevpoll will have created a device type for 1.3.6.1.4.1.9.1.875, used the device's sysDescr value as a type description, and attached it to the 'unknown' vendor. You can find the generated 1.3.6.1.4.1.9.1.875 type in the SeedDB "Type" tab. Change the vendor Cisco, and update the description and typename as you please.
I would be also interested to insert some Juniper and checkpoint firewalls (because of MAC/IP mapping) is it possible?
As long as they provide ARP and/or ND mappings in the IETF-standard IP-MIB, you should be fine (RFC 4293, alternately the obsoleted RFC 2011). -- Morten Brekkevold UNINETT
Hi, I modified the unknown OIDs and now I am able to collect information from boxes. Now I have these issues: - graphs showing throughput - there are only empty graphs on port info tabs. I think that backend should be fine, because I can see some graphs (for example SystemMetrics/CPU are all fine) Maybe it is related to a fetch error from statistics pane. (see screenshot) - I am getting these logs from ipdevpoll.log: 2014-03-23 22:59:09,943 [WARNING plugins.dnsname.dnsname] [inventory IP1] Box dnsname has changed from u 'IP1' to 'DNS1' 2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory IP2] Box dnsname has changed from u 'IP2' to 'DNS2' When I edit device it gets the right name, but it keep reporting only IP. This started when I added unknown device and now I corrected it. So I have other devices with right DNS names as sysnames. - how can I change the look of graphs? I'm getting black backgrounded graphs which are really ugly on white background. The work done is really amazing. I look forward when I have it finally fully up. Mat -----Original Message----- From: Morten Brekkevold [mailto:morten.brekkevold@uninett.no] Sent: Monday, March 24, 2014 9:22 AM To: JABUREK Martin Cc: nav-users@uninett.no Subject: Re: New to nav system On Fri, 21 Mar 2014 15:44:38 +0000 "Martin.Jaburek@cah.cz" <Martin.Jaburek@cah.cz> wrote:
Finally the problem solved itself - I had to restart nav services, (Maybe it was due to previous problems with connectivity to carbon backend).
Yes, it could be. We haven't tested enough how our code handles a missing Graphite backend.
Now I have all the information needed from supported devices (3750 and 6504)
My ipdevpoll.log now only displays these errors:
2014-03-21 15:55:11,057 [WARNING plugins.typeoid.typeoid] [inventory xxx] Netbox has changed type from unknown to unknown (sysObjectID 1.3.6.1.4.1.9.1.875)
These aren't errors, they are warnings. They should probably be INFO level messages, though. These are just to assert that the device appears to have been replaced with another type of device; you will see this on the first run for all devices, since their type is, by definition, unknown before we query them.
These are also cisco so I expect that it should be only needed to insert some mapping to database?
The message says the new type is unknown, as the 1.3.6.1.4.1.9.1.875 sysObjectID was not previously registered in your database. ipdevpoll will have created a device type for 1.3.6.1.4.1.9.1.875, used the device's sysDescr value as a type description, and attached it to the 'unknown' vendor. You can find the generated 1.3.6.1.4.1.9.1.875 type in the SeedDB "Type" tab. Change the vendor Cisco, and update the description and typename as you please.
I would be also interested to insert some Juniper and checkpoint firewalls (because of MAC/IP mapping) is it possible?
As long as they provide ARP and/or ND mappings in the IETF-standard IP-MIB, you should be fine (RFC 4293, alternately the obsoleted RFC 2011). -- Morten Brekkevold UNINETT
On 03/24/2014 10:51 AM, Martin.Jaburek@cah.cz wrote:
I modified the unknown OIDs and now I am able to collect information from boxes.
Great!
Now I have these issues: - graphs showing throughput - there are only empty graphs on port info tabs. I think that backend should be fine, because I can see some graphs (for example SystemMetrics/CPU are all fine) Maybe it is related to a fetch error from statistics pane. (see screenshot)
See below.
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory IP2] Box dnsname has changed from u 'IP2' to 'DNS2' When I edit device it gets the right name, but it keep reporting only IP. This started when I added unknown device and now I corrected it. So I have other devices with right DNS names as sysnames.
We think this may be related to this bug: https://bugs.launchpad.net/nav/+bug/1292513 . This has been fixed and will be part of the next release. The port statistics are probably being stored using the IP-address not the DNS name of the IP Device. You can verify this by browsing the Graphite Web interface and see which nodes are present under nav.devices. Try restarting ipdevpoll. This may fix your current problem.
- how can I change the look of graphs? I'm getting black backgrounded graphs which are really ugly on white background.
In the graphite configuration directory (perhaps /opt/graphite/conf), copy the file graphTemplates.conf.example to graphTemplates.conf. Then edit it and add the following: [nav] background = white foreground = black
The work done is really amazing. I look forward when I have it finally fully up.
Thank you! :) -- John-Magne Bredal UNINETT AS
Hi, Regarding the bug - I'm using 4.0b5 right now. Is the patch also applicable for this version? Restarting ipdevpoll does help, but not for the first time. I had to restart it repeatadly (I did it due to other errors and then I mention, that it corrected it) Regarding the graphs I think there is some problem with graphing/storing data? I attached three pictures: Ten correct.png ... correct graph from rrdtools Ten graphite.png ... graph collected from graphite web interface Ten nav.png ... graph collected from nav interface It seems to me, that graphite stores too few datapoints, I tried to dump raw data and I get this: nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:16:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:17:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:18:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:19:00,6302589367015099.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:20:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:21:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:22:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:23:00,6302603784021890.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:24:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:25:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:26:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:27:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:28:00,6302617817392692.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:29:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:30:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:31:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:32:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:33:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:34:00,6302631305894654.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:35:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:36:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:37:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:38:00,6302639660718015.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:39:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:40:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:41:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:42:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:43:00,6302653053594991.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:44:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:45:00, Shouldn't I set up scheme for carbon database to await only 5 min collections? It seems to me, that after applying derivative function it show nothing due to empty datapoints. Mat -----Original Message----- From: John-Magne Bredal [mailto:john.m.bredal@uninett.no] Sent: Monday, March 24, 2014 2:36 PM To: JABUREK Martin; Morten Brekkevold Cc: nav-users@uninett.no Subject: Re: New to nav system On 03/24/2014 10:51 AM, Martin.Jaburek@cah.cz wrote:
I modified the unknown OIDs and now I am able to collect information from boxes.
Great!
Now I have these issues: - graphs showing throughput - there are only empty graphs on port info tabs. I think that backend should be fine, because I can see some graphs (for example SystemMetrics/CPU are all fine) Maybe it is related to a fetch error from statistics pane. (see screenshot)
See below.
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory IP2] Box dnsname has changed from u 'IP2' to 'DNS2' When I edit device it gets the right name, but it keep reporting only IP. This started when I added unknown device and now I corrected it. So I have other devices with right DNS names as sysnames.
We think this may be related to this bug: https://bugs.launchpad.net/nav/+bug/1292513 . This has been fixed and will be part of the next release. The port statistics are probably being stored using the IP-address not the DNS name of the IP Device. You can verify this by browsing the Graphite Web interface and see which nodes are present under nav.devices. Try restarting ipdevpoll. This may fix your current problem.
- how can I change the look of graphs? I'm getting black backgrounded graphs which are really ugly on white background.
In the graphite configuration directory (perhaps /opt/graphite/conf), copy the file graphTemplates.conf.example to graphTemplates.conf. Then edit it and add the following: [nav] background = white foreground = black
The work done is really amazing. I look forward when I have it finally fully up.
Thank you! :) -- John-Magne Bredal UNINETT AS
Hi, I'm stupid. I forget to update etc/graphite/storage-schemas.conf and etc/graphite/storage-aggregation.conf. I deleted all whisper databases and hopefully it will be much better now. Mat -----Original Message----- From: JABUREK Martin Sent: Tuesday, March 25, 2014 3:55 PM To: 'John-Magne Bredal'; Morten Brekkevold Cc: nav-users@uninett.no Subject: RE: New to nav system Hi, Regarding the bug - I'm using 4.0b5 right now. Is the patch also applicable for this version? Restarting ipdevpoll does help, but not for the first time. I had to restart it repeatadly (I did it due to other errors and then I mention, that it corrected it) Regarding the graphs I think there is some problem with graphing/storing data? I attached three pictures: Ten correct.png ... correct graph from rrdtools Ten graphite.png ... graph collected from graphite web interface Ten nav.png ... graph collected from nav interface It seems to me, that graphite stores too few datapoints, I tried to dump raw data and I get this: nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:16:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:17:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:18:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:19:00,6302589367015099.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:20:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:21:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:22:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:23:00,6302603784021890.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:24:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:25:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:26:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:27:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:28:00,6302617817392692.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:29:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:30:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:31:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:32:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:33:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:34:00,6302631305894654.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:35:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:36:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:37:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:38:00,6302639660718015.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:39:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:40:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:41:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:42:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:43:00,6302653053594991.0 nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:44:00, nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:45:00, Shouldn't I set up scheme for carbon database to await only 5 min collections? It seems to me, that after applying derivative function it show nothing due to empty datapoints. Mat -----Original Message----- From: John-Magne Bredal [mailto:john.m.bredal@uninett.no] Sent: Monday, March 24, 2014 2:36 PM To: JABUREK Martin; Morten Brekkevold Cc: nav-users@uninett.no Subject: Re: New to nav system On 03/24/2014 10:51 AM, Martin.Jaburek@cah.cz wrote:
I modified the unknown OIDs and now I am able to collect information from boxes.
Great!
Now I have these issues: - graphs showing throughput - there are only empty graphs on port info tabs. I think that backend should be fine, because I can see some graphs (for example SystemMetrics/CPU are all fine) Maybe it is related to a fetch error from statistics pane. (see screenshot)
See below.
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory IP2] Box dnsname has changed from u 'IP2' to 'DNS2' When I edit device it gets the right name, but it keep reporting only IP. This started when I added unknown device and now I corrected it. So I have other devices with right DNS names as sysnames.
We think this may be related to this bug: https://bugs.launchpad.net/nav/+bug/1292513 . This has been fixed and will be part of the next release. The port statistics are probably being stored using the IP-address not the DNS name of the IP Device. You can verify this by browsing the Graphite Web interface and see which nodes are present under nav.devices. Try restarting ipdevpoll. This may fix your current problem.
- how can I change the look of graphs? I'm getting black backgrounded graphs which are really ugly on white background.
In the graphite configuration directory (perhaps /opt/graphite/conf), copy the file graphTemplates.conf.example to graphTemplates.conf. Then edit it and add the following: [nav] background = white foreground = black
The work done is really amazing. I look forward when I have it finally fully up.
Thank you! :) -- John-Magne Bredal UNINETT AS
On Tue, 25 Mar 2014 15:05:27 +0000 "Martin.Jaburek@cah.cz" <Martin.Jaburek@cah.cz> wrote:
I'm stupid. I forget to update etc/graphite/storage-schemas.conf and etc/graphite/storage-aggregation.conf.
I deleted all whisper databases and hopefully it will be much better now.
Yes, the storage schemas are quite important for good results :-) -- Morten Brekkevold UNINETT
participants (4)
-
John-Magne Bredal -
Martin.Jaburek＠cah.cz -
martin.jaburek＠cah.cz
-
Morten Brekkevold