Symantec Traffic Shaper (STS) 6.0.x spontaneously reboots when configured with an improperly set static route

Article:TECH146073  |  Created: 2010-12-13  |  Updated: 2012-04-17  |  Article URL http://www.symantec.com/docs/TECH146073
Article Type
Technical Solution

Product(s)

Issue



The Symantec Traffic Shaper (STS)  6.0.x spontaneously restarts the operating system.


Error



  • The boot.log file contains the following log entries which indicate that a restart occurred:
    2010 Oct 19 00:42:57 (notice) syslog-ng: syslog-ng startup succeeded
    2010 Oct 19 00:42:58 (notice) asrconfig: ASR asrconfig succeeded
    2010 Oct 19 00:42:58 (notice) ipmi: Starting ipmi:
    2010 Oct 19 00:42:58 (notice) ipmi:
     
  • The following error appears on the serial terminal console or DRAC before the system restarts, and a full stack trace appears after it:
     BUG: unable to handle kernel NULL pointer dereference at 0000000d
    IP: [<f8b99036>] match+0x16/0x50 [ipt_emptyack]
    Oops: 0000 [#1] SMP
    last sysfs file: /sys/bus/pci/drivers/megaraid_sas/release_date
    Modules linked in: ipt_emptyack ipt_earlytalker(P) ipt_SMTPCHOP ipt_SYNACKGEN ipt_TCPCHOP del_ct ipt_ssconnlimit_ipt_POIROT n
    nn_idle pkt_chamber(P) asdb(P)
     
  • The output of df –h from the STS appliance shows that each partition has at least 20% of its disk space available.
     
  • Dell Hardware diagnostics do not detect any hardware errors or faults.

Environment



  • The STS Appliance is configured in routed mode.

Cause



A mis-configured static route causes STS appliance to send a RST packet through the wrong network interface.


Solution



To resolve this issue, please upgrade to Symantec Traffic Shaper 6.1.

If you are not able to upgrade immediately, workaround this issue by locating and correcting the misconfigured static route.

 

 


Supplemental Materials

Description

The following is a transcript of the full stack trace that appears at the terminal console during an event of this type:

BUG: unable to handle kernel NULL pointer dereference at 0000000d
IP: [<f8b99036>] match+0x16/0x50 [ipt_emptyack]
Oops: 0000 [#1] SMP
last sysfs file: /sys/bus/pci/drivers/megaraid_sas/release_date
Modules linked in: ipt_emptyack ipt_earlytalker(P) ipt_SMTPCHOP ipt_SYNACKGEN ipt_TCPCHOP del_ct ipt_ssconnlimit_ipt_POIROT n
nn_idle pkt_chamber(P) asdb(P)

Pid: 0, comm: swapper Tainted: P           (2.6.28-9.23_asrprod #1) PowerEdge R610
EIP: 0060: [<f8b99036>] EFLAGS: 00010216 CPU: 0
EIP is at match+0x16/0x50 [ipt_emptyack]
EAX: f4a130c0 EBX: f4220c20 ECX: 00000000 EDX: 40957bac
ESI: f507b7a4 EDI: 00000070 EBP: f4220c20 ESP: 40957b78
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
Process swapper (pid: 0, ti=40956000 task=408dd340 task.ti=40956000)
Stack:
 f507b814 f507b7a4 40791a1c 00000000 f4a130c0 f6720c6c 00093819 00000000
 ffffffff 40a28c0c f77f0000 f507b000 f507b858 00000000 f77f0000 f8b99320
 f507b834 00000000 00000014 40957be7 00000002 00000000 f77f0000 00000004
Call Trace:
 [<40791a1c>] ipt_do_table+0x1bc/0x300
 [<40791d40>] ipt_post_routing_hook+0x0/0x20
 [<4074bf05>] nf_iterate_0x55/0x80
 [<4074bfcc>] nf_hook_slow+0x5c/0xe0
 [<4075e170>] ip_finish_output+0x0/0x2c0
 [<4075e74c>] ip_output+0x8c/0xa0
 [<4075e170>] ip_finish_output+0x0/0x2c0
 [<4075de15>] ip_local_out+0x15/0x20
 [<40792e61>] reject_tg+0x381/0x380
 [<40791adc>] ipt_do_table+0x27c/0x300
 [<40791c10>] ipt_hook+0x0/0x20
 [<4074bf05>] nf_iterate+0x55/0x80                                                                                      ROT n
 [<4074bfcc>] nf_hook_slow+0x5c/0xe0
 [<4075b6f0>] ip_forward_finish+0x0/0x40
 [<4075ba59>] ip_forward+0x329/0x390
 [<4075b6f0>] ip_forward_finish+0x0/0x40
 [<4075a202>] ip_rcv_finish+0x122/0x360
 [<4075a904>] ip_rcv+0x204/0x290
 [<4075a0e0>] ip_rcv_finish+0x0/0x360
 [<4075a700>] ip_rcv+0x0/0x290
 [<40732799>] netif_receive_skb+0x199/0x230
 [<40628cb5>] bnx2_poll_work+0x615/0xfe0
 [<4041b26a>] read_hpet+0xa/0x10
 [<40449404>] getnstimeofday+0x44/0x100
 [<40448477>] sched_clock_cpu+0xc7/0x150
 [<407d399d>] _spin_lock_irq+0x1d/0x30
 [<40439637>] run_timer_softirq+0x167/0x1a0
 [<4062bbef>] bnx2_poll_msix+0x1f/0xf0
 [<40734a79>] net_rx_action_0x99/0x140
 [<40434cf4>] __do_softirq+0x94/0x160
 [<4046471d>] handle_IRQ_event+0x4d/0x60
 [<40434e15>] do_softirq+0x55/0x60
 [<40406462>] do_IRQ+0x52/0x90
 [<4044781c>] notifier_call_chain+0x3c/0x70
 [<40404707>] common_interrupt+0x23/0x28
 [<40595185>] acpi_idle_enter_c1+0xc0/0x10b                                                                             ROT n
 [<4070a596>] cpuidle_idle_call+0x66/0xc0
 [<4040245f>] cpu_idle+0x4f/0xa0
Code: 04 f3 c3 66 90 0f b6 42 53 c1 e8 06 f7 d0 83 e0 01 c3 8d 76 00 83 ec 08 89 1c 24 89 74 24 04 8b 88 84 00 00 00 8b
 00 00 <0f> b6 71 0d 0f b7 53 02 89 f0 c0 e8 04 89 c6 0f b6 41 0c 66 c1
EIP: [<f8b099036>] match+0x16/0x50 [ipt_emptyack] SS:ESP 0068:40957b78
Kernel panic - not syncing: Fatal exception in interrupt
------------[ cut here ]------------
WARNING: at arch/x86/kernel/smp.c:118 resched_task+0x55/0x60()
Modules linked in: ipt_emtpyack ipt_earlytalker(P) ipt_SMTPCHOP ipt_SYNACKGEN ipt_TCPCHOP del_ct ipt_ssconnlimit ipt_POI
nn_idle pkt_chamber(P) asdb(P)
Pid: 0, comm: swapper Tainted: P      D    2.6.28-9.23_asrprod #1
Call Trace:
 [<404301af>] warn_on_slowpath+0x5f/0x90
 [<40447877>] atomic_notifier_call_chain+0x17/0x20
 [<40447900>] notify_die+0x30/0x40
 [<40416fcc>] nmi_watchdog_tick+0x4c/0x1b0
 [<404043fb>] do_nmi+0x8b/0x2a0
 [<40427962>] enqueque_task_fair+0xb2/0xd0
 [<404264b5>] enqueue_task+0x25/0x80
 [<40426df5>] resched_task+0x55/0x60
 [<40429778>] try_to_wake_up+0x78/0x140
 [<404260db>] __wake_up_common+0x4b/0x80
 [<40426eb0>] complete+0x40/0x60
 [<405c1820>] ipmi_smi_msg_received+0x1d0/0x2a0
 [<405c39be>] deliver_recv_msg+0x2e/0x50
 [<405c3cd8>] smi_event_handler+0x178/0x470
 [<405c4126>] set_run_to_completion+0x36/0x40
 [<405befdc>] panic_event+0x4c/0x500
 [<40447877>] atomic_notifier_call_chain+0x17/0x20
 [<40447900>] notify_die+0x30/0x40
 [<40416fcc>] nmi_watchdog_tick+0x4c/0x1b0
 [<40404f3b>] do_nmi+0x8b/0x2a0
 [<407d3d73>] nmi_stack_correct+0x26/0x2b
 [<4056ec61>] cfb_imageblit+0x511/0x560
 [<40404f3b>] do_nmi+0x8b/0x2a0
 [<4056c652>] bit_putcs+0x392/0x630
 [<4056d6e2>] cfb_fillrect+0x142/0x300
 [<4056d129>] soft_cursor+0x189/0x1f0
 [<4041ec75>] default_spin_lock_flags+0x5/0x10
 [<407d3a03>] _spin_lock_irqsave+0x33/0x50
 [<4041b26a>] read_hpet+0x1/0x10
 [<40449404>] getnstimeofday+0x44/0x100
 [<40448477>] sched_clock_cpu+0xc7/0x150
 [<4042dad0>] scheduler_tick+0xa0/0xd0
 [<40541662>] __next_cpu+0x12/0x30
 [<404164ce>] lapic_timer_broadcast+0xe/0x10
 [<4044ca22>] ticks_do_broadcast+0x52/0x60
 [<4044caa4>] tick_do_periodic_broadcast+0x24/0x30
 [<4044cabd>] tick_handle_periodic_broadcast+0xd/0x60
 [<40464700>] handle_IRQ_event+0x30/0x60
 [<407d38a5>] _spin_lock+0x5/0x10
 [<4046656d>] handle_edge_irq+0xcd/0x110
 [<40406462>] do_IRQ+0x52/0x90
 [<405ccb10>] serial8250_console_putchar+0x0/0x30
 [<4041ec75>] default_spin_lock_flags+0x5/0x10
 [<40404707>] common_interrupt+0x23/0x28
 [<40541662>] __next_cpu+0x12/0x30
 [<4041583e>] native_send_call_func_ipi+0x4e/0x60
 [<40450509>] smp_call_function_mask+0xf9/0x1d0
 [<40415680>] stop_this_cpu+0x0/0x40
 [<40406462>] do_IRQ+0x52/0x90
 [<4040699d>] show_registers+0x7d/0x1b0
 [<4044781c>] notifier_call_chain+0x3c/0x70
 [<40447877>] atomic_notifier_call_chain+0x17/0x20
 [<4043024f>] panic+0x5f/0x110
 [<404065dc>] oops_end+0x8c/0xa0
 [<404205ed>] do_page_fault+0x67d/0xa60
 [<40730c16>] skb_dma_map+0x56/0x200
 [<4077ac66>] arp_bind_neighbour+0x56/0x90
 [<4062bd9e>] bnx2_start_xmit+0xde/0x430
 [<4041ff70>] do_page_fault+0x0/0xa60
 [<407d3cca>] error_code+0x72/0x78
 [<407500d8>] nf_conntrack_helper_unregister+0x158/0x1f0
 [<f8b99036>] match+0x16/0x50 [ipt_emptyack]
 [<40791a1c>] ipt_do_table+0x1bc/0x300
 [<40791d40>] ipt_post_routing_hook+0x0/0x20
 [<4074bf05>] nf_iterate+0x55/0x80
 [<4074bfcc>] nf_hook_slow+0x5c/0x0xe0
 [<4075e170>] ip_finish_output+0x0/0x2c0
 [<4075e74c>] ip_output+0x8c/0xa0
 [<4075e170>] ip_finish_output+0x0/0x2c0
 [<4075de15>] ip_local_out+0x15/0x20
 [<40792e61>] reject_tg+0x381/0c390
 [<40791adc>] ipt_do_table+0x27c/0x300
 [<40791c10>] ipt_hook+0x0/0x20
 [<4074bf05>] nf_iterate+0x55/0x80
 [<4074bfcc>] nf_hook_slow+0x5c/0xe0
 [<4075b6f0>] ip_forward_finish+0x0/0x40
 [<4075ba59>] ip_forward+0x329/0x390
 [<4075b6f0>] ip_forward_finish+0x0/0x40
 [<4075a202>] ip_recv_finish+0x122.0x360
 [<4075a904>] ip_recv+0x204/0x290
 [<4075a0e0>] ip_rcv_finish+0x0/0x360
 [<4075a700>] ip_recv+0x0/0x290
 [<40732799>] netif_receive_skb+0x199/0x230
 [<40628cb5>] bnx2_poll_work+0x615/0xfe0
 [<4041b26a>] read_hpet+0xa/0x10
 [<40449404>] getnstimeofday+0x44/0x100
 [<40448477>] sched_clock_cpu+0xc7/0x150
 [<407d399d>] _spin_lock_irq+0x1d/0x30
 [<40439637>] run_timer_softirq+0x167/0x1a0
 [<4062bbef>] bnx2_poll_msix+0x1f/0xf0
 [<40734a79>] net_rx_action+0x99/0x140
 [<40434cf4>] __do_softirq+0x94/0x160
 [<4046471d>] handle_IRQ_event+0x4d/0x60
 [<40434e15>] do_soft_irq+0x55/0x60
 [<40406462>] do_IRQ+0x52/0x90
 [<4044781c>] notifier_call_chain+0x3c/0x70
 [<40404707>] common_interrupt+0x23/0x28
 [<40595185>] acpi_idle_enter_c1+0xc0/0x10b
 [<4070a596>] cpuidle_idle_call+0x66/0xc0
 [<4040245f>] cpu_idle+0x4f/0xa0
---[ end trace 5cd7ba21cd65d96b ]---



Article URL http://www.symantec.com/docs/TECH146073


Terms of use for this information are found in Legal Notices