[root@emerald ~]# BUG: soft lockup detected on CPU#0! Call Trace: [] softlockup_tick+0xf5/0x12a [] run_local_timers+0x13/0x15 [] update_process_times+0x38/0x7b [] smp_local_timer_interrupt+0x34/0x58 [] smp_apic_timer_interrupt+0x43/0x65 [] apic_timer_interrupt+0x6b/0x70 [] _spin_unlock_irqrestore+0x45/0x4a [] :raid456:release_stripe+0x3b/0x44 [] :raid456:raid5d+0x32c/0x441 [] finish_wait+0x59/0x6d [] trace_hardirqs_on+0xcb/0x167 [] md_thread+0x32/0x121 [] autoremove_wake_function+0x0/0x3b [] md_thread+0x0/0x121 [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 BUG: soft lockup detected on CPU#0! Call Trace: [] softlockup_tick+0xf5/0x12a [] run_local_timers+0x13/0x15 [] update_process_times+0x38/0x7b [] smp_local_timer_interrupt+0x34/0x58 [] smp_apic_timer_interrupt+0x43/0x65 [] :raid456:handle_stripe5+0x58/0x1770 [] apic_timer_interrupt+0x6b/0x70 [] lock_acquire+0x9c/0xab [] :raid456:handle_stripe5+0x58/0x1770 [] _spin_lock+0x25/0x34 [] :raid456:handle_stripe5+0x58/0x1770 [] __lock_acquire+0x1fe/0x11bc [] __wake_up+0x22/0x52 [] :raid456:handle_stripe+0x34/0x138c [] __lock_acquire+0x1fe/0x11bc [] :raid456:release_stripe+0x3b/0x44 [] :raid456:raid5d+0x338/0x441 [] :raid456:raid5d+0x311/0x441 [] _spin_unlock_irq+0x2b/0x33 [] trace_hardirqs_on+0xcb/0x167 [] :raid456:raid5d+0x324/0x441 [] finish_wait+0x59/0x6d [] trace_hardirqs_on+0xcb/0x167 [] md_thread+0x32/0x121 [] autoremove_wake_function+0x0/0x3b [] md_thread+0x0/0x121 [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 BUG: soft lockup detected on CPU#0! Call Trace: [] softlockup_tick+0xf5/0x12a [] run_local_timers+0x13/0x15 [] update_process_times+0x38/0x7b [] smp_local_timer_interrupt+0x34/0x58 [] smp_apic_timer_interrupt+0x43/0x65 [] apic_timer_interrupt+0x6b/0x70 [] _spin_unlock_irqrestore+0x45/0x4a [] :raid456:release_stripe+0x3b/0x44 [] :raid456:raid5d+0x32c/0x441 [] finish_wait+0x59/0x6d [] trace_hardirqs_on+0xcb/0x167 [] md_thread+0x32/0x121 [] autoremove_wake_function+0x0/0x3b [] md_thread+0x0/0x121 [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 SysRq : HELP : loglevel0-8 reBoot Crashdump show-all-locks(D) tErm Full kIll saK showMem Nice powerOff showPc show-all-timers(Q) unRaw Sync showTasks Unmount shoW-blocked-tasks SysRq : Changing Loglevel Loglevel set to 9 SysRq : Show Memory Mem-info: DMA per-cpu: CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0 DMA32 per-cpu: CPU 0: Hot: hi: 186, btch: 31 usd: 44 Cold: hi: 62, btch: 15 usd: 9 CPU 1: Hot: hi: 186, btch: 31 usd: 17 Cold: hi: 62, btch: 15 usd: 14 Active:277534 inactive:199476 dirty:48564 writeback:223 unstable:0 free:3652 slab:14789 mapped:18960 pagetables:6152 bounce:0 DMA free:7096kB min:16kB low:20kB high:24kB active:0kB inactive:0kB present:6536kB pages_scanned:0 all_unreclaimable? yes lowmem_reserve[]: 0 1987 1987 1987 DMA32 free:7512kB min:5696kB low:7120kB high:8544kB active:1110136kB inactive:797904kB present:2035564kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 2*4kB 4*8kB 5*16kB 2*32kB 4*64kB 4*128kB 2*256kB 1*512kB 1*1024kB 0*2048kB 1*4096kB = 7096kB DMA32: 138*4kB 133*8kB 23*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 2*2048kB 0*4096kB = 7456kB Swap cache: add 72, delete 72, find 3/6, race 0+0 Free swap = 6224360kB Total swap = 6224564kB Free swap: 6224360kB 524160 pages of RAM 14441 reserved pages 220655 pages shared 0 pages swap cached SysRq : Show Pending Timers Timer List Version: v0.3 HRTIMER_MAX_CLOCK_BASES: 2 now at 52541467361665 nsecs cpu: 0 clock 0: .index: 0 .resolution: 999848 nsecs .get_time: ktime_get_real active timers: clock 1: .index: 1 .resolution: 999848 nsecs .get_time: ktime_get active timers: #0: <3>BUG: sleeping function called from invalid context at kernel/mutex.c:86 in_atomic():0, irqs_disabled():1 1 lock held by bash/20396: #0: (sysrq_key_table_lock){+...}, at: [] __handle_sysrq+0x26/0x147 irq event stamp: 48014 hardirqs last enabled at (48013): [] trace_hardirqs_on_thunk+0x35/0x37 hardirqs last disabled at (48014): [] _spin_lock_irqsave+0x13/0x3c softirqs last enabled at (45826): [] __do_softirq+0xe2/0xf8 softirqs last disabled at (45819): [] call_softirq+0x1c/0x30 Call Trace: [] __might_sleep+0xbe/0xdd [] mutex_lock+0x1d/0x31 [] lookup_module_symbol_name+0x19/0xbd [] lookup_symbol_name+0x4d/0x52 [] print_name_offset+0x28/0xac [] timer_list_show+0x2b1/0x55b [] timer_list_show+0x444/0x55b [] it_real_fn+0x0/0x1d [] do_setitimer+0x3bb/0x3c0 [] __handle_sysrq+0x26/0x147 [] sysrq_timer_list_show+0xd/0x12 [] sysrq_handle_show_timers+0x9/0xb [] __handle_sysrq+0x8c/0x147 [] write_sysrq_trigger+0x0/0x43 [] write_sysrq_trigger+0x41/0x43 [] proc_reg_write+0x75/0xa3 [] vfs_write+0xc8/0x187 [] sys_write+0x47/0x75 [] tracesys+0xdc/0xe1 ================================= [ INFO: inconsistent lock state ] 2.6.23.8.bryce #1 --------------------------------- inconsistent {in-hardirq-W} -> {hardirq-on-W} usage. bash/20396 [HC0[0]:SC0[0]:HE1:SE1] takes: (sysrq_key_table_lock){+...}, at: [] __handle_sysrq+0x26/0x147 {in-hardirq-W} state was registered at: [] 0xffffffffffffffff irq event stamp: 48014 hardirqs last enabled at (48013): [] trace_hardirqs_on_thunk+0x35/0x37 hardirqs last disabled at (48014): [] _spin_lock_irqsave+0x13/0x3c softirqs last enabled at (45826): [] __do_softirq+0xe2/0xf8 softirqs last disabled at (45819): [] call_softirq+0x1c/0x30 other info that might help us debug this: 1 lock held by bash/20396: #0: (sysrq_key_table_lock){+...}, at: [] __handle_sysrq+0x26/0x147 stack backtrace: Call Trace: [] print_usage_bug+0x177/0x17c [] mark_lock+0x5e6/0x63f [] mark_held_locks+0x3e/0x79 [] _spin_unlock_irq+0x2b/0x33 [] trace_hardirqs_on+0x8b/0x167 [] _spin_unlock_irq+0x2b/0x33 [] thread_return+0x84/0x60a [] show_trace+0x4a/0x55 [] __cond_resched+0x2d/0x55 [] cond_resched+0x32/0x39 [] mutex_lock+0x22/0x31 [] lookup_module_symbol_name+0x19/0xbd [] lookup_symbol_name+0x4d/0x52 [] print_name_offset+0x28/0xac [] timer_list_show+0x2b1/0x55b [] timer_list_show+0x444/0x55b [] it_real_fn+0x0/0x1d [] do_setitimer+0x3bb/0x3c0 [] __handle_sysrq+0x26/0x147 [] sysrq_timer_list_show+0xd/0x12 [] sysrq_handle_show_timers+0x9/0xb [] __handle_sysrq+0x8c/0x147 [] write_sysrq_trigger+0x0/0x43 [] write_sysrq_trigger+0x41/0x43 [] proc_reg_write+0x75/0xa3 [] vfs_write+0xc8/0x187 [] sys_write+0x47/0x75 [] tracesys+0xdc/0xe1 , it_real_fn, S:01, do_setitimer, sendmail/2541 # expires at 54056800846738 nsecs [in 1515333485073 nsecs] #1: , hrtimer_wakeup, S:01, do_nanosleep, atd/2687 # expires at 54059843183457 nsecs [in 1518375821792 nsecs] #2: , hrtimer_wakeup, S:01, futex_wait, java/3461 # expires at 65121777862839 nsecs [in 12580310501174 nsecs] cpu: 1 clock 0: .index: 0 .resolution: 999848 nsecs .get_time: ktime_get_real active timers: clock 1: .index: 1 .resolution: 999848 nsecs .get_time: ktime_get active timers: #0: , hrtimer_wakeup, S:01, do_nanosleep, gdm-binary/3071 # expires at 52542399792391 nsecs [in 932430726 nsecs] #1: , hrtimer_wakeup, S:01, do_nanosleep, gdm-binary/3071 # expires at 52542399792391 nsecs [in 932430726 nsecs] #2: , hrtimer_wakeup, S:01, do_nanosleep, wmix/3212 # expires at 52542411850048 nsecs [in 944488383 nsecs] #3: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/7878 # expires at 52542791961102 nsecs [in 1324599437 nsecs] #4: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/18149 # expires at 52542792017097 nsecs [in 1324655432 nsecs] #5: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/3266 # expires at 52542792029033 nsecs [in 1324667368 nsecs] #6: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/19820 # expires at 52542792040017 nsecs [in 1324678352 nsecs] #7: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/19820 # expires at 52542792040017 nsecs [in 1324678352 nsecs] #8: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/7579 # expires at 52542792052067 nsecs [in 1324690402 nsecs] #9: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/19664 # expires at 52543199800078 nsecs [in 1732438413 nsecs] #10: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/3269 # expires at 52543199810042 nsecs [in 1732448377 nsecs] #11: , hrtimer_wakeup, S:01, futex_wait, thunderbird-bin/3269 # expires at 52543199810042 nsecs [in 1732448377 nsecs] #12: , hrtimer_wakeup, S:01, futex_wait, automount/2334 # expires at 52543200341167 nsecs [in 1732979502 nsecs] #13: , hrtimer_wakeup, S:01, do_nanosleep, gpm/2551 # expires at 52543349862505 nsecs [in 1882500840 nsecs] #14: , hrtimer_wakeup, S:01, do_nanosleep, gpm/2551 # expires at 52543349862505 nsecs [in 1882500840 nsecs] #15: , hrtimer_wakeup, S:01, futex_wait, firefox-bin/5161 # expires at 52550702966351 nsecs [in 9235604686 nsecs] #16: , hrtimer_wakeup, S:01, do_nanosleep, irqbalance/2126 # expires at 52550349862666 nsecs [in 8882501001 nsecs] #17: , hrtimer_wakeup, S:01, futex_wait, firefox-bin/5161 # expires at 52550702966351 nsecs [in 9235604686 nsecs] #18: , hrtimer_wakeup, S:01, do_nanosleep, crond/2649 # expires at 52560070576437 nsecs [in 18603214772 nsecs] #19: , hrtimer_wakeup, S:01, do_nanosleep<3>BUG: soft lockup detected on CPU#0! Call Trace: [] softlockup_tick+0xf5/0x12a [] run_local_timers+0x13/0x15 [] update_process_times+0x38/0x7b [] smp_local_timer_interrupt+0x34/0x58 [] smp_apic_timer_interrupt+0x43/0x65 [] apic_timer_interrupt+0x6b/0x70 [] :raid456:handle_stripe5+0x188/0x1770 [] trace_hardirqs_on_thunk+0x35/0x37 [] trace_hardirqs_on_thunk+0x35/0x37 [] __wake_up+0x22/0x52 [] :raid456:handle_stripe+0x34/0x138c [] __wake_up+0x43/0x52 [] :raid456:raid5d+0x338/0x441 [] :raid456:raid5d+0x324/0x441 [] finish_wait+0x59/0x6d [] trace_hardirqs_on+0xcb/0x167 [] md_thread+0x32/0x121 [] autoremove_wake_function+0x0/0x3b [] md_thread+0x0/0x121 [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 , crond/2649 # expires at 52560070576437 nsecs [in 18603214772 nsecs] SysRq : Show Blocked State task PC stack pid father pdflush D 0000000000000001 4264 239 2 ffff810037f17d40 0000000000000086 0000000000000286 ffff81007ff20000 ffff81007ff20000 ffff810037f10f90 ffff8100792ca000 0000000000000286 ffff810037f17d50 ffff81007ff20000 ffff810037f17d40 ffffffff81041d50 Call Trace: [] __mod_timer+0xab/0xe2 [] schedule_timeout+0x5e/0xd0 [] process_timeout+0x0/0xb [] schedule_timeout+0x59/0xd0 [] io_schedule_timeout+0x4b/0x7b [] congestion_wait+0x83/0x9f [] autoremove_wake_function+0x0/0x3b [] writeback_inodes+0x83/0x106 [] wb_kupdate+0xc8/0x121 [] pdflush+0x0/0x208 [] pdflush+0x12f/0x208 [] wb_kupdate+0x0/0x121 [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 pdflush D 0000000000000001 4488 240 2 ffff810037f1b8a0 0000000000000086 ffff810037d74c00 ffff81007e922580 ffff810037f1b840 ffff810037f18000 ffff81004b4ee000 ffff81007e8ee740 ffff81007e922400 ffff810037d74c00 ffff81007e922580 0000000000000282 Call Trace: [] :raid456:raid5_unplug_device+0x6e/0x7d [] :raid456:get_active_stripe+0x1e9/0x5f6 [] mark_held_locks+0x3e/0x79 [] _spin_unlock_irqrestore+0x42/0x4a [] trace_hardirqs_on+0xcb/0x167 [] default_wake_function+0x0/0xf [] :raid456:make_request+0x21d/0x654 [] __up_read+0x3d/0x87 [] autoremove_wake_function+0x0/0x3b [] up_read+0x26/0x2d [] generic_make_request+0x172/0x406 [] mark_held_locks+0x3e/0x79 [] submit_bio+0x5f/0xed [] submit_bh+0xe9/0x136 [] __block_write_full_page+0x18a/0x336 [] blkdev_get_block+0x0/0x54 [] blkdev_get_block+0x0/0x54 [] block_write_full_page+0xe9/0x10f [] blkdev_writepage+0x13/0x15 [] __writepage+0x15/0x3e [] write_cache_pages+0x2ab/0x3a7 [] __writepage+0x0/0x3e [] __writeback_single_inode+0x9d/0x3b2 [] generic_writepages+0x20/0x26 [] do_writepages+0x29/0x44 [] __writeback_single_inode+0xa8/0x3b2 [] _read_unlock+0x26/0x2d [] :dm_mod:dm_table_any_congested+0x2c/0x81 [] sync_sb_inodes+0x211/0x2dc [] writeback_inodes+0xcd/0x106 [] background_writeout+0xaf/0xd4 [] pdflush+0x0/0x208 [] pdflush+0x12f/0x208 [] background_writeout+0x0/0xd4 [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 kjournald D 0000000000000001 5288 1720 2 ffff81006d251b10 0000000000000086 ffff81006d251ad8 ffff81007e922580 ffff81006d251ab0 ffff81007e8c0f90 ffff81007ff2c000 ffff81007e8ee740 00000001031cc36d 0000000037d74c00 000000000000000f 0000000000000282 Call Trace: [] :raid456:get_active_stripe+0x1e9/0x5f6 [] prepare_to_wait+0x4d/0x62 [] _spin_unlock_irqrestore+0x42/0x4a [] trace_hardirqs_on+0xcb/0x167 [] default_wake_function+0x0/0xf [] :raid456:make_request+0x21d/0x654 [] __up_read+0x3d/0x87 [] autoremove_wake_function+0x0/0x3b [] up_read+0x26/0x2d [] generic_make_request+0x172/0x406 [] :jbd:journal_free_journal_head+0x56/0x58 [] submit_bio+0x5f/0xed [] submit_bh+0xe9/0x136 [] :jbd:journal_do_submit_data+0x32/0x4a [] :jbd:journal_commit_transaction+0x81e/0x16be [] try_to_del_timer_sync+0x58/0x69 [] :jbd:kjournald+0x15e/0x3ae [] autoremove_wake_function+0x0/0x3b [] :jbd:kjournald+0x0/0x3ae [] kthread+0x46/0x70 [] child_rip+0xa/0x12 [] restore_args+0x0/0x30 [] kthread+0x0/0x70 [] child_rip+0x0/0x12 rsyslogd D 0000000000000001 4096 2300 1 ffff81006bfc1998 0000000000000092 0000000000000286 ffff81007ff20000 ffff81007ff20000 ffff81006c73e000 ffff81002f4b2000 0000000000000286 ffff81006bfc19a8 ffff81007ff20000 ffff81006bfc1998 ffffffff81041d50 Call Trace: [] __mod_timer+0xab/0xe2 [] schedule_timeout+0x5e/0xd0 [] process_timeout+0x0/0xb [] schedule_timeout+0x59/0xd0 [] io_schedule_timeout+0x4b/0x7b [] congestion_wait+0x83/0x9f [] autoremove_wake_function+0x0/0x3b [] writeback_inodes+0x83/0x106 [] balance_dirty_pages_ratelimited_nr+0x12c/0x212 [] :ext3:ext3_ordered_commit_write+0x9b/0xd0 [] generic_file_buffered_write+0x3ff/0x8fc [] current_fs_time+0x22/0x29 [] __generic_file_aio_write_nolock+0x29a/0x44a [] generic_file_aio_write+0x64/0xc6 [] :ext3:ext3_file_write+0x1f/0xaa [] do_sync_write+0xed/0x12a [] wait_on_page_writeback_range+0x76/0x156 [] autoremove_wake_function+0x0/0x3b [] _spin_unlock+0x26/0x2d [] __mutex_unlock_slowpath+0xb4/0x176 [] audit_syscall_entry+0x151/0x187 [] vfs_write+0xc8/0x187 [] sys_write+0x47/0x75 [] tracesys+0xdc/0xe1 hald-addon-st D 0000000000000001 5520 2943 2808 ffff810061c8fa68 0000000000000096 ffffffff812aa1fa 0000000000000002 0000000000000000 ffff8100623c2f90 ffff81007ff24000 0000000000000046 ffff810061c8fa48 0000000000000046 ffff810061c8fb58 ffff810061c8fb40 Call Trace: [] wait_for_completion+0x33/0xe7 [] wait_for_completion+0xc8/0xe7 [] default_wake_function+0x0/0xf [] blk_execute_rq_nowait+0x68/0x9b [] blk_execute_rq+0x70/0xc2 [] get_request_wait+0x24/0x1a4 [] blk_get_request+0x26/0x73 [] :scsi_mod:scsi_execute+0xd5/0xfe [] :scsi_mod:scsi_execute_req+0x71/0xd2 [] :sd_mod:sd_revalidate_disk+0xf1/0x143a [] get_super+0xb0/0xc0 [] check_disk_change+0x4b/0x7c [] :sd_mod:sd_open+0xc2/0x1be [] blkdev_open+0x0/0x7a [] do_open+0xa5/0x309 [] blkdev_open+0x0/0x7a [] _spin_unlock+0x26/0x2d [] blkdev_open+0x0/0x7a [] blkdev_open+0x37/0x7a [] __dentry_open+0xcd/0x1f9 [] nameidata_to_filp+0x3c/0x49 [] do_filp_open+0x44/0x50 [] _spin_unlock+0x26/0x2d [] get_unused_fd_flags+0xfe/0x128 [] do_sys_open+0x4e/0xd6 [] sys_open+0x1b/0x1d [] tracesys+0xdc/0xe1 hald-addon-st D 0000000000000001 5520 2947 2808 ffff810061d5fa68 0000000000000096 ffffffff812aa1fa 0000000000000002 0000000000000000 ffff810061d5c000 ffff81007ff24000 0000000000000046 ffff810061d5fa48 0000000000000046 ffff810061d5fb58 ffff810061d5fb40 Call Trace: [] wait_for_completion+0x33/0xe7 [] wait_for_completion+0xc8/0xe7 [] default_wake_function+0x0/0xf [] blk_execute_rq_nowait+0x68/0x9b [] blk_execute_rq+0x70/0xc2 [] get_request_wait+0x24/0x1a4 [] blk_get_request+0x26/0x73 [] :scsi_mod:scsi_execute+0xd5/0xfe [] :scsi_mod:scsi_execute_req+0x71/0xd2 [] :sd_mod:sd_revalidate_disk+0xf1/0x143a [] get_super+0xb0/0xc0 [] check_disk_change+0x4b/0x7c [] :sd_mod:sd_open+0xc2/0x1be [] blkdev_open+0x0/0x7a [] do_open+0xa5/0x309 [] blkdev_open+0x0/0x7a [] _spin_unlock+0x26/0x2d [] blkdev_open+0x0/0x7a [] blkdev_open+0x37/0x7a [] __dentry_open+0xcd/0x1f9 [] nameidata_to_filp+0x3c/0x49 [] do_filp_open+0x44/0x50 [] _spin_unlock+0x26/0x2d [] get_unused_fd_flags+0xfe/0x128 [] do_sys_open+0x4e/0xd6 [] sys_open+0x1b/0x1d [] tracesys+0xdc/0xe1 java D 0000000000000001 6400 3414 3364 ffff810055fd7ea8 0000000000000092 ffff81005d08c000 0000000000000000 0000000000000000 ffff81005d08c000 ffff81004ddc2f90 ffffffff81056624 ffff81005d08c000 ffffffff812ad06e 00002aaaaacea000 00002b739c149e60 Call Trace: [] mark_held_locks+0x3e/0x79 [] _spin_unlock_irq+0x2b/0x33 [] trace_hardirqs_on+0xcb/0x167 [] __down_write_nested+0x75/0xb2 [] __down_write+0xb/0xd [] down_write+0x43/0x4a [] sys_mprotect+0xd3/0x24f [] tracesys+0xdc/0xe1 java D 0000000000000001 5008 3421 3364 ffff810055b3db78 0000000000000092 0000000000000286 ffff81007ff20000 ffff81007ff20000 ffff810055b3a000 ffff810055b3af90 0000000000000286 ffff810055b3db88 ffff81007ff20000 ffff810055b3db78 ffffffff81041d50 Call Trace: [] __mod_timer+0xab/0xe2 [] schedule_timeout+0x5e/0xd0 [] process_timeout+0x0/0xb [] schedule_timeout+0x59/0xd0 [] io_schedule_timeout+0x4b/0x7b [] congestion_wait+0x83/0x9f [] autoremove_wake_function+0x0/0x3b [] writeback_inodes+0x83/0x106 [] balance_dirty_pages_ratelimited_nr+0x12c/0x212 [] set_page_dirty_balance+0x47/0x59 [] do_wp_page+0x4d4/0x6a5 [] handle_mm_fault+0x4d8/0x9ec [] do_page_fault+0x1a2/0x9d0 [] getnstimeofday+0x34/0x8f [] audit_syscall_exit+0x349/0x3aa [] trace_hardirqs_on_thunk+0x35/0x37 [] error_exit+0x0/0x96 java D 0000000000000001 4976 3422 3364 ffff81005485fb78 0000000000000092 0000000000000286 ffff81007ff20000 ffff81007ff20000 ffff810055b3af90 ffff810037f10f90 0000000000000286 ffff81005485fb88 ffff81007ff20000 ffff81005485fb78 ffffffff81041d50 Call Trace: [] __mod_timer+0xab/0xe2 [] schedule_timeout+0x5e/0xd0 [] process_timeout+0x0/0xb [] schedule_timeout+0x59/0xd0 [] io_schedule_timeout+0x4b/0x7b [] congestion_wait+0x83/0x9f [] autoremove_wake_function+0x0/0x3b [] writeback_inodes+0x83/0x106 [] balance_dirty_pages_ratelimited_nr+0x12c/0x212 [] set_page_dirty_balance+0x47/0x59 [] do_wp_page+0x4d4/0x6a5 [] handle_mm_fault+0x4d8/0x9ec [] do_page_fault+0x1a2/0x9d0 [] getnstimeofday+0x34/0x8f [] audit_syscall_exit+0x349/0x3aa [] trace_hardirqs_on_thunk+0x35/0x37 [] error_exit+0x0/0x96 firefox-bin D 0000000000000001 4256 5159 5154 ffff810023835998 0000000000000092 0000000000000286 ffff81007ff20000 ffff81007ff20000 ffff81002f4b2000 ffff810055b3a000 0000000000000286 ffff8100238359a8 ffff81007ff20000 ffff810023835998 ffffffff81041d50 Call Trace: [] __mod_timer+0xab/0xe2 [] schedule_timeout+0x5e/0xd0 [] process_timeout+0x0/0xb [] schedule_timeout+0x59/0xd0 [] io_schedule_timeout+0x4b/0x7b [] congestion_wait+0x83/0x9f [] autoremove_wake_function+0x0/0x3b [] writeback_inodes+0x83/0x106 [] balance_dirty_pages_ratelimited_nr+0x12c/0x212 [] :ext3:ext3_ordered_commit_write+0x9b/0xd0 [] generic_file_buffered_write+0x3ff/0x8fc [] current_fs_time+0x22/0x29 [] dnotify_parent+0x7d/0x8c [] __generic_file_aio_write_nolock+0x29a/0x44a [] generic_file_aio_write+0x64/0xc6 [] :ext3:ext3_file_write+0x1f/0xaa [] do_sync_write+0xed/0x12a [