oom: multi threaded process coredump don't make deadlock
authorKOSAKI Motohiro <[email protected]>
Tue, 10 Aug 2010 00:19:42 +0000 (17:19 -0700)
committerLinus Torvalds <[email protected]>
Tue, 10 Aug 2010 03:45:02 +0000 (20:45 -0700)
commitcef1d3523d33ebc35fc29e454b1f4bab953fabbf
tree3688cf9e7c3b1bd4e1d473d79fd1a959bd4306fb
parent93b43fa55088fe977503a156d1097cc2055449a2
oom: multi threaded process coredump don't make deadlock

Oleg pointed out current PF_EXITING check is wrong. Because PF_EXITING
is per-thread flag, not per-process flag. He said,

   Two threads, group-leader L and its sub-thread T. T dumps the code.
   In this case both threads have ->mm != NULL, L has PF_EXITING.

   The first problem is, select_bad_process() always return -1 in this
   case (even if the caller is T, this doesn't matter).

   The second problem is that we should add TIF_MEMDIE to T, not L.

I think we can remove this dubious PF_EXITING check. but as first step,
This patch add the protection of multi threaded issue.

Signed-off-by: KOSAKI Motohiro <[email protected]>
Cc: Oleg Nesterov <[email protected]>
Cc: Minchan Kim <[email protected]>
Cc: David Rientjes <[email protected]>
Cc: KAMEZAWA Hiroyuki <[email protected]>
Signed-off-by: Andrew Morton <[email protected]>
Signed-off-by: Linus Torvalds <[email protected]>
mm/oom_kill.c