Re: scheduler bug: process running since 5124095h

From: Mike Galbraith
Date: Tue Mar 30 2010 - 05:10:03 EST


On Tue, 2010-03-30 at 10:07 +0200, Mike Galbraith wrote:
> On Tue, 2010-03-30 at 15:22 +0900, Hidetoshi Seto wrote:
>
> > Quick report:
> >
> > The reason why this commit have bisected is because it changed
> > the type of time values from signed clock_t to unsigned cputime_t,
> > so that the following if-block become to be always taken:
> >
> > > - stime = nsec_to_clock_t(p->se.sum_exec_runtime) -
> > > - cputime_to_clock_t(task_utime(p));
> > > + stime = nsecs_to_cputime(p->se.sum_exec_runtime) - task_utime(p);
> > >
> > >> > if (stime >= 0)
> > > - p->prev_stime = max(p->prev_stime, clock_t_to_cputime(stime));
> > > + p->prev_stime = max(p->prev_stime, stime);
> > >
> > > return p->prev_stime;
> >
> > >From strace of latancytop, it does write to /proc/<pid>/sched:
> >
> > 5891 open("/proc/1/sched", O_RDWR) = 5
> > 5891 fstat(5, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
> > 5891 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
> > 0x7fc6668f3000
> > 5891 read(5, "init (1, #threads: 1)\n----------"..., 1024) = 776
> > 5891 read(5, "", 1024) = 0
> > >> 5891 write(5, "erase", 5) = 5
> > 5891 close(5) = 0
> >
> > It results in:
> >
> > [kernel/sched_debug.c]
> > void proc_sched_set_task(struct task_struct *p)
> > {
> > :
> > p->se.sum_exec_runtime = 0;
> > p->se.prev_sum_exec_runtime = 0;
> > p->nvcsw = 0;
> > p->nivcsw = 0;
> > }
>
> Hm. Dunno why that (evilness) exists.
>
> > So soon some task will have great (in fact negative) stime.
> >
> > There would be no doubt that this initialize in sched_debug.c
> > will break monotonicity of sum_exec_runtime. I confirmed that
> > the issue is disappeared by comment-out of lines above.
> >
> > Reverting the bisected commit is wrong solution, because it
> > will bring another issue, i.e. lost of runtime, and u/stime
> > seems to be frozen because these values restart from 0 so
> > prev_* is used for a while.
> >
> > How to fix? Is this a bug of latencytop? Kernel?
> > Please comment.

I think the correct fix is to not allow resetting of those 4 fields, as
they're used elsewhere in kernel. Latencytop doesn't seem to miss being
allowed to scribble. Dunno why it wants to reset any of these though.

sched: fix proc_sched_set_task()

Latencytop clearing sum_exec_runtime via proc_sched_set_task() breaks
task_times(). Other places in kernel use nvcsw and nivcsw, which are
being cleared as well, Clear task statistics only.

Signed-off-by: Mike Galbraith <efault@xxxxxx>
Cc: Ingo Molnar <mingo@xxxxxxx>
Cc: Peter Zijlstra <a.p.zijlstra@xxxxxxxxx>
Cc: Hidetoshi Seto <seto.hidetoshi@xxxxxxxxxxxxxx>
Reported-by: TÃrÃk Edwin <edwintorok@xxxxxxxxx>
LKML-Reference: <new-submission>

diff --git a/kernel/sched_debug.c b/kernel/sched_debug.c
index 8a46a71..ea2c690 100644
--- a/kernel/sched_debug.c
+++ b/kernel/sched_debug.c
@@ -491,8 +491,4 @@ void proc_sched_set_task(struct task_struct *p)
#ifdef CONFIG_SCHEDSTATS
memset(&p->se.statistics, 0, sizeof(p->se.statistics));
#endif
- p->se.sum_exec_runtime = 0;
- p->se.prev_sum_exec_runtime = 0;
- p->nvcsw = 0;
- p->nivcsw = 0;
}



--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/