Re: bisected: futex regression >= 3.14 - was - Slowdown due to threads bouncing between HT cores

From: Mike Galbraith
Date: Mon Oct 27 2014 - 06:05:14 EST


On Sun, 2014-10-26 at 15:11 +0100, Steinar H. Gunderson wrote:
> I'm maybe a bit surprised nobody else can
> reproduce my issue;

I tried again this morning, and failed again this morning.

>From notes...

box = 2 socket, 14 cores/socket +ht, kernel = v3.18-rc2

stockfish 28 threads
nps 30511800 time 150120
nps 31337817 time 197553
nps 30675979 time 183005
nps 30706678 time 205037
nps 33389720 time 319808 (note massive runtime (ms) variance)
avg 30046381 211104

Adds perturbation source - ring-test -t 56 -w 1 -s 1 -p
(pipe ring, work 1ms, sleep 1ms, thread 0-55 pinned to cpu 0-55)

One ring did nada, bump to 5 concurrent rings.

nps 29443509 time 177969
nps 28713560 time 159663
nps 30628452 time 192714
nps 28834888 time 151611
nps 32611498 time 387760

Hm, still nada, try _10_.

nps 29998092 time 164625
nps 31142316 time 178655

Heh, 10 rings of pokers, still nada, try heavier tbench.

...

4 tbench pairs - 4 full cpus worth of competition
nps 27157639 time 144184
nps 26511984 time 143998
nps 28408851 time 182903
nps 28501510 time 157897
nps 28357045 time 172855
avg 27787405 160367 (avg runtime drops?.. shrug)

Ah, finally a nps delta.. but nothing unexpected.

vs zero competition, average nps is 0.924

4 cpus shared ~= stockfish runs on 26 cpus, 26/28 = 0.928

Test session summary: the sun moved westward.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/