NUMA Questions

From: Scott Robert Ladd
Date: Mon May 24 2004 - 14:10:21 EST


I'm running a Tyan K8W 2885, with two Opteron 240s and 512MB in each
memory bank. I've compiled kernel 2.6.7-rc1 with the following in my config:

CONFIG_K8_NUMA=y
CONFIG_DISCONTIGMEM=y
CONFIG_NUMA=y

In /var/log/messages, I see:

May 24 14:45:11 Corwin Scanning NUMA topology in Northbridge 24
May 24 14:45:11 Corwin Number of nodes 2 (10010)
May 24 14:45:11 Corwin Node 0 MemBase 0000000000000000 Limit 000000001fffffff
May 24 14:45:11 Corwin Node 1 MemBase 0000000020000000 Limit 000000003fff0000
May 24 14:45:11 Corwin Using node hash shift of 24
May 24 14:45:11 Corwin Bootmem setup node 0 0000000000000000-000000001fffffff
May 24 14:45:11 Corwin Bootmem setup node 1 0000000020000000-000000003fff0000
May 24 14:45:11 Corwin ACPI: have wakeup address 0x10020005000
May 24 14:45:11 Corwin No mptable found.
May 24 14:45:11 Corwin No mptable found.
May 24 14:45:11 Corwin setting up node 0 0-1ffff
May 24 14:45:11 Corwin On node 0 totalpages: 131071
May 24 14:45:11 Corwin DMA zone: 4096 pages, LIFO batch:1
May 24 14:45:11 Corwin Normal zone: 126975 pages, LIFO batch:16
May 24 14:45:11 Corwin HighMem zone: 0 pages, LIFO batch:1
May 24 14:45:11 Corwin setting up node 1 20000-3fff0
May 24 14:45:11 Corwin On node 1 totalpages: 131056
May 24 14:45:11 Corwin DMA zone: 0 pages, LIFO batch:1
May 24 14:45:11 Corwin Normal zone: 131056 pages, LIFO batch:16
May 24 14:45:11 Corwin HighMem zone: 0 pages, LIFO batch:1

So am I correct in assuming that NUMA is up and running? I note that Andi's numastat displays:

node1 node0
numa_hit 304539 472556
numa_miss 0 0
numa_foreign 0 0
interleave_hit 0 0
local_node 303607 472549
other_node 932 7

Yet when I run Andi's numactl, it states:

Corwin /usr/src/numactl-0.6.3 # numactl --show
No NUMA support available on this system.

A quick test program, and I see:

numa_available() returns -1
numa_max_node() return 1

Can anyone shed light on this?

--
Scott Robert Ladd
Coyote Gulch Productions (http://www.coyotegulch.com)
Software Invention for High-Performance Computing

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/