Re: [PATCH] driver core: ensure a device has valid node id in device_add()

From: Yunsheng Lin
Date: Tue Sep 10 2019 - 03:09:39 EST


On 2019/9/10 2:50, Michal Hocko wrote:
> On Mon 09-09-19 14:04:23, Yunsheng Lin wrote:
>> Currently a device does not belong to any of the numa nodes
>> (dev->numa_node is NUMA_NO_NODE) when the node id is neither
>> specified by fw nor by virtual device layer and the device has
>> no parent device.
>>
>> According to discussion in [1]:
>
> Please do not reference important parts of the justification via a link.
> Just quote the relevant part to the changelog. It is just too easy that
> external links die - not to mention lkml.org.

Ok

>
>> Even if a device's numa node is not specified, the device really
>> does belong to a node.
>
> What does this mean?

It means some one need to guess the node id if the node is not
specified.

>
>> This patch sets the device node to node 0 in device_add() if the
>> device's node id is not specified and it either has no parent
>> device, or the parent device also does not have a valid node id.
>
> Why is node 0 special? I have seen platforms with node 0 missing or
> being memory less. The changelog also lacks an actual problem

by node 0 missing, how do we know if node 0 is missing?
by node_online(0)?

> descripton. Why do we even care about NUMA_NO_NODE? E.g. the page
> allocator interprets NUMA_NO_NODE as the closest node with a memory.
> And by closest it really means to the CPU which is performing the
> allocation.

Yes, I should have mentioned that in the commit log.

I mentioned the below in the RFC, but somehow deleted when sending
V1:
"There may be explicit handling out there relying on NUMA_NO_NODE,
like in nvme_probe()."

>
>> [1] https://lkml.org/lkml/2019/9/2/466
>>
>> Signed-off-by: Yunsheng Lin <linyunsheng@xxxxxxxxxx>
>> ---
>> Changelog RFC -> v1:
>> 1. Drop log error message and use a "if" instead of "? :".
>> 2. Drop the RFC tag.
>> ---
>> drivers/base/core.c | 10 +++++++---
>> include/linux/numa.h | 2 ++
>> 2 files changed, 9 insertions(+), 3 deletions(-)
>>
>> diff --git a/drivers/base/core.c b/drivers/base/core.c
>> index 1669d41..f79ad20 100644
>> --- a/drivers/base/core.c
>> +++ b/drivers/base/core.c
>> @@ -2107,9 +2107,13 @@ int device_add(struct device *dev)
>> if (kobj)
>> dev->kobj.parent = kobj;
>>
>> - /* use parent numa_node */
>> - if (parent && (dev_to_node(dev) == NUMA_NO_NODE))
>> - set_dev_node(dev, dev_to_node(parent));
>> + /* use parent numa_node or default node 0 */
>> + if (!numa_node_valid(dev_to_node(dev))) {
>> + if (parent && numa_node_valid(dev_to_node(parent)))
>> + set_dev_node(dev, dev_to_node(parent));
>> + else
>> + set_dev_node(dev, 0);
>> + }
>>
>> /* first, register with generic layer. */
>> /* we require the name to be set before, and pass NULL */
>> diff --git a/include/linux/numa.h b/include/linux/numa.h
>> index 110b0e5..eccc757 100644
>> --- a/include/linux/numa.h
>> +++ b/include/linux/numa.h
>> @@ -13,4 +13,6 @@
>>
>> #define NUMA_NO_NODE (-1)
>>
>> +#define numa_node_valid(node) ((unsigned int)(node) < nr_node_ids)
>> +
>> #endif /* _LINUX_NUMA_H */
>> --
>> 2.8.1
>