Re: [PATCH] tcp: set SPLICE_F_NONBLOCK after first buffer has beenspliced
From: Eric Dumazet
Date: Thu Nov 05 2009 - 09:12:05 EST
Max Kellermann a écrit :
> On 2009/11/05 12:21, Eric Dumazet <eric.dumazet@xxxxxxxxx> wrote:
>> Max Kellermann a écrit :
>>> Do you think that a splice() should block if the socket is readable
>>> and the pipe is writable according to select()?
>> Yes, this is perfectly legal
>> select() can return "OK to write on fd",
>> and still, write(fd, buffer, 10000000) is supposer/allowed to block if fd is not O_NDELAY
>>From the select() manpage: "those in writefds will be watched to see
> if a write will not block"
>>From the poll() manpage: "Writing now will not block."
> This looks unambiguous to me, and contradicts with your thesis. Can
> you provide sources?
> What is your interpretation of the guarantees provided by select() and
> poll()? Which byte count is "ok" to write after POLLOUT, and how much
> is "too much"? How does the application know?
It cannot, therefore an application uses O_NDELAY to avoid blocking.
Try following program if you are not convinced
int main(int argc, char *argv)
struct pollfd pfd;
pfd.fd = fds;
pfd.events = POLLOUT;
res = poll(&pfd, 1, -1);
if (res > 0 && pfd.revents & POLLOUT)
printf("OK to write on pipe\n");
write(fds, buffer, sizeof(buffer)); // why it blocks, did poll() lied ???
> I understand your patch, but I don't understand the conflict with my
> patch. Can you describe a breakage caused by my patch?
I only pointed out that using splice(tcp -> pipe) and blocking on pipe
_can_ block, even on _first_ frame received from tcp, as you discovered.
Your only choices to avoid a deadlock are :
1) to use SPLICE_F_NONBLOCK.
2) Using a second thread to read the pipe and empty it. First thread will
happily transfert 1000000 bytes in one syscall...
3) or limit your splice(... len, flags) length to 16 (16 buffers of one byte
in pathological cases)
Your patch basically makes SPLICE_F_NONBLOCK option always set (choice 1) above)
So users wanting option 3) are stuck. You force them to use a poll()/select()
thing while they dont want to poll : They have a producer thread(s), and a consumer
splice(tcp, &offset, pfds, NULL, 10000000,
SPLICE_F_MORE | SPLICE_F_MOVE);
Why in the first place have an option if it is always set ?
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/