I have a legitimate reason to open ~10,000 files and ~10,000 tasks on an
Alpha/Linux box. (If not thousands more...)
Exactly WHAT kernel modifications do I have to make to allow this to happen
and/or what are the issues involved?
I ask this on the kernel list because there are many conflicting
pieces of information about what the issues and max limits are, and I
want the definitive answer. (For example: It appears that the issues are
different between Linux 2.0.X and 2.1.X.)
1) Is there a maximum amount of TASKS that I can have? I know
that this number is tunable in "tasks.h", but are there any other limits
that I should be aware of? (Can I just define it as 10,000?)
2) Is there a maximum amount of OPEN_FILES that I can have?
Once again, I know that this number is tunable in "fs.h" and "limits.h",
and that /proc/sys/fs/file-max exists, but are there any other limits
that I should be aware of? (I heard some rumblings about issues with
select...) (I have also heard of a 3000fds patch... Where does this
exist? )
3) On Digital Unix, we eventually run into a limit of the number of
processes because of memory. (Each process has a certain footprint, and each
new one takes a small piece of memory from the overall available) What is the
footprint of a linux process and can it be reduced?
FYI: This program was written on Digital/Unix, and was ported to Alpha/Linux
very easily. (Nearly "make") When it was written, it pointed out many
of the short comings of Digital Unix with regard high number of processes,
that have since been fixed. (A quick call to the Digital Unix kernel people
fixed that.. ) Hopefully the same improvemnt of the Linux kernel can result
from it. (As we find places for improvement, we'll report it back to the list.)
Thanks,
Phil
Digital/Compaq High Performance Servers/Benchmark Engineering
Phillip.Ezolt@compaq.com ezolt@perf.zko.dec.com
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.rutgers.edu
Please read the FAQ at http://www.tux.org/lkml/