Commit Graph
339 Commits
Author SHA1 Message Date
Hannes Weisbach 4f2c1e07c1 Add ARCH variable to Makefiles
In some Makefiles the ARCH variable was not set, although it was used.
In executer/user/Makefile.in it was used before it was set.
2017-10-18 09:20:50 +09:00
Dominique Martinet b894619d1b Speed up parallel builds
- make should be $(MAKE)
 - add + in front of rules spawning long-lasted make process in a
subshell. (This would not be needed with $(MAKE) -C .. target, but our
makefiles do not handle that because they use $(PWD))
 - split the main 'all' rule as all 4 targets are independant
 - fix dependencies where appropriate for parallelism

Extra, not speed-related changes:
 - remove some double-colon for targets as they do not need it

This cuts build time from 5s to 1.5s on a laptop with -j4, and more
importantly from 85s to 35s on a KNL node.
As a bonus, the fixed dependencies removes the need to clean before
rebuilding all the time. Probably.
2017-10-13 10:02:11 +09:00
Masamichi Takagi e1442bf12b mcexec: Fix usage 2017-10-03 15:34:00 +09:00
Masamichi Takagi 37e3118df6 mcexec: Add --stack-premap=<premap_size>[,<max>] to man page 2017-09-26 18:45:52 +09:00
Masamichi Takagi be4d84c0c1 mcexec: Add --stack-premap=<premap_size>[,<max>]
<premap_size> of stack is pre-mapped on creating a process.
And its max size of stack is set to <max>.
This replaces MCKERNEL_RLIMIT_STACK=<premap_size>,<max>.
2017-09-26 17:04:10 +09:00
Balazs Gerofi dae9a5ff13 mcexec: verify argument for -n/-t/-c 2017-09-25 16:43:47 +09:00
Yutaka IshikawaandMasamichi Takagi 47b4bd5aba Installing mcexec.1 man page 2017-09-20 16:37:05 +09:00
Yutaka IshikawaandMasamichi Takagi ea831c614e mcexec man page 2017-09-20 16:37:00 +09:00
Balazs Gerofi 5664125e57 mcexec: verify number of processes for partitioned execution 2017-09-21 16:11:56 +09:00
Balazs Gerofi 203bfc2492 mcexec: limit nr. of threads for non-OpenMP partitioned execution 2017-09-21 15:30:37 +09:00
Katsuya HorigomeandKen Sato a05b6e1ba8 Expand dump-functions for excluding user/unused memory (This is rebase commit for merging to development) 2017-09-11 15:49:04 +09:00
Takayuki Okamoto 0278a876db disable POSTK_DEBUG_* on x86_64 2017-09-07 22:20:22 +09:00
Ken Sato 707b245009 diable swap out/in in qlmpi 2017-09-07 16:06:56 +09:00
Takayuki Okamoto 8cc264d794 fix build error with "out of tree build"
- change include-path
- enable memdump by default
2017-09-06 21:54:43 +09:00
Takayuki Okamoto 9989f41fd3 add arm64 support
- add arm64 dependent codes with GICv3 and SVE support
- fix bugs based on architecture separation requests
2017-09-05 15:06:27 +09:00
Balazs Gerofi 99ca46663b mcctrl, mexec: fix a bunch of warnings 2017-09-04 08:53:32 +09:00
Hitoshi Iizuka 82a0f155d8 qlmpilib.c:fix ql_init() to static 2017-08-30 17:00:37 +09:00
Ken Sato a2b8235e83 Add -rpath to mcexec 2017-08-30 16:54:48 +09:00
Yutaka IshikawaandKen Sato 236a072311 Add qlmpi and swap to mckernel (This is rebase commit for merging to development) 2017-08-29 15:04:58 +09:00
Tomoki Shirasawa b39fec1104 uti: remove unused functions 2017-07-26 13:14:30 +09:00
Tomoki Shirasawa effde241b9 support uti_attr for utility thread offloading 2017-07-25 13:03:48 +09:00
Tomoki Shirasawa 101cab5b0a remove debug print 2017-07-25 13:02:17 +09:00
Balazs Gerofi bc423255d9 mcctrl/mcexec: limit thread pool size when too many threads exist on Linux 2017-07-21 15:33:19 +09:00
Masamichi Takagi 38961fca78 Revert "do_fork(): RLIMIT_NPROC check"
This reverts commit 035e7913d8.
2017-07-13 04:13:41 +09:00
Masamichi Takagi 035e7913d8 do_fork(): RLIMIT_NPROC check
1. mcexec sets RLIMIT_NPROC to the number of mcexec threads.
2. do_fork() gets the current number of threads by calling rusage function.
3. do_fork() returns -EAGAIN when the limit is exceeded.
2017-07-12 20:42:38 +09:00
Masamichi Takagi 6afea4af48 mcexec: Fix debug/error messages 2017-07-12 14:30:21 +09:00
Masamichi Takagi 6415dcfdcc mcexec: Disable address space layout randomization
Move the code from mcreboot.sh to mcexec.c.
2017-07-12 14:17:38 +09:00
Tomoki Shirasawa 090937a5a3 fix out of tree build 2017-06-30 09:57:50 +09:00
Tomoki Shirasawa 2082acdf0d add executer/user/arch/x86_64/Makefile.in 2017-06-28 09:36:31 +09:00
Tomoki Shirasawa a8f11634e6 remove debug print for uti tracer 2017-06-27 14:42:04 +09:00
Tomoki Shirasawa 07efb3ab9a support to utility thread offloading 2017-06-27 13:27:09 +09:00
Balazs Gerofi 52bc052e1a mcexec: recursively bind mount $prefix/rootfs/ on / 2017-06-16 18:01:25 +09:00
Balazs Gerofi f84415c310 mcexec: use atobytes() for MCKERNEL_RLIMIT_STACK 2017-06-15 16:50:34 +09:00
Balazs Gerofi 200fe9aec4 mcctrl/mcexec: fix per-process data reference counting 2017-06-07 17:21:55 +09:00
Masamichi Takagi 6bdafbd33b Fix rusage 2017-06-07 09:30:42 +09:00
Balazs Gerofi 0c3b705f98 brk(): make aggressive heap extension optional 2017-05-24 01:41:54 +09:00
Balazs Gerofi 9f55263528 mcexec: atobytes() to convert size string to # of bytes 2017-05-24 01:41:54 +09:00
Balazs Gerofi 9b5ccb5a33 Pre-map file mappings from /dev/shm (--mpol-shm-premap mcexec argument) 2017-05-23 20:00:06 +09:00
Balazs Gerofi e901d42fb6 mcexec: --extend-heap-by: argument to specify heap extension size 2017-05-23 19:58:49 +09:00
Balazs Gerofi e554f4e2f9 mcexec: --disable-sched-yield: avoid kernel/user switch 2017-05-23 19:57:08 +09:00
Balazs Gerofi e3e0f6a174 mcexec: introduction of --profile 2017-05-23 02:42:06 +09:00
Balazs Gerofi 9c25d47d9b mcexec: transfer job information to LWK 2017-05-23 02:42:06 +09:00
Balazs Gerofi 989af7e045 mcexec: RLIMIT_STACK handling 2017-05-23 02:39:42 +09:00
Balazs Gerofi 721cee05a2 MPOL default threshold to 0 2017-05-23 02:39:42 +09:00
Balazs Gerofi ab113658f1 mcexec: --no-bind-ikc-map for optionally disabling binding 2017-05-23 02:39:42 +09:00
Balazs Gerofi 2d72042021 mcexec: bind to CPus according to ikc_map 2017-05-23 02:39:42 +09:00
Balazs Gerofi 26b9484bae mcexec: --mpol-threshold to control MPOL_BIND/MPOL_PREFERRED 2017-05-23 02:39:42 +09:00
Balazs Gerofi 182202523e mcexec/mm: user memory policy control for heap, stack, etc. 2017-05-23 02:39:42 +09:00
Balazs Gerofi e01f6dd6ea eclair: obtain kernel_base from dump_mem_chunks_t 2017-05-12 13:23:23 +09:00
Balazs Gerofi 2f2f04d5a1 mcexec: ENABLE_MCOVERLAYFS on CentOS for up to version 7.3 2017-04-29 05:10:21 +09:00