Conditions:
- 90 subsystems
- I used TOF-0, TOF-1, TOF-2 and TOF-4 VME CPUs. 23/22 daq_rdosoft processes per CPU.
- Water mark was set to 32 kB.
- All 90 sources had the same subevt size (see table)
- Subevent sizes were Gaussian-like smeared
- No writing to hard disk, no rfio.
- net.core.netdev_max_backlog = 10000
- net.core.rmem_max = 4194304 (nettrans.c:openUdp(): requests 1 MB queue)
- EB buffer = 8 MB (x2x2). Cannot go to 16 MB because 16x2x2x90 = 5.6 GB (more than available memory).
Results:
ev rate |
data rate |
subevt size |
disc evt |
cpu evtbuild |
cpu netmem |
load |
buff evtbuild |
buff netmem |
Hz |
MB/sec |
Bytes |
% |
% |
% |
|
% |
% |
1000 |
12 |
140 |
0 |
9 |
5 |
2.3 |
10 |
5 |
1000 |
27 |
270 |
0 |
13 |
9 |
2.3 |
10 |
5 |
1000 |
45 |
530 |
0 |
10 |
17 |
2.3 |
10 |
5 |
1000 |
55 |
640 |
0 |
16 |
22 |
2.5 |
10 |
5 |
1000 |
70 |
820 |
0 |
17 |
27 |
2.7 |
10 |
5 |
1000 |
86 |
1024 |
0 |
22 |
33 |
2.7 |
10 |
5 |
1000 |
103 |
1170 |
0 |
23 |
35 |
2.7 |
10 |
5 |
1000 |
112 |
1270 |
0 |
27 |
43 |
2.7 |
10 |
5 |
1000 |
116 |
1320 |
0 |
27 |
45 |
2.7 |
10 |
5 |
1000 |
120 |
1370 |
70 |
- |
- |
- |
- |
- |
2000 |
25 |
140 |
0 |
16 |
12 |
2.3 |
10 |
5 |
2000 |
46 |
270 |
0 |
21 |
24 |
2.3 |
10 |
5 |
2000 |
91 |
530 |
0 |
26 |
35 |
2.6 |
10 |
5 |
2000 |
110 |
640 |
0 |
34 |
44 |
2.6 |
10 |
5 |
2000 |
120 |
700 |
1 |
35 |
43 |
3.0 |
10 |
5 |
2000 |
130 |
760 |
75 |
- |
- |
- |
- |
- |
3000 |
37 |
140 |
0 |
26 |
19 |
2.2 |
10 |
5 |
3000 |
56 |
220 |
0 |
29 |
20 |
2.5 |
10 |
5 |
3000 |
76 |
280 |
0 |
32 |
24 |
2.5 |
10 |
5 |
3000 |
95 |
370 |
0 |
36 |
39 |
3.5 |
10 |
5 |
3000 |
115 |
450 |
0 |
36 |
45 |
3.6 |
20 |
10 |
3000 |
125 |
500 |
1 |
40 |
44 |
3.6 |
20 |
15 |
3000 |
135 |
550 |
95 |
- |
- |
- |
50 |
50 |
4000 |
50 |
140 |
0 |
35 |
21 |
2.3 |
10 |
5 |
4000 |
62 |
180 |
0 |
36 |
23 |
2.5 |
10 |
5 |
4000 |
76 |
220 |
0 |
43 |
31 |
2.5 |
10 |
5 |
4000 |
88 |
260 |
0 |
43 |
33 |
3.2 |
10 |
5 |
4000 |
101 |
290 |
0 |
48 |
41 |
3.2 |
20 |
15 |
4000 |
114 |
330 |
0 |
48 |
41 |
3.2 |
25 |
20 |
4000 |
127 |
370 |
99 |
- |
- |
- |
100 |
100 |
5000 |
62 |
140 |
0 |
39 |
36 |
2.6 |
15 |
5 |
5000 |
70 |
160 |
0 |
48 |
31 |
2.6 |
15 |
5 |
5000 |
78 |
200 |
0 |
49 |
39 |
2.6 |
15 |
5 |
5000 |
94 |
220 |
0 |
54 |
41 |
2.6 |
20 |
15 |
5000 |
110 |
260 |
0 |
56 |
41 |
2.6 |
20 |
15 |
5000 |
126 |
300 |
80 |
- |
- |
- |
20 |
15 |
6000 |
74 |
140 |
0 |
61 |
27 |
2.9 |
20 |
15 |
6000 |
95 |
180 |
0 |
57 |
41 |
2.9 |
20 |
15 |
6000 |
104 |
200 |
0 |
62 |
38 |
2.9 |
30 |
20 |
6000 |
115 |
220 |
99 |
62 |
38 |
3.3 |
30 |
30 |
--
SergeyYurevich - 08 Feb 2008