The wait-time was determined based on a rough calculation that we made. It is
important to mention that some intelligence can be employed to dynamically
calculate this wait-time.
o Once a batch of four indexer instances were done, their produced four mini
searchable collections would then be merged into a single intermediate searchable
collection using the Verity merging tool.
o Once all five batches of the indexer instances were done (i.e., the 20 indexer
instances were done), the merging tool would merge the five intermediate searchable
collections into a single large one.
The solution as described above worked well. The overall indexing time of the 12 million
records went from 96 hours down to 16 hours. Further tuning of the solution could have
been performed to reduce that time to meet the required level of 10 hours. The above project
leads me to believe that:
??? Reliability of the indexing tool depends on the reliability of the indexing solution that
is built around it (i.e., its wrapper).
??? Reliability of the indexing tool also depends on the stability of the operating system
and the database server.
In summary, the previous experiences conclude that reliability of software systems has to do
with: (i) the reliability of the infrastructure, servers, and integrated components that compose
these systems, and (ii) the skills and the quality of the people who developed the system.
Pages:
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28