Benchmark report
Summary
Result summary
Best score summary
Useful for visualizing the best solver configuration.
| Solver | Total | Average | Standard Deviation | Problem | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| exam_comp_set1 | exam_comp_set2 | exam_comp_set3 | exam_comp_set4 | exam_comp_set5 | exam_comp_set6 | exam_comp_set7 | exam_comp_set8 | ||||
| Tabu Search (Phreak (Drools 6.0)) 0 | -157hard/-97315soft | -20hard/-12165soft | 33.55/10865.75 | 0hard/-5965soft 0 | 0hard/-608soft 0 | -100hard/-12715soft 0 ! | -5hard/-30206soft 1 ! | 0hard/-3799soft 0 | -1hard/-29945soft 0 ! | -45hard/-5032soft 0 ! | -6hard/-9045soft 0 ! |
| Tabu Search (ReteOO (Drools 6.0)) 1 | -157hard/-97517soft | -20hard/-12190soft | 33.55/10832.56 | 0hard/-6090soft 1 | 0hard/-613soft 1 | -100hard/-12804soft 1 ! | -5hard/-30110soft 0 ! | 0hard/-3800soft 1 | -1hard/-29945soft 0 ! | -45hard/-5064soft 1 ! | -6hard/-9091soft 1 ! |
Best score scalability summary
Useful for visualizing the scalability of each solver configuration.
Winning score difference summary
Useful for zooming in on the results of the best score summary.
| Solver | Total | Average | Problem | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| exam_comp_set1 | exam_comp_set2 | exam_comp_set3 | exam_comp_set4 | exam_comp_set5 | exam_comp_set6 | exam_comp_set7 | exam_comp_set8 | |||
| Tabu Search (Phreak (Drools 6.0)) 0 | 0hard/-96soft | 0hard/-12soft | 0hard/0soft 0 | 0hard/0soft 0 | 0hard/0soft 0 ! | 0hard/-96soft 1 ! | 0hard/0soft 0 | 0hard/0soft 0 ! | 0hard/0soft 0 ! | 0hard/0soft 0 ! |
| Tabu Search (ReteOO (Drools 6.0)) 1 | 0hard/-298soft | 0hard/-38soft | 0hard/-125soft 1 | 0hard/-5soft 1 | 0hard/-89soft 1 ! | 0hard/0soft 0 ! | 0hard/-1soft 1 | 0hard/0soft 0 ! | 0hard/-32soft 1 ! | 0hard/-46soft 1 ! |
Worst score difference percentage summary (ROI)
Useful for visualizing the return on investment (ROI) to decision makers.
| Solver | Average | Problem | |||||||
|---|---|---|---|---|---|---|---|---|---|
| exam_comp_set1 | exam_comp_set2 | exam_comp_set3 | exam_comp_set4 | exam_comp_set5 | exam_comp_set6 | exam_comp_set7 | exam_comp_set8 | ||
| Tabu Search (Phreak (Drools 6.0)) 0 | 0.00%/0.59% | 0.00%/2.05% 0 | 0.00%/0.82% 0 | 0.00%/0.70% 0 ! | 0.00%/0.00% 1 ! | 0.00%/0.03% 0 | 0.00%/0.00% 0 ! | 0.00%/0.63% 0 ! | 0.00%/0.51% 0 ! |
| Tabu Search (ReteOO (Drools 6.0)) 1 | 0.00%/0.04% | 0.00%/0.00% 1 | 0.00%/0.00% 1 | 0.00%/0.00% 1 ! | 0.00%/0.32% 0 ! | 0.00%/0.00% 1 | 0.00%/0.00% 0 ! | 0.00%/0.00% 1 ! | 0.00%/0.00% 1 ! |
Performance summary
Average calculate count summary
Useful for comparing different score calculators and/or score rule implementations (presuming that the solver configurations do not differ otherwise). Also useful to measure the scalability cost of an extra constraint.
| Solver | Average | Problem | |||||||
|---|---|---|---|---|---|---|---|---|---|
| exam_comp_set1 | exam_comp_set2 | exam_comp_set3 | exam_comp_set4 | exam_comp_set5 | exam_comp_set6 | exam_comp_set7 | exam_comp_set8 | ||
| Problem scale | 676,436 | 229,446 | 1,705,200 | 1,613,952 | 5,733 | 128,268 | 30,976 | 1,315,200 | 382,720 |
| Tabu Search (Phreak (Drools 6.0)) 0 | 4,535/s | 3,648/s | 6,279/s | 3,519/s | 2,619/s | 7,590/s | 4,092/s | 4,237/s | 4,296/s |
| Tabu Search (ReteOO (Drools 6.0)) 1 | 3,726/s | 2,798/s | 4,941/s | 2,785/s | 2,635/s | 6,731/s | 3,173/s | 3,312/s | 3,434/s |
Time spend summary
Useful for visualizing the performance of construction heuristics (presuming that no other solver phases are configured).
| Solver | Average | Problem | |||||||
|---|---|---|---|---|---|---|---|---|---|
| exam_comp_set1 | exam_comp_set2 | exam_comp_set3 | exam_comp_set4 | exam_comp_set5 | exam_comp_set6 | exam_comp_set7 | exam_comp_set8 | ||
| Problem scale | 676,436 | 229,446 | 1,705,200 | 1,613,952 | 5,733 | 128,268 | 30,976 | 1,315,200 | 382,720 |
| Tabu Search (Phreak (Drools 6.0)) 0 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 |
| Tabu Search (ReteOO (Drools 6.0)) 1 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 | 429,000 |
Time spend scalability summary
Useful for extrapolating the scalability of construction heuristics (presuming that no other solver phases are configured).
Best score per time spend summary
Useful for visualizing trade-off between the best score versus the time spend for construction heuristics (presuming that no other solver phases are configured).
Problem benchmarks
exam_comp_set1
exam_comp_set2
exam_comp_set3
exam_comp_set4
exam_comp_set5
exam_comp_set6
exam_comp_set7
exam_comp_set8
Solver benchmarks
Tabu Search (Phreak (Drools 6.0)) 0
<solver>
<solutionClass>org.optaplanner.examples.examination.domain.Examination</solutionClass>
<planningEntityClass>org.optaplanner.examples.examination.domain.Exam</planningEntityClass>
<scoreDirectorFactory>
<scoreDefinitionType>HARD_SOFT</scoreDefinitionType>
<scoreDrl>/org/optaplanner/examples/examination/solver/examinationScoreRules.drl</scoreDrl>
</scoreDirectorFactory>
<termination>
<maximumSecondsSpend>429</maximumSecondsSpend>
</termination>
<customSolverPhase>
<customSolverPhaseCommandClass>org.optaplanner.examples.examination.solver.solution.initializer.ExaminationSolutionInitializer</customSolverPhaseCommandClass>
</customSolverPhase>
<localSearch>
<unionMoveSelector>
<cacheType>PHASE</cacheType>
<selectionOrder>SHUFFLED</selectionOrder>
<moveListFactory>
<moveListFactoryClass>org.optaplanner.examples.examination.solver.move.factory.PeriodChangeMoveFactory</moveListFactoryClass>
</moveListFactory>
<moveListFactory>
<moveListFactoryClass>org.optaplanner.examples.examination.solver.move.factory.RoomChangeMoveFactory</moveListFactoryClass>
</moveListFactory>
<moveListFactory>
<moveListFactoryClass>org.optaplanner.examples.examination.solver.move.factory.ExamSwapMoveFactory</moveListFactoryClass>
</moveListFactory>
</unionMoveSelector>
<acceptor>
<entityTabuSize>10</entityTabuSize>
</acceptor>
<forager>
<acceptedCountLimit>2000</acceptedCountLimit>
</forager>
</localSearch>
</solver>
Tabu Search (ReteOO (Drools 6.0)) 1
<solver>
<solutionClass>org.optaplanner.examples.examination.domain.Examination</solutionClass>
<planningEntityClass>org.optaplanner.examples.examination.domain.Exam</planningEntityClass>
<scoreDirectorFactory>
<scoreDefinitionType>HARD_SOFT</scoreDefinitionType>
<scoreDrl>/org/optaplanner/examples/examination/solver/examinationScoreRules.drl</scoreDrl>
</scoreDirectorFactory>
<termination>
<maximumSecondsSpend>429</maximumSecondsSpend>
</termination>
<customSolverPhase>
<customSolverPhaseCommandClass>org.optaplanner.examples.examination.solver.solution.initializer.ExaminationSolutionInitializer</customSolverPhaseCommandClass>
</customSolverPhase>
<localSearch>
<unionMoveSelector>
<cacheType>PHASE</cacheType>
<selectionOrder>SHUFFLED</selectionOrder>
<moveListFactory>
<moveListFactoryClass>org.optaplanner.examples.examination.solver.move.factory.PeriodChangeMoveFactory</moveListFactoryClass>
</moveListFactory>
<moveListFactory>
<moveListFactoryClass>org.optaplanner.examples.examination.solver.move.factory.RoomChangeMoveFactory</moveListFactoryClass>
</moveListFactory>
<moveListFactory>
<moveListFactoryClass>org.optaplanner.examples.examination.solver.move.factory.ExamSwapMoveFactory</moveListFactoryClass>
</moveListFactory>
</unionMoveSelector>
<acceptor>
<entityTabuSize>10</entityTabuSize>
</acceptor>
<forager>
<acceptedCountLimit>2000</acceptedCountLimit>
</forager>
</localSearch>
</solver>
Benchmark information
| Name | 2014-01-23_114458 |
|---|---|
| Aggregation | true |
| startingTimestamp | Jan 23, 2014 11:44:58 AM |
| warmUpTimeMillisSpend | 30,000 ms |
| parallelBenchmarkCount / availableProcessors | 2 / 4 |
| benchmarkTimeMillisSpend | ms |
| failureCount | 0 |
| VM max memory (as in -Xmx but lower) | 1,431,699,456 bytes |
| Operating system | Linux i386 3.2.0-57-generic-pae |
| Java version | Java 1.7.0_25 (Oracle Corporation) |
| Java VM | Java OpenJDK Server VM 23.7-b01 (Oracle Corporation) |
| OptaPlanner version | Unjarred development snapshot |
| Report locale | en_US |