Benchmark report

Result summary

Best score summary

Useful for visualizing the best solver configuration.

Score level 0
Score level 1

Solver	Total	Average	Standard Deviation	Problem
Solver	Total	Average	Standard Deviation	comp01	comp02	comp03	comp04	comp05	comp06	comp07
Tabu Search 1 !	-10hard/-1632soft	-2hard/-234soft	2.77/202.62	0hard/-15soft 1 Individual runs Run #0 0hard/-7soft 3 Run #1 0hard/-5soft 0 Run #2 0hard/-6soft 1 Run #3 0hard/-6soft 1 Run #4 0hard/-7soft 3 Run #5 0hard/-57soft 5 Average 0hard/-15soft Standard Deviation 0.0/18.94 Best 0hard/-5soft Worst 0hard/-57soft Median 0hard/-7soft	-1hard/-225soft 1 ! Individual runs Run #0 0hard/-243soft 2 Run #1 0hard/-190soft 0 Run #2 -3hard/-247soft 5 ! Run #3 0hard/-217soft 1 Run #4 -2hard/-212soft 4 ! Run #5 -1hard/-240soft 3 ! Average -1hard/-225soft Standard Deviation 1.15/20.37 Best 0hard/-190soft Worst -3hard/-247soft Median -1hard/-240soft	0hard/-211soft 1 Individual runs Run #0 0hard/-192soft 0 Run #1 0hard/-235soft 5 Run #2 0hard/-204soft 1 Run #3 0hard/-209soft 3 Run #4 0hard/-204soft 1 Run #5 0hard/-221soft 4 Average 0hard/-211soft Standard Deviation 0.0/13.77 Best 0hard/-192soft Worst 0hard/-235soft Median 0hard/-209soft	0hard/-122soft 1 Individual runs Run #0 0hard/-121soft 3 Run #1 0hard/-118soft 2 Run #2 0hard/-114soft 1 Run #3 0hard/-136soft 4 Run #4 0hard/-105soft 0 Run #5 0hard/-138soft 5 Average 0hard/-122soft Standard Deviation 0.0/11.70 Best 0hard/-105soft Worst 0hard/-138soft Median 0hard/-121soft	-8hard/-703soft 1 ! Individual runs Run #0 -8hard/-649soft 3 ! Run #1 -8hard/-653soft 4 ! Run #2 -7hard/-666soft 1 ! Run #3 -6hard/-791soft 0 ! Run #4 -9hard/-809soft 5 ! Run #5 -8hard/-646soft 2 ! Average -8hard/-703soft Standard Deviation 1.0/69.53 Best -6hard/-791soft Worst -9hard/-809soft Median -8hard/-649soft	-1hard/-183soft 1 ! Individual runs Run #0 -1hard/-214soft 5 ! Run #1 0hard/-172soft 1 Run #2 -1hard/-182soft 4 ! Run #3 0hard/-170soft 0 Run #4 -1hard/-181soft 3 ! Run #5 -1hard/-174soft 2 ! Average -1hard/-183soft Standard Deviation 0.57/14.92 Best 0hard/-170soft Worst -1hard/-214soft Median -1hard/-181soft	0hard/-173soft 0 Individual runs Run #0 0hard/-167soft 1 Run #1 0hard/-144soft 0 Run #2 0hard/-173soft 3 Run #3 0hard/-168soft 2 Run #4 0hard/-198soft 5 Run #5 0hard/-184soft 4 Average 0hard/-173soft Standard Deviation 0.0/16.57 Best 0hard/-144soft Worst 0hard/-198soft Median 0hard/-173soft
Late Acceptance 0 !	-5hard/-1503soft	-1hard/-215soft	1.41/185.58	0hard/-8soft 0 Individual runs Run #0 0hard/-8soft 2 Run #1 0hard/-7soft 0 Run #2 0hard/-9soft 4 Run #3 0hard/-7soft 0 Run #4 0hard/-8soft 2 Run #5 0hard/-9soft 4 Average 0hard/-8soft Standard Deviation 0.0/0.81 Best 0hard/-7soft Worst 0hard/-9soft Median 0hard/-8soft	-1hard/-186soft 0 ! Individual runs Run #0 -1hard/-201soft 5 ! Run #1 0hard/-174soft 0 Run #2 0hard/-185soft 3 Run #3 0hard/-196soft 4 Run #4 0hard/-182soft 2 Run #5 0hard/-178soft 1 Average -1hard/-186soft Standard Deviation 0.91/9.57 Best 0hard/-174soft Worst -1hard/-201soft Median 0hard/-185soft	0hard/-183soft 0 Individual runs Run #0 0hard/-170soft 0 Run #1 0hard/-175soft 1 Run #2 0hard/-182soft 2 Run #3 0hard/-185soft 4 Run #4 0hard/-197soft 5 Run #5 0hard/-184soft 3 Average 0hard/-183soft Standard Deviation 0.0/8.51 Best 0hard/-170soft Worst 0hard/-197soft Median 0hard/-184soft	0hard/-107soft 0 Individual runs Run #0 0hard/-108soft 3 Run #1 0hard/-107soft 2 Run #2 0hard/-112soft 5 Run #3 0hard/-106soft 1 Run #4 0hard/-111soft 4 Run #5 0hard/-97soft 0 Average 0hard/-107soft Standard Deviation 0.0/4.88 Best 0hard/-97soft Worst 0hard/-112soft Median 0hard/-108soft	-4hard/-643soft 0 ! Individual runs Run #0 0hard/-736soft 1 Run #1 -5hard/-755soft 5 ! Run #2 -5hard/-527soft 2 ! Run #3 -5hard/-695soft 4 ! Run #4 0hard/-485soft 0 Run #5 -5hard/-660soft 3 ! Average -4hard/-643soft Standard Deviation 2.44/102.14 Best 0hard/-485soft Worst -5hard/-755soft Median -5hard/-660soft	0hard/-182soft 0 Individual runs Run #0 0hard/-192soft 4 Run #1 0hard/-172soft 1 Run #2 0hard/-175soft 2 Run #3 0hard/-203soft 5 Run #4 0hard/-166soft 0 Run #5 0hard/-181soft 3 Average 0hard/-182soft Standard Deviation 0.0/12.56 Best 0hard/-166soft Worst 0hard/-203soft Median 0hard/-181soft	0hard/-194soft 1 Individual runs Run #0 0hard/-164soft 0 Run #1 0hard/-202soft 3 Run #2 0hard/-205soft 5 Run #3 0hard/-204soft 4 Run #4 0hard/-190soft 1 Run #5 0hard/-194soft 2 Average 0hard/-194soft Standard Deviation 0.0/14.14 Best 0hard/-164soft Worst 0hard/-205soft Median 0hard/-202soft

Best score scalability summary

Useful for visualizing the scalability of each solver configuration.

Score level 0
Score level 1

Winning score difference summary

Useful for zooming in on the results of the best score summary.

Score level 0
Score level 1

Solver	Total	Average	Problem
Solver	Total	Average	comp01	comp02	comp03	comp04	comp05	comp06	comp07
Tabu Search 1 !	-5hard/-150soft	-1hard/-22soft	0hard/-7soft 1	0hard/-39soft 1 !	0hard/-28soft 1	0hard/-15soft 1	-4hard/-60soft 1 !	-1hard/-1soft 1 !	0hard/0soft 0
Late Acceptance 0 !	0hard/-21soft	0hard/-3soft	0hard/0soft 0	0hard/0soft 0 !	0hard/0soft 0	0hard/0soft 0	0hard/0soft 0 !	0hard/0soft 0	0hard/-21soft 1

Worst score difference percentage summary (ROI)

Useful for visualizing the return on investment (ROI) to decision makers.

Score level 0
Score level 1

Solver	Average	Problem
Solver	Average	comp01	comp02	comp03	comp04	comp05	comp06	comp07
Tabu Search 1 !	0.00%/1.55%	0.00%/0.00% 1	0.00%/0.00% 1 !	0.00%/0.00% 1	0.00%/0.00% 1	0.00%/0.00% 1 !	0.00%/0.00% 1 !	0.00%/10.82% 0
Late Acceptance 0 !	21.43%/14.09%	0.00%/46.67% 0	0.00%/17.33% 0 !	0.00%/13.27% 0	0.00%/12.30% 0	50.00%/8.53% 0 !	100.00%/0.55% 0	0.00%/0.00% 1

Performance summary

Average calculate count summary

Useful for comparing different score calculators and/or score rule implementations (presuming that the solver configurations do not differ otherwise). Also useful to measure the scalability cost of an extra constraint.

Solver	Average	Problem
Solver	Average	comp01	comp02	comp03	comp04	comp05	comp06	comp07
Problem scale	114,256	28,800	113,200	100,400	128,700	49,248	162,450	217,000
Tabu Search 1 !	11,849/s	20,828/s Individual runs Run #0 20,828/s Run #1 21,073/s Run #2 21,328/s Run #3 21,311/s Run #4 21,243/s Run #5 21,218/s	10,688/s Individual runs Run #0 10,513/s Run #1 10,701/s Run #2 10,610/s Run #3 10,663/s Run #4 10,596/s Run #5 10,688/s	11,035/s Individual runs Run #0 10,925/s Run #1 11,173/s Run #2 11,052/s Run #3 11,035/s Run #4 11,113/s Run #5 11,005/s	12,996/s Individual runs Run #0 12,996/s Run #1 13,219/s Run #2 13,235/s Run #3 13,162/s Run #4 13,259/s Run #5 13,138/s	6,491/s Individual runs Run #0 6,491/s Run #1 6,461/s Run #2 6,503/s Run #3 6,407/s Run #4 6,617/s Run #5 6,544/s	10,707/s Individual runs Run #0 10,512/s Run #1 10,663/s Run #2 10,631/s Run #3 10,577/s Run #4 10,707/s Run #5 10,709/s	10,199/s Individual runs Run #0 9,863/s Run #1 10,041/s Run #2 10,199/s Run #3 10,073/s Run #4 9,980/s Run #5 9,983/s
Late Acceptance 0 !	11,619/s	21,143/s Individual runs Run #0 21,128/s Run #1 21,001/s Run #2 21,076/s Run #3 21,010/s Run #4 21,143/s Run #5 21,082/s	10,205/s Individual runs Run #0 10,295/s Run #1 10,062/s Run #2 10,205/s Run #3 10,193/s Run #4 10,172/s Run #5 10,326/s	10,875/s Individual runs Run #0 10,676/s Run #1 10,814/s Run #2 10,801/s Run #3 10,692/s Run #4 10,620/s Run #5 10,875/s	12,893/s Individual runs Run #0 12,893/s Run #1 12,939/s Run #2 12,719/s Run #3 12,981/s Run #4 12,901/s Run #5 12,989/s	6,452/s Individual runs Run #0 6,422/s Run #1 6,276/s Run #2 6,552/s Run #3 6,320/s Run #4 6,540/s Run #5 6,452/s	10,210/s Individual runs Run #0 10,140/s Run #1 10,133/s Run #2 10,151/s Run #3 10,221/s Run #4 10,288/s Run #5 10,210/s	9,560/s Individual runs Run #0 9,570/s Run #1 9,560/s Run #2 9,392/s Run #3 9,157/s Run #4 9,142/s Run #5 9,336/s

Time spent summary

Useful for visualizing the performance of construction heuristics (presuming that no other solver phases are configured).

Solver	Average	Problem
Solver	Average	comp01	comp02	comp03	comp04	comp05	comp06	comp07
Problem scale	114,256	28,800	113,200	100,400	128,700	49,248	162,450	217,000
Tabu Search 1 !	429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000
Late Acceptance 0 !	429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000	429,000 Individual runs Run #0 429,000 Run #1 429,000 Run #2 429,000 Run #3 429,000 Run #4 429,000 Run #5 429,000

Time spent scalability summary

Useful for extrapolating the scalability of construction heuristics (presuming that no other solver phases are configured).

Best score per time spent summary

Useful for visualizing trade-off between the best score versus the time spent for construction heuristics (presuming that no other solver phases are configured).

Score level 0
Score level 1

comp01

Entity count: 160
Variable count: 320
Problem scale: 28,800
Memory usage after loading the inputSolution (before creating the Solver): 14,303,220 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

comp02

Entity count: 283
Variable count: 566
Problem scale: 113,200
Memory usage after loading the inputSolution (before creating the Solver): 14,102,348 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

comp03

Entity count: 251
Variable count: 502
Problem scale: 100,400
Memory usage after loading the inputSolution (before creating the Solver): 13,762,884 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

comp04

Entity count: 286
Variable count: 572
Problem scale: 128,700
Memory usage after loading the inputSolution (before creating the Solver): 13,773,604 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

comp05

Entity count: 152
Variable count: 304
Problem scale: 49,248
Memory usage after loading the inputSolution (before creating the Solver): 13,791,292 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

comp06

Entity count: 361
Variable count: 722
Problem scale: 162,450
Memory usage after loading the inputSolution (before creating the Solver): 13,809,072 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

comp07

Entity count: 434
Variable count: 868
Problem scale: 217,000
Memory usage after loading the inputSolution (before creating the Solver): 13,826,600 bytes on average.

Single Benchmark Runs Score Distribution

Score level 0
Score level 1

Tabu Search 1 !

<solver>
  <environmentMode>PRODUCTION</environmentMode>
  <solutionClass>org.optaplanner.examples.curriculumcourse.domain.CourseSchedule</solutionClass>
  <entityClass>org.optaplanner.examples.curriculumcourse.domain.Lecture</entityClass>
  <scoreDirectorFactory>
    <scoreDefinitionType>HARD_SOFT</scoreDefinitionType>
    <scoreDrl>org/optaplanner/examples/curriculumcourse/solver/curriculumCourseScoreRules.drl</scoreDrl>
  </scoreDirectorFactory>
  <termination>
    <secondsSpentLimit>429</secondsSpentLimit>
  </termination>
  <constructionHeuristic>
    <constructionHeuristicType>FIRST_FIT_DECREASING</constructionHeuristicType>
  </constructionHeuristic>
  <localSearch>
    <unionMoveSelector>
      <changeMoveSelector/>
      <swapMoveSelector>
        <filterClass>org.optaplanner.examples.curriculumcourse.solver.move.DifferentCourseSwapMoveFilter</filterClass>
      </swapMoveSelector>
    </unionMoveSelector>
    <acceptor>
      <entityTabuSize>9</entityTabuSize>
    </acceptor>
    <forager>
      <acceptedCountLimit>900</acceptedCountLimit>
    </forager>
  </localSearch>
</solver>

Late Acceptance 0 !

<solver>
  <environmentMode>PRODUCTION</environmentMode>
  <solutionClass>org.optaplanner.examples.curriculumcourse.domain.CourseSchedule</solutionClass>
  <entityClass>org.optaplanner.examples.curriculumcourse.domain.Lecture</entityClass>
  <scoreDirectorFactory>
    <scoreDefinitionType>HARD_SOFT</scoreDefinitionType>
    <scoreDrl>org/optaplanner/examples/curriculumcourse/solver/curriculumCourseScoreRules.drl</scoreDrl>
  </scoreDirectorFactory>
  <termination>
    <secondsSpentLimit>429</secondsSpentLimit>
  </termination>
  <constructionHeuristic>
    <constructionHeuristicType>FIRST_FIT_DECREASING</constructionHeuristicType>
  </constructionHeuristic>
  <localSearch>
    <unionMoveSelector>
      <changeMoveSelector/>
      <swapMoveSelector>
        <filterClass>org.optaplanner.examples.curriculumcourse.solver.move.DifferentCourseSwapMoveFilter</filterClass>
      </swapMoveSelector>
    </unionMoveSelector>
    <acceptor>
      <lateAcceptanceSize>600</lateAcceptanceSize>
    </acceptor>
    <forager>
      <acceptedCountLimit>4</acceptedCountLimit>
    </forager>
  </localSearch>
</solver>

Name	2015-09-27_215336
Aggregation	false
Failure count	0
Starting timestamp	Sep 27, 2015 9:53:36 PM
Warm up time spent	30,000 ms
Parallel benchmark count / available processors	1 / 8
Benchmark time spent	36,083,574 ms
Environment mode	PRODUCTION
Logging level	debug
Solver ranking class	TotalScoreSolverRankingComparator
VM max memory (as in -Xmx but lower)	7,635,730,432 bytes
OptaPlanner version	Unjarred development snapshot
Java version	Java 1.7.0_79 (Oracle Corporation)
Java VM	Java Java HotSpot(TM) 64-Bit Server VM 24.79-b02 (Oracle Corporation)
Operating system	Linux amd64 4.1.7-200.fc22.x86_64
Report locale	en_US