Skip to content

Benchmark 3.5.24 (differentiated) vs 2023.03

Jump to bottom
Ihar Suvorau edited this page Jul 24, 2023 · 2 revisions

Benchmarking results for v3.5.24 (differentiated resources) against the version in Spring 2023

Metric names

Short name Full name
AED Absolute Event Distance
CAR Case Arrival Rate
CED Circadian Event Distribution
RED Relative Event Distribution
CTD Cycle Time Distance
NGD N-Gram Distance (size 2)
NGD(3) N-Gram Distance (size 3)

Delta values for each metric

Negative value means improvement:

comparison

Measurements

name metric distance_2023.03 distance_3.5.24 distance_diff
AC_CRE AED 117.32 211.11126848542963 93.79126848542964
AC_CRE CAR 110.38 263.0452261306533 152.6652261306533
AC_CRE CED 3.11 3.344495659944786 0.23449565994478627
AC_CRE CTD 62.23 69.17085427135679 6.940854271356791
AC_CRE NGD 0.24 0.1773465703971119 -0.06265342960288808
AC_CRE NGD(3) 0.220734506503443
AC_CRE RED 48.19 39.3758570847497 -8.8141429152503
BPIC12 AED 313.3 220.0841002406034 -93.21589975939662
BPIC12 CAR 336.42 289.8471102150538 -46.5728897849462
BPIC12 CED 2.1 2.1990913864695503 0.09909138646955018
BPIC12 CTD 93.45 19.117271505376344 -74.33272849462367
BPIC12 NGD 0.56 0.6323552451934914 0.07235524519349135
BPIC12 NGD(3) 0.7171298216507673
BPIC12 RED 96.82 27.206660231363163 -69.61333976863683
BPIC17 AED 314.92 324.3445534622312 9.424553462231188
BPIC17 CAR 390.04 384.171773318872 -5.8682266811280215
BPIC17 CED 1.65 2.2872823272988203 0.6372823272988204
BPIC17 CTD 102.85 42.03999457700651 -60.810005422993484
BPIC17 NGD 0.37 0.3587432444810845 -0.011256755518915473
BPIC17 NGD(3) 0.5643711366827521
BPIC17 RED 132.31 26.678708330327403 -105.6312916696726
CALL AED 61.76 91.11294627193404 29.352946271934037
CALL CAR 61.68 91.12906205680554 29.449062056805538
CALL CED 4.72 20.259111837903585 15.539111837903587
CALL CTD 8.18 0.0025106366667944 -8.177489363333205
CALL NGD 0.08 0.1268291529751069 0.04682915297510691
CALL NGD(3) 0.1682638268284515
CALL RED 0.0 0.0005309392503037 0.0005309392503037

Raw CSV files with measurements

Configuration

version: 4
common:
  train_log_path: <train_log_path>
  test_log_path: <test_log_path>
  num_final_evaluations: 10
  evaluation_metrics:
    - 3_gram_distance
    - 2_gram_distance
    - absolute_event_distribution
    - relative_event_distribution
    - circadian_event_distribution
    - arrival_event_distribution
    - cycle_time_distribution
  log_ids:
    case: case_id
    activity: activity
    resource: resource
    start_time: start_time
    end_time: end_time
    enabled_time: enabled_time
preprocessing:
  multitasking: false
  enable_time_concurrency_threshold: 0.5
  concurrency_df: 0.75
  concurrency_l2l: 0.9
  concurrency_l1l: 0.9
control_flow:
  optimization_metric: n_gram_distance
  num_iterations: 30
  num_evaluations_per_iteration: 5
  gateway_probabilities: discovery
  discovery_algorithm: sm3
  epsilon:
    - 0.1
    - 1.0
  eta:
    - 0.2
    - 0.6
  replace_or_joins:
    - true
    - false
  prioritize_parallelism:
    - true
    - false
resource_model:
  optimization_metric: circadian_event_distribution
  num_iterations: 40
  num_evaluations_per_iteration: 5
  resource_profiles:
    discovery_type: differentiated
    granularity:
      - 15
      - 60
    confidence:
      - 0.1
      - 1.0
    support:
      - 0.1
      - 1.0
    participation: 0.4
extraneous_activity_delays:
  optimization_metric: relative_event_distribution
  num_iterations: 1

Clone this wiki locally