Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Measure peak RAM in benchmarks #6995

Merged
merged 2 commits into from
Jul 25, 2024
Merged

Measure peak RAM in benchmarks #6995

merged 2 commits into from
Jul 25, 2024

Conversation

SiarheiFedartsou
Copy link
Member

@SiarheiFedartsou SiarheiFedartsou commented Jul 12, 2024

Yet another small improvement in benchmarks...

Benchmark Results

Benchmark Base PR
alias aliased u32: 1097.65
plain u32: 1094.37
aliased double: 948.365
plain double: 961.812
aliased u32: 1093.78
plain u32: 1094.46
aliased double: 955.535
plain double: 961.899
e2e_match_ch Ops: 43.48 ± 0.12 ops/s. Best: 43.63 ops/s
Total: 3013.14ms ± 8.99ms. Best: 3002.68ms
Min time: 2.06ms ± 0.03ms
Mean time: 23.00ms ± 0.07ms
Median time: 16.98ms ± 0.08ms
95th percentile: 75.98ms ± 0.34ms
99th percentile: 94.06ms ± 0.49ms
Max time: 107.15ms ± 0.94ms
Ops: 43.52 ± 0.10 ops/s. Best: 43.65 ops/s
Total: 3010.14ms ± 7.25ms. Best: 3001.21ms
Min time: 2.04ms ± 0.03ms
Mean time: 22.98ms ± 0.06ms
Median time: 17.04ms ± 0.14ms
95th percentile: 75.05ms ± 0.72ms
99th percentile: 95.61ms ± 0.63ms
Max time: 109.66ms ± 0.71ms
e2e_match_mld Ops: 62.89 ± 0.12 ops/s. Best: 63.03 ops/s
Total: 2082.97ms ± 4.08ms. Best: 2078.40ms
Min time: 1.74ms ± 0.04ms
Mean time: 15.90ms ± 0.03ms
Median time: 8.30ms ± 0.12ms
95th percentile: 53.20ms ± 0.88ms
99th percentile: 62.62ms ± 0.78ms
Max time: 71.17ms ± 2.39ms
Ops: 63.99 ± 0.13 ops/s. Best: 64.19 ops/s
Total: 2047.16ms ± 4.36ms. Best: 2040.74ms
Min time: 1.74ms ± 0.02ms
Mean time: 15.63ms ± 0.03ms
Median time: 8.27ms ± 0.06ms
95th percentile: 52.25ms ± 0.09ms
99th percentile: 60.51ms ± 0.15ms
Max time: 69.33ms ± 0.50ms
e2e_nearest_ch Ops: 871.71 ± 2.88 ops/s. Best: 876.10 ops/s
Total: 1147.14ms ± 3.84ms. Best: 1141.42ms
Min time: 0.98ms ± 0.01ms
Mean time: 1.15ms ± 0.00ms
Median time: 1.06ms ± 0.00ms
95th percentile: 1.59ms ± 0.00ms
99th percentile: 1.64ms ± 0.00ms
Max time: 5.59ms ± 2.53ms
Ops: 873.45 ± 4.49 ops/s. Best: 880.35 ops/s
Total: 1144.95ms ± 6.40ms. Best: 1135.91ms
Min time: 0.97ms ± 0.00ms
Mean time: 1.14ms ± 0.01ms
Median time: 1.06ms ± 0.00ms
95th percentile: 1.58ms ± 0.00ms
99th percentile: 1.64ms ± 0.02ms
Max time: 5.67ms ± 2.63ms
e2e_nearest_mld Ops: 868.98 ± 3.34 ops/s. Best: 875.47 ops/s
Total: 1150.75ms ± 4.56ms. Best: 1142.25ms
Min time: 0.98ms ± 0.00ms
Mean time: 1.15ms ± 0.00ms
Median time: 1.06ms ± 0.00ms
95th percentile: 1.60ms ± 0.00ms
99th percentile: 1.66ms ± 0.04ms
Max time: 6.24ms ± 2.79ms
Ops: 875.78 ± 3.40 ops/s. Best: 880.53 ops/s
Total: 1141.89ms ± 4.42ms. Best: 1135.68ms
Min time: 0.98ms ± 0.00ms
Mean time: 1.14ms ± 0.00ms
Median time: 1.06ms ± 0.00ms
95th percentile: 1.58ms ± 0.00ms
99th percentile: 1.63ms ± 0.01ms
Max time: 5.87ms ± 2.76ms
e2e_route_ch Ops: 371.12 ± 6.66 ops/s. Best: 379.12 ops/s
Total: 2694.31ms ± 51.12ms. Best: 2637.70ms
Min time: 1.20ms ± 0.02ms
Mean time: 2.70ms ± 0.05ms
Median time: 2.70ms ± 0.05ms
95th percentile: 3.55ms ± 0.08ms
99th percentile: 3.94ms ± 0.09ms
Max time: 6.83ms ± 2.65ms
Ops: 375.33 ± 4.95 ops/s. Best: 380.19 ops/s
Total: 2664.39ms ± 38.15ms. Best: 2630.29ms
Min time: 1.18ms ± 0.02ms
Mean time: 2.67ms ± 0.04ms
Median time: 2.68ms ± 0.04ms
95th percentile: 3.50ms ± 0.05ms
99th percentile: 3.90ms ± 0.10ms
Max time: 6.75ms ± 2.63ms
e2e_route_mld Ops: 315.38 ± 0.45 ops/s. Best: 316.17 ops/s
Total: 3170.68ms ± 4.57ms. Best: 3162.89ms
Min time: 1.19ms ± 0.02ms
Mean time: 3.17ms ± 0.00ms
Median time: 3.21ms ± 0.01ms
95th percentile: 4.30ms ± 0.01ms
99th percentile: 4.80ms ± 0.03ms
Max time: 7.49ms ± 2.17ms
Ops: 307.93 ± 1.87 ops/s. Best: 311.51 ops/s
Total: 3248.26ms ± 21.13ms. Best: 3210.13ms
Min time: 1.19ms ± 0.01ms
Mean time: 3.25ms ± 0.02ms
Median time: 3.29ms ± 0.02ms
95th percentile: 4.44ms ± 0.02ms
99th percentile: 4.92ms ± 0.09ms
Max time: 7.45ms ± 2.05ms
e2e_table_ch Ops: 322.81 ± 0.73 ops/s. Best: 323.98 ops/s
Total: 3097.98ms ± 7.06ms. Best: 3086.65ms
Min time: 1.61ms ± 0.02ms
Mean time: 3.10ms ± 0.01ms
Median time: 3.09ms ± 0.02ms
95th percentile: 4.30ms ± 0.01ms
99th percentile: 4.66ms ± 0.07ms
Max time: 8.92ms ± 2.15ms
Ops: 328.45 ± 0.73 ops/s. Best: 329.67 ops/s
Total: 3044.47ms ± 7.11ms. Best: 3033.30ms
Min time: 1.57ms ± 0.01ms
Mean time: 3.04ms ± 0.01ms
Median time: 3.04ms ± 0.01ms
95th percentile: 4.23ms ± 0.02ms
99th percentile: 4.55ms ± 0.06ms
Max time: 8.12ms ± 2.41ms
e2e_table_mld Ops: 110.59 ± 0.41 ops/s. Best: 111.13 ops/s
Total: 9041.40ms ± 33.22ms. Best: 8998.57ms
Min time: 3.63ms ± 0.05ms
Mean time: 9.04ms ± 0.03ms
Median time: 9.00ms ± 0.05ms
95th percentile: 13.86ms ± 0.08ms
99th percentile: 14.49ms ± 0.08ms
Max time: 17.46ms ± 2.50ms
Ops: 110.17 ± 0.24 ops/s. Best: 110.61 ops/s
Total: 9076.93ms ± 20.12ms. Best: 9040.74ms
Min time: 3.67ms ± 0.06ms
Mean time: 9.08ms ± 0.02ms
Median time: 9.04ms ± 0.07ms
95th percentile: 13.89ms ± 0.03ms
99th percentile: 14.60ms ± 0.08ms
Max time: 17.09ms ± 2.40ms
e2e_trip_ch Ops: 102.60 ± 0.55 ops/s. Best: 103.20 ops/s
Total: 9746.91ms ± 52.21ms. Best: 9689.97ms
Min time: 1.45ms ± 0.06ms
Mean time: 9.75ms ± 0.05ms
Median time: 9.16ms ± 0.05ms
95th percentile: 17.71ms ± 0.12ms
99th percentile: 19.55ms ± 0.09ms
Max time: 21.42ms ± 0.20ms
Ops: 101.72 ± 0.81 ops/s. Best: 103.35 ops/s
Total: 9835.47ms ± 73.67ms. Best: 9675.57ms
Min time: 1.44ms ± 0.08ms
Mean time: 9.83ms ± 0.07ms
Median time: 9.27ms ± 0.07ms
95th percentile: 17.89ms ± 0.10ms
99th percentile: 19.83ms ± 0.17ms
Max time: 21.63ms ± 0.35ms
e2e_trip_mld Ops: 59.49 ± 0.56 ops/s. Best: 60.21 ops/s
Total: 16812.74ms ± 159.06ms. Best: 16609.88ms
Min time: 1.58ms ± 0.20ms
Mean time: 16.81ms ± 0.16ms
Median time: 16.28ms ± 0.16ms
95th percentile: 27.60ms ± 0.20ms
99th percentile: 29.82ms ± 0.27ms
Max time: 33.93ms ± 2.85ms
Ops: 58.20 ± 0.29 ops/s. Best: 58.73 ops/s
Total: 17184.34ms ± 85.97ms. Best: 17026.74ms
Min time: 1.68ms ± 0.21ms
Mean time: 17.18ms ± 0.09ms
Median time: 16.67ms ± 0.07ms
95th percentile: 28.27ms ± 0.13ms
99th percentile: 30.58ms ± 0.32ms
Max time: 33.32ms ± 1.07ms
json-render String: 5.68798ms
Stringstream: 9.07002ms
Vector: 6.59109ms
String: 5.63621ms
Stringstream: 9.16011ms
Vector: 6.57013ms
match_ch Default radius:
4.60057ms/req at 82 coordinate
0.0561045ms/coordinate
Radius 10m:
16.1239ms/req at 82 coordinate
0.196633ms/coordinate
Default radius:
4.62109ms/req at 82 coordinate
0.0563547ms/coordinate
Radius 10m:
16.1346ms/req at 82 coordinate
0.196763ms/coordinate
match_mld Default radius:
3.05491ms/req at 82 coordinate
0.0372549ms/coordinate
Radius 10m:
11.0042ms/req at 82 coordinate
0.134198ms/coordinate
Default radius:
2.97406ms/req at 82 coordinate
0.036269ms/coordinate
Radius 10m:
11.0627ms/req at 82 coordinate
0.13491ms/coordinate
osrm_contract Time: 96.98s Peak RAM: 201.95MB Time: 97.11s Peak RAM: 201.95MB
osrm_customize Time: 1.29s Peak RAM: 117.67MB Time: 1.31s Peak RAM: 117.69MB
osrm_extract Time: 11.76s Peak RAM: 424.48MB Time: 11.70s Peak RAM: 431.03MB
osrm_partition Time: 2.14s Peak RAM: 144.95MB Time: 2.08s Peak RAM: 146.87MB
packedvector random write:
std::vector 9837.63 ms
util::packed_vector 73697 ms
slowdown: 7.49134
random read:
std::vector 8457.6 ms
util::packed_vector 30287.8 ms
slowdown: 3.58113
random write:
std::vector 9828.94 ms
util::packed_vector 73661.4 ms
slowdown: 7.49434
random read:
std::vector 8492.83 ms
util::packed_vector 30287 ms
slowdown: 3.56618
random_match_ch 500 matches, default radius
ops: 200.36 ± 0.60 ops/s. best: 200.94ops/s.
total: 284.49 ± 0.86ms. best: 283.66ms.
avg: 4.99 ± 0.02ms
min: 0.14 ± 0.01ms
max: 26.32 ± 0.31ms
p99: 26.32 ± 0.31ms

500 matches, radius=10
ops: 59.44 ± 0.65 ops/s. best: 60.26ops/s.
total: 1076.79 ± 11.18ms. best: 1062.10ms.
avg: 16.82 ± 0.17ms
min: 0.15 ± 0.00ms
max: 248.78 ± 6.81ms
p99: 248.78 ± 6.81ms

500 matches, radius=20
ops: 14.37 ± 0.02 ops/s. best: 14.40ops/s.
total: 4523.68 ± 7.18ms. best: 4512.65ms.
avg: 69.60 ± 0.11ms
min: 0.31 ± 0.00ms
max: 1228.31 ± 2.60ms
p99: 1228.31 ± 2.60ms
500 matches, default radius
ops: 201.56 ± 0.84 ops/s. best: 202.32ops/s.
total: 282.80 ± 1.18ms. best: 281.74ms.
avg: 4.96 ± 0.02ms
min: 0.13 ± 0.01ms
max: 26.21 ± 0.11ms
p99: 26.21 ± 0.11ms

500 matches, radius=10
ops: 59.01 ± 0.10 ops/s. best: 59.09ops/s.
total: 1084.64 ± 1.75ms. best: 1083.14ms.
avg: 16.95 ± 0.03ms
min: 0.15 ± 0.00ms
max: 255.38 ± 1.22ms
p99: 255.38 ± 1.22ms

500 matches, radius=20
ops: 14.14 ± 0.03 ops/s. best: 14.18ops/s.
total: 4596.29 ± 9.02ms. best: 4583.58ms.
avg: 70.71 ± 0.14ms
min: 0.30 ± 0.01ms
max: 1288.74 ± 6.46ms
p99: 1288.74 ± 6.46ms

Peak RAM: 56.293MB
random_match_mld 500 matches, default radius
ops: 301.42 ± 2.30 ops/s. best: 303.71ops/s.
total: 189.12 ± 1.45ms. best: 187.68ms.
avg: 3.32 ± 0.03ms
min: 0.12 ± 0.01ms
max: 19.16 ± 0.25ms
p99: 19.16 ± 0.25ms

500 matches, radius=10
ops: 106.26 ± 0.59 ops/s. best: 107.02ops/s.
total: 602.34 ± 3.33ms. best: 598.02ms.
avg: 9.41 ± 0.05ms
min: 0.14 ± 0.00ms
max: 111.75 ± 0.55ms
p99: 111.75 ± 0.55ms

500 matches, radius=20
ops: 21.56 ± 0.08 ops/s. best: 21.66ops/s.
total: 3015.48 ± 10.99ms. best: 3000.35ms.
avg: 46.39 ± 0.17ms
min: 0.20 ± 0.02ms
max: 584.77 ± 1.96ms
p99: 584.77 ± 1.96ms
500 matches, default radius
ops: 292.16 ± 8.43 ops/s. best: 302.49ops/s.
total: 195.31 ± 5.63ms. best: 188.44ms.
avg: 3.43 ± 0.10ms
min: 0.12 ± 0.01ms
max: 21.80 ± 3.03ms
p99: 21.80 ± 3.03ms

500 matches, radius=10
ops: 106.25 ± 0.27 ops/s. best: 106.70ops/s.
total: 602.36 ± 1.52ms. best: 599.79ms.
avg: 9.41 ± 0.02ms
min: 0.14 ± 0.00ms
max: 111.80 ± 0.43ms
p99: 111.80 ± 0.43ms

500 matches, radius=20
ops: 21.62 ± 0.05 ops/s. best: 21.68ops/s.
total: 3006.49 ± 7.35ms. best: 2998.32ms.
avg: 46.25 ± 0.11ms
min: 0.19 ± 0.01ms
max: 585.31 ± 1.24ms
p99: 585.31 ± 1.24ms

Peak RAM: 51.922MB
random_nearest_ch 10000 nearest, number_of_results=1
ops: 23266.65 ± 56.18 ops/s. best: 23316.47ops/s.
total: 429.80 ± 1.04ms. best: 428.88ms.
avg: 0.04 ± 0.00ms
min: 0.01 ± 0.00ms
max: 0.17 ± 0.06ms
p99: 0.11 ± 0.00ms

10000 nearest, number_of_results=5
ops: 17942.31 ± 18.47 ops/s. best: 17960.76ops/s.
total: 557.34 ± 0.57ms. best: 556.77ms.
avg: 0.06 ± 0.00ms
min: 0.02 ± 0.00ms
max: 0.18 ± 0.04ms
p99: 0.12 ± 0.00ms

10000 nearest, number_of_results=10
ops: 14404.74 ± 88.22 ops/s. best: 14488.12ops/s.
total: 694.25 ± 4.30ms. best: 690.22ms.
avg: 0.07 ± 0.00ms
min: 0.03 ± 0.00ms
max: 0.18 ± 0.02ms
p99: 0.14 ± 0.00ms
10000 nearest, number_of_results=1
ops: 23189.72 ± 106.85 ops/s. best: 23338.91ops/s.
total: 431.24 ± 1.99ms. best: 428.47ms.
avg: 0.04 ± 0.00ms
min: 0.01 ± 0.00ms
max: 0.17 ± 0.05ms
p99: 0.11 ± 0.00ms

10000 nearest, number_of_results=5
ops: 18031.59 ± 12.63 ops/s. best: 18061.90ops/s.
total: 554.58 ± 0.39ms. best: 553.65ms.
avg: 0.06 ± 0.00ms
min: 0.02 ± 0.00ms
max: 0.15 ± 0.01ms
p99: 0.12 ± 0.00ms

10000 nearest, number_of_results=10
ops: 14588.62 ± 10.16 ops/s. best: 14612.02ops/s.
total: 685.47 ± 0.48ms. best: 684.37ms.
avg: 0.07 ± 0.00ms
min: 0.03 ± 0.00ms
max: 0.21 ± 0.06ms
p99: 0.13 ± 0.00ms

Peak RAM: 37.668MB
random_nearest_mld 10000 nearest, number_of_results=1
ops: 22963.51 ± 62.62 ops/s. best: 23050.71ops/s.
total: 435.48 ± 1.19ms. best: 433.83ms.
avg: 0.04 ± 0.00ms
min: 0.01 ± 0.00ms
max: 0.17 ± 0.06ms
p99: 0.11 ± 0.00ms

10000 nearest, number_of_results=5
ops: 17830.10 ± 35.14 ops/s. best: 17874.20ops/s.
total: 560.85 ± 1.15ms. best: 559.47ms.
avg: 0.06 ± 0.00ms
min: 0.02 ± 0.00ms
max: 0.15 ± 0.00ms
p99: 0.12 ± 0.00ms

10000 nearest, number_of_results=10
ops: 14399.39 ± 7.04 ops/s. best: 14407.54ops/s.
total: 694.47 ± 0.35ms. best: 694.08ms.
avg: 0.07 ± 0.00ms
min: 0.03 ± 0.00ms
max: 0.17 ± 0.01ms
p99: 0.14 ± 0.00ms
10000 nearest, number_of_results=1
ops: 23097.96 ± 88.26 ops/s. best: 23212.76ops/s.
total: 432.95 ± 1.66ms. best: 430.80ms.
avg: 0.04 ± 0.00ms
min: 0.01 ± 0.00ms
max: 0.17 ± 0.05ms
p99: 0.11 ± 0.00ms

10000 nearest, number_of_results=5
ops: 18018.53 ± 36.92 ops/s. best: 18053.17ops/s.
total: 554.99 ± 1.14ms. best: 553.92ms.
avg: 0.06 ± 0.00ms
min: 0.02 ± 0.00ms
max: 0.15 ± 0.00ms
p99: 0.12 ± 0.00ms

10000 nearest, number_of_results=10
ops: 14615.59 ± 6.82 ops/s. best: 14629.13ops/s.
total: 684.20 ± 0.32ms. best: 683.57ms.
avg: 0.07 ± 0.00ms
min: 0.03 ± 0.00ms
max: 0.17 ± 0.00ms
p99: 0.13 ± 0.00ms

Peak RAM: 35.043MB
random_route_ch 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
ops: 494.88 ± 4.87 ops/s. best: 506.00ops/s.
total: 1988.63 ± 19.32ms. best: 1944.66ms.
avg: 2.02 ± 0.02ms
min: 0.30 ± 0.00ms
max: 4.08 ± 0.50ms
p99: 3.01 ± 0.10ms

1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
ops: 565.70 ± 4.54 ops/s. best: 571.92ops/s.
total: 1767.88 ± 13.94ms. best: 1748.49ms.
avg: 1.77 ± 0.01ms
min: 0.06 ± 0.00ms
max: 4.45 ± 0.12ms
p99: 3.89 ± 0.05ms

1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
ops: 980.24 ± 11.45 ops/s. best: 997.80ops/s.
total: 1004.01 ± 11.70ms. best: 986.17ms.
avg: 1.02 ± 0.01ms
min: 0.26 ± 0.00ms
max: 1.76 ± 0.06ms
p99: 1.51 ± 0.02ms

1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
ops: 1035.07 ± 11.03 ops/s. best: 1059.12ops/s.
total: 966.26 ± 10.18ms. best: 944.18ms.
avg: 0.97 ± 0.01ms
min: 0.04 ± 0.00ms
max: 2.96 ± 0.04ms
p99: 2.31 ± 0.11ms
1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
ops: 546.47 ± 1.46 ops/s. best: 548.07ops/s.
total: 1800.67 ± 4.98ms. best: 1795.41ms.
avg: 1.83 ± 0.01ms
min: 0.30 ± 0.00ms
max: 3.12 ± 0.32ms
p99: 2.61 ± 0.04ms

1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
ops: 621.89 ± 0.55 ops/s. best: 622.52ops/s.
total: 1608.02 ± 1.42ms. best: 1606.37ms.
avg: 1.61 ± 0.00ms
min: 0.06 ± 0.01ms
max: 4.97 ± 0.03ms
p99: 3.57 ± 0.02ms

1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
ops: 1071.36 ± 1.39 ops/s. best: 1073.06ops/s.
total: 918.46 ± 1.21ms. best: 917.00ms.
avg: 0.93 ± 0.00ms
min: 0.26 ± 0.00ms
max: 1.53 ± 0.01ms
p99: 1.31 ± 0.01ms

1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
ops: 1162.73 ± 1.09 ops/s. best: 1164.93ops/s.
total: 860.04 ± 0.82ms. best: 858.42ms.
avg: 0.86 ± 0.00ms
min: 0.04 ± 0.00ms
max: 4.11 ± 0.02ms
p99: 2.12 ± 0.01ms

Peak RAM: 99.012MB
random_route_mld 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
ops: 243.56 ± 2.08 ops/s. best: 246.55ops/s.
total: 4040.48 ± 34.70ms. best: 3991.14ms.
avg: 4.11 ± 0.04ms
min: 0.30 ± 0.00ms
max: 8.92 ± 0.13ms
p99: 6.92 ± 0.05ms

1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
ops: 233.33 ± 2.22 ops/s. best: 236.53ops/s.
total: 4286.14 ± 40.96ms. best: 4227.82ms.
avg: 4.29 ± 0.04ms
min: 0.05 ± 0.00ms
max: 10.97 ± 1.46ms
p99: 8.91 ± 0.19ms

1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
ops: 325.80 ± 0.60 ops/s. best: 326.92ops/s.
total: 3020.31 ± 5.54ms. best: 3009.88ms.
avg: 3.07 ± 0.01ms
min: 0.28 ± 0.00ms
max: 7.30 ± 0.06ms
p99: 5.30 ± 0.06ms

1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
ops: 296.92 ± 7.40 ops/s. best: 309.08ops/s.
total: 3370.56 ± 83.67ms. best: 3235.40ms.
avg: 3.37 ± 0.08ms
min: 0.04 ± 0.00ms
max: 7.37 ± 0.18ms
p99: 6.71 ± 0.15ms
1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
ops: 260.62 ± 0.74 ops/s. best: 261.38ops/s.
total: 3775.59 ± 11.04ms. best: 3764.57ms.
avg: 3.84 ± 0.01ms
min: 0.29 ± 0.00ms
max: 8.44 ± 0.05ms
p99: 6.43 ± 0.06ms

1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
ops: 251.89 ± 0.36 ops/s. best: 252.36ops/s.
total: 3970.06 ± 5.83ms. best: 3962.61ms.
avg: 3.97 ± 0.01ms
min: 0.05 ± 0.00ms
max: 9.19 ± 0.29ms
p99: 8.22 ± 0.05ms

1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
ops: 338.65 ± 3.02 ops/s. best: 341.20ops/s.
total: 2906.03 ± 26.22ms. best: 2883.92ms.
avg: 2.95 ± 0.03ms
min: 0.27 ± 0.00ms
max: 7.15 ± 0.08ms
p99: 5.14 ± 0.09ms

1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
ops: 305.02 ± 5.14 ops/s. best: 310.05ops/s.
total: 3279.85 ± 56.64ms. best: 3225.26ms.
avg: 3.28 ± 0.06ms
min: 0.04 ± 0.00ms
max: 7.18 ± 0.26ms
p99: 6.53 ± 0.15ms

Peak RAM: 86.980MB
random_table_ch 250 tables, 3 coordinates
ops: 1434.20 ± 12.28 ops/s. best: 1445.95ops/s.
total: 174.33 ± 1.51ms. best: 172.90ms.
avg: 0.70 ± 0.01ms
min: 0.46 ± 0.01ms
max: 1.05 ± 0.18ms
p99: 0.89 ± 0.04ms

250 tables, 25 coordinates
ops: 170.58 ± 0.23 ops/s. best: 170.80ops/s.
total: 1465.57 ± 1.94ms. best: 1463.71ms.
avg: 5.86 ± 0.01ms
min: 5.09 ± 0.01ms
max: 6.48 ± 0.03ms
p99: 6.39 ± 0.04ms

250 tables, 50 coordinates
ops: 83.79 ± 0.18 ops/s. best: 84.06ops/s.
total: 2983.75 ± 6.56ms. best: 2974.16ms.
avg: 11.93 ± 0.03ms
min: 11.04 ± 0.02ms
max: 13.17 ± 0.08ms
p99: 12.82 ± 0.07ms
250 tables, 3 coordinates
ops: 1465.61 ± 12.52 ops/s. best: 1477.55ops/s.
total: 170.59 ± 1.47ms. best: 169.20ms.
avg: 0.68 ± 0.01ms
min: 0.45 ± 0.01ms
max: 1.03 ± 0.23ms
p99: 0.88 ± 0.04ms

250 tables, 25 coordinates
ops: 175.66 ± 0.66 ops/s. best: 176.20ops/s.
total: 1423.22 ± 5.41ms. best: 1418.84ms.
avg: 5.69 ± 0.02ms
min: 4.79 ± 0.01ms
max: 7.03 ± 1.04ms
p99: 6.70 ± 0.71ms

250 tables, 50 coordinates
ops: 86.97 ± 0.04 ops/s. best: 87.02ops/s.
total: 2874.53 ± 1.35ms. best: 2872.85ms.
avg: 11.50 ± 0.01ms
min: 10.37 ± 0.02ms
max: 12.94 ± 0.30ms
p99: 12.50 ± 0.10ms

Peak RAM: 64.168MB
random_table_mld 250 tables, 3 coordinates
ops: 331.58 ± 1.48 ops/s. best: 333.31ops/s.
total: 753.98 ± 3.39ms. best: 750.05ms.
avg: 3.02 ± 0.01ms
min: 2.49 ± 0.01ms
max: 3.91 ± 0.25ms
p99: 3.68 ± 0.06ms

250 tables, 25 coordinates
ops: 36.67 ± 0.05 ops/s. best: 36.79ops/s.
total: 6817.77 ± 8.92ms. best: 6795.39ms.
avg: 27.27 ± 0.04ms
min: 25.48 ± 0.13ms
max: 33.96 ± 4.95ms
p99: 29.60 ± 0.26ms

250 tables, 50 coordinates
ops: 17.41 ± 0.07 ops/s. best: 17.51ops/s.
total: 14361.21 ± 55.31ms. best: 14281.27ms.
avg: 57.44 ± 0.22ms
min: 54.75 ± 0.20ms
max: 66.77 ± 6.83ms
p99: 60.34 ± 0.53ms
250 tables, 3 coordinates
ops: 336.92 ± 1.07 ops/s. best: 337.81ops/s.
total: 742.04 ± 2.37ms. best: 740.06ms.
avg: 2.97 ± 0.01ms
min: 2.48 ± 0.01ms
max: 3.85 ± 0.21ms
p99: 3.52 ± 0.05ms

250 tables, 25 coordinates
ops: 37.44 ± 0.04 ops/s. best: 37.49ops/s.
total: 6678.16 ± 6.84ms. best: 6668.29ms.
avg: 26.71 ± 0.03ms
min: 25.15 ± 0.05ms
max: 31.48 ± 2.29ms
p99: 28.69 ± 0.13ms

250 tables, 50 coordinates
ops: 17.68 ± 0.07 ops/s. best: 17.76ops/s.
total: 14137.05 ± 54.04ms. best: 14079.41ms.
avg: 56.55 ± 0.22ms
min: 54.24 ± 0.13ms
max: 66.02 ± 6.00ms
p99: 59.47 ± 0.82ms

Peak RAM: 66.211MB
random_trip_ch 250 trips, 3 coordinates
ops: 506.28 ± 4.35 ops/s. best: 511.80ops/s.
total: 493.85 ± 4.25ms. best: 488.47ms.
avg: 1.98 ± 0.02ms
min: 1.10 ± 0.03ms
max: 2.72 ± 0.34ms
p99: 2.51 ± 0.06ms

250 trips, 5 coordinates
ops: 332.27 ± 2.86 ops/s. best: 336.57ops/s.
total: 752.47 ± 6.39ms. best: 742.78ms.
avg: 3.01 ± 0.03ms
min: 1.99 ± 0.05ms
max: 3.80 ± 0.13ms
p99: 3.68 ± 0.07ms
250 trips, 3 coordinates
ops: 519.33 ± 3.48 ops/s. best: 522.69ops/s.
total: 481.42 ± 3.26ms. best: 478.30ms.
avg: 1.93 ± 0.01ms
min: 1.13 ± 0.03ms
max: 2.66 ± 0.40ms
p99: 2.41 ± 0.11ms

250 trips, 5 coordinates
ops: 345.97 ± 0.62 ops/s. best: 346.71ops/s.
total: 722.61 ± 1.31ms. best: 721.07ms.
avg: 2.89 ± 0.01ms
min: 1.97 ± 0.00ms
max: 3.54 ± 0.06ms
p99: 3.46 ± 0.01ms

Peak RAM: 81.898MB
random_trip_mld 250 trips, 3 coordinates
ops: 163.74 ± 0.60 ops/s. best: 164.49ops/s.
total: 1526.80 ± 5.46ms. best: 1519.89ms.
avg: 6.11 ± 0.02ms
min: 3.62 ± 0.05ms
max: 8.35 ± 0.37ms
p99: 7.94 ± 0.11ms

250 trips, 5 coordinates
ops: 107.01 ± 0.97 ops/s. best: 108.87ops/s.
total: 2336.49 ± 20.77ms. best: 2296.37ms.
avg: 9.35 ± 0.08ms
min: 6.65 ± 0.05ms
max: 11.72 ± 0.37ms
p99: 11.28 ± 0.22ms
250 trips, 3 coordinates
ops: 174.56 ± 0.90 ops/s. best: 175.80ops/s.
total: 1432.21 ± 7.38ms. best: 1422.05ms.
avg: 5.73 ± 0.03ms
min: 3.48 ± 0.02ms
max: 7.66 ± 0.58ms
p99: 7.18 ± 0.16ms

250 trips, 5 coordinates
ops: 112.28 ± 1.27 ops/s. best: 114.16ops/s.
total: 2227.01 ± 25.12ms. best: 2189.99ms.
avg: 8.91 ± 0.10ms
min: 6.52 ± 0.02ms
max: 11.98 ± 1.49ms
p99: 10.67 ± 0.36ms

Peak RAM: 76.148MB
route_ch 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
421.736ms
0.421736ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
510.922ms
0.510922ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
147.728ms
0.147728ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
130.479ms
0.130479ms/req
1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
419.19ms
0.41919ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
504.588ms
0.504588ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
147.185ms
0.147185ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
130.711ms
0.130711ms/req
route_mld 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
569.763ms
0.569763ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
712.965ms
0.712965ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
292.168ms
0.292168ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
317.38ms
0.31738ms/req
1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
568.564ms
0.568564ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
712.704ms
0.712704ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
283.721ms
0.283721ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
315.718ms
0.315718ms/req
rtree 1 result:
192.242ms -> 0.0192242 ms/query
10 results:
227.739ms -> 0.0227739 ms/query
1 result:
194.139ms -> 0.0194139 ms/query
10 results:
229.201ms -> 0.0229201 ms/query

@SiarheiFedartsou SiarheiFedartsou merged commit 7802f86 into master Jul 25, 2024
22 checks passed
@SiarheiFedartsou SiarheiFedartsou deleted the sf-peak-ram branch July 25, 2024 19:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant