Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework workon #684

Merged
merged 198 commits into from
Jan 28, 2022
Merged
Show file tree
Hide file tree
Changes from 189 commits
Commits
Show all changes
198 commits
Select commit Hold shift + click to select a range
6b2ff76
add waitone
Delaunay Oct 19, 2021
3c16285
-
Delaunay Oct 20, 2021
f3f75f7
-
Delaunay Oct 26, 2021
f5d60e4
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Oct 26, 2021
0b67965
-
Delaunay Oct 26, 2021
00a56be
Add multiprocess backend
Delaunay Oct 26, 2021
9061846
-
Delaunay Oct 26, 2021
036881c
Add multiprocess backend
Delaunay Oct 26, 2021
e2d3bdd
Add multiprocess backend
Delaunay Oct 26, 2021
b060610
Add multiprocess backend
Delaunay Oct 26, 2021
621576b
-
Delaunay Nov 1, 2021
88366af
-
Delaunay Nov 2, 2021
d6912a8
-
Delaunay Nov 2, 2021
3369298
-
Delaunay Nov 2, 2021
971156b
-
Delaunay Nov 15, 2021
df83a69
Merge branch 'develop' of github.com:Epistimio/orion into parallel
Delaunay Nov 15, 2021
4fae22b
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Nov 15, 2021
e5b6e6c
-
Delaunay Nov 15, 2021
6e474ef
Create a runner for the sample-dispatch logic
Delaunay Nov 15, 2021
019824c
-
Delaunay Nov 15, 2021
93f11f9
-
Delaunay Nov 15, 2021
c64fbeb
Fix time.clock() for python 3.8 was deprecated since 3.3
Delaunay Nov 15, 2021
6e057c4
-
Delaunay Nov 15, 2021
e22f960
-
Delaunay Nov 16, 2021
6f8509e
-
Delaunay Nov 17, 2021
8bb8818
-
Delaunay Nov 17, 2021
da9be96
-
Delaunay Nov 17, 2021
c522dda
-
Delaunay Nov 17, 2021
af2f13c
-
Delaunay Nov 17, 2021
a969c45
-
Delaunay Nov 17, 2021
1fda314
-
Delaunay Nov 18, 2021
628da1a
-
Delaunay Nov 18, 2021
b242de4
Make Pool worker catch keyboard interrupts
Delaunay Nov 18, 2021
a55e69e
Better exception handling
Delaunay Nov 18, 2021
bcc5725
Add SIGTERM handler
Delaunay Nov 18, 2021
50267d8
0
Delaunay Nov 18, 2021
131d6ed
-
Delaunay Nov 19, 2021
5b3ff4b
-
Delaunay Nov 19, 2021
289cbff
Rerun failures
Delaunay Nov 22, 2021
e1c22b1
no parallel-mode
Delaunay Nov 22, 2021
d13b907
add concurrency=multiprocessing
Delaunay Nov 22, 2021
3c9718c
use tox.ini for coverage config
Delaunay Nov 22, 2021
1a4abb5
track workers
Delaunay Nov 22, 2021
26d5b96
randomize test order
Delaunay Nov 22, 2021
c4f0665
Shuffle order
Delaunay Nov 22, 2021
4a8e82d
-
Delaunay Nov 22, 2021
7b24d23
split functional and unittests
Delaunay Nov 22, 2021
a2cb6a9
-
Delaunay Nov 23, 2021
91d264d
-
Delaunay Nov 23, 2021
821b65e
Use threadpool
Delaunay Nov 23, 2021
6c88d9a
Enable backend switch
Delaunay Nov 23, 2021
7cac1d3
-
Delaunay Nov 23, 2021
6d7eda2
-
Delaunay Nov 23, 2021
cb3567b
-
Delaunay Nov 23, 2021
3c9f84c
-
Delaunay Nov 23, 2021
e495889
-
Delaunay Nov 23, 2021
4edd342
-
Delaunay Nov 23, 2021
ed4529b
-
Delaunay Nov 23, 2021
6c3d836
-
Delaunay Nov 23, 2021
ef029de
-
Delaunay Nov 23, 2021
31f0784
-
Delaunay Nov 23, 2021
21978d2
Merge branch 'develop' of github.com:Epistimio/orion into parallel
Delaunay Nov 24, 2021
074aac2
-
Delaunay Nov 24, 2021
2ae2ccd
-
Delaunay Nov 24, 2021
4346ad6
-
Delaunay Nov 24, 2021
7c116ae
-
Delaunay Nov 24, 2021
45294bc
-
Delaunay Nov 24, 2021
ed9200f
-
Delaunay Nov 24, 2021
0abf681
-
Delaunay Nov 24, 2021
d281ce6
-
Delaunay Nov 24, 2021
2360c97
-
Delaunay Nov 24, 2021
3a3d5bb
-
Delaunay Nov 25, 2021
6072fa2
-
Delaunay Nov 25, 2021
a6c86cb
-
Delaunay Nov 25, 2021
122ca75
-
Delaunay Nov 25, 2021
2dcae67
-
Delaunay Nov 25, 2021
7038aaa
-
Delaunay Nov 25, 2021
e890a23
-
Delaunay Nov 25, 2021
64d5103
-
Delaunay Nov 25, 2021
3bff018
-
Delaunay Nov 25, 2021
ddebefb
-
Delaunay Nov 25, 2021
f5e6c44
-
Delaunay Nov 25, 2021
fc84acd
-
Delaunay Nov 29, 2021
97b04ce
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Nov 29, 2021
13ecfbc
-
Delaunay Nov 29, 2021
5c1e394
-
Delaunay Nov 29, 2021
25239a2
-
Delaunay Nov 29, 2021
f66750e
-
Delaunay Nov 29, 2021
54a53fa
-
Delaunay Nov 29, 2021
ea5de5e
Merge branch 'develop' of github.com:Epistimio/orion into parallel
Delaunay Nov 29, 2021
f1cdf1f
-
Delaunay Nov 29, 2021
87d45cb
-
Delaunay Nov 30, 2021
1b5dd63
Fix tests
Delaunay Nov 30, 2021
6aafd41
black & isort
Delaunay Nov 30, 2021
c15f4c4
add ReservationRaceCondition test
Delaunay Nov 30, 2021
0ca6088
use spawn instead of fork
Delaunay Nov 30, 2021
d202c7e
use fork
Delaunay Nov 30, 2021
c4d27ff
Soft shutdown
Delaunay Nov 30, 2021
ef5a201
Soft shutdown
Delaunay Nov 30, 2021
7647a15
restore CI
Delaunay Nov 30, 2021
ce0c4b7
Pyling
Delaunay Nov 30, 2021
1ef2313
-
Delaunay Nov 30, 2021
09fefdb
Merge branch 'develop' of github.com:Epistimio/orion into parallel
Delaunay Dec 1, 2021
94238e7
-
Delaunay Dec 1, 2021
ccbf1b9
Update src/orion/client/experiment.py
Delaunay Dec 7, 2021
07f11ac
Update src/orion/core/utils/exceptions.py
Delaunay Dec 7, 2021
0de56d7
Update src/orion/core/worker/consumer.py
Delaunay Dec 7, 2021
56a7d6b
Update src/orion/executor/base.py
Delaunay Dec 7, 2021
b597387
Update src/orion/executor/multiprocess_backend.py
Delaunay Dec 7, 2021
d421582
Update src/orion/executor/multiprocess_backend.py
Delaunay Dec 7, 2021
04e5736
review
Delaunay Dec 7, 2021
a1d11ec
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Dec 7, 2021
9864da0
Add runner test
Delaunay Dec 7, 2021
8f6ac7c
Add testing for should_sample
Delaunay Dec 7, 2021
0f50794
add more cases for test_should_sample
Delaunay Dec 7, 2021
abddf25
-
Delaunay Dec 7, 2021
61cd957
-
Delaunay Dec 7, 2021
1b32c48
-
Delaunay Dec 7, 2021
4133de7
-
Delaunay Dec 7, 2021
96b3be4
-
Delaunay Dec 13, 2021
d5abb80
Wait once
Delaunay Dec 14, 2021
9da5b73
Limit worker used with pool_size
Delaunay Dec 14, 2021
0c3a24c
add pool size test
Delaunay Dec 14, 2021
3a79ed1
Update src/orion/client/experiment.py
Delaunay Dec 14, 2021
107ef47
Update src/orion/client/runner.py
Delaunay Dec 14, 2021
3c7ecd7
Review
Delaunay Dec 14, 2021
66b9ce4
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Dec 14, 2021
24cd140
Update tests/unittests/client/test_runner.py
Delaunay Dec 17, 2021
a7388e4
-
Delaunay Jan 6, 2022
59731ee
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Jan 6, 2022
23c86c6
Update tests/unittests/client/test_runner.py
Delaunay Jan 6, 2022
6033984
Update tests/unittests/client/test_runner.py
Delaunay Jan 6, 2022
2f7fb47
-
Delaunay Jan 6, 2022
4feb2ba
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Jan 6, 2022
76b8a72
Move tests
Delaunay Jan 6, 2022
5c53c75
add test_execute_async_exception
Delaunay Jan 6, 2022
a7c177d
-
Delaunay Jan 6, 2022
0e7d0db
-
Delaunay Jan 6, 2022
d4c5034
-
Delaunay Jan 6, 2022
53375e6
-
Delaunay Jan 6, 2022
4e14fee
-
Delaunay Jan 6, 2022
8ebd0da
-
Delaunay Jan 6, 2022
79d1e5f
-
Delaunay Jan 6, 2022
4b25e06
-
Delaunay Jan 6, 2022
e76cac6
-
Jan 7, 2022
cbf152f
-
Jan 7, 2022
c9d5cc7
-
Jan 7, 2022
d69b69e
-
Delaunay Jan 10, 2022
7d6491f
-
Delaunay Jan 10, 2022
2efb999
-
Delaunay Jan 10, 2022
27eeec3
Update src/orion/client/runner.py
Delaunay Jan 11, 2022
c28a350
Add exception test
Delaunay Jan 12, 2022
71420f3
Merge branch 'parallel' of github.com:Delaunay/orion into parallel
Delaunay Jan 12, 2022
6189cf6
Fix double arguments in config test
Delaunay Jan 12, 2022
a043971
Increase timeout a big
Delaunay Jan 12, 2022
c3f320b
Simplifying test_suggest_race_condition
Delaunay Jan 18, 2022
7a7f8a8
Make Timeouts uniforms
Delaunay Jan 18, 2022
68cd736
-
Delaunay Jan 18, 2022
03facae
Add futures tests
Delaunay Jan 18, 2022
c55d087
-
Delaunay Jan 20, 2022
b0c3ebe
Harmonize Exception raised when submitting to a closed executor
Delaunay Jan 20, 2022
f4d6c15
Move futures tests
Delaunay Jan 20, 2022
da08be8
-
Delaunay Jan 20, 2022
69943df
Update exception
Delaunay Jan 20, 2022
81f69a8
-
Delaunay Jan 20, 2022
7d95721
-
Delaunay Jan 20, 2022
47a6a95
-
Jan 21, 2022
ba22611
-
Jan 21, 2022
f2b8676
-
Jan 21, 2022
13bb972
Update multiprocess_backend.py
Delaunay Jan 25, 2022
96c5e2f
Merge branch 'develop' of github.com:Epistimio/orion into parallel
Delaunay Jan 26, 2022
0d390c5
Add coverage
Delaunay Jan 26, 2022
cefca8b
Removed stuff
Delaunay Jan 26, 2022
6a3d6fb
Merge branch 'develop' of github.com:Epistimio/orion into parallel
Delaunay Jan 27, 2022
0aa1c47
-
Delaunay Jan 27, 2022
8f88f88
-
Delaunay Jan 27, 2022
e816343
-
Delaunay Jan 27, 2022
0099899
-
Delaunay Jan 27, 2022
6f04da7
-
Delaunay Jan 27, 2022
05e2733
Add Singlebackend futures
Delaunay Jan 27, 2022
0d8b992
-
Delaunay Jan 27, 2022
ee105ed
-
Delaunay Jan 27, 2022
071eab4
-
Delaunay Jan 27, 2022
6271b43
-
Delaunay Jan 27, 2022
16aabf6
-
Delaunay Jan 27, 2022
11c15df
-
Delaunay Jan 27, 2022
da35044
-
Jan 28, 2022
4446b76
-
Jan 28, 2022
ad715dc
Add Protected
Jan 28, 2022
5e31077
Add protected tests
Jan 28, 2022
220f941
-
Jan 28, 2022
fc8355e
-
Jan 28, 2022
3e63bef
-
Jan 28, 2022
6c6267b
-
Jan 28, 2022
de6bd73
-
Jan 28, 2022
6d35592
-
Jan 28, 2022
77fcc58
restore
Jan 28, 2022
2765cb5
Make sure custom handlers are removed
Jan 28, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -80,3 +80,8 @@ target/

# Notebooks
tests/**.ipynb

# Generated doc
docs/src/auto_examples
docs/src/auto_tutorials
docs/src/gen_modules
1 change: 1 addition & 0 deletions docs/src/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -293,6 +293,7 @@
"orion.plotting.base.PlotAccessor.__call__",
"orion.benchmark.task.BaseTask.__call__",
"orion.benchmark.task.base.BaseTask.__call__",
"AlreadyReleased",
]

nitpicky = True
Expand Down
16 changes: 8 additions & 8 deletions examples/plotting/plot_4_partial_dependencies.py
Original file line number Diff line number Diff line change
Expand Up @@ -99,16 +99,16 @@
import time

experiment = get_experiment("2-dim-exp", storage=storage)
start = time.clock()
start = time.perf_counter()
fig = experiment.plot.partial_dependencies(n_grid_points=5)
print(time.clock() - start, "seconds to compute")
print(time.perf_counter() - start, "seconds to compute")
fig

#%%
# With more points the grid is finer.
start = time.clock()
start = time.perf_counter()
fig = experiment.plot.partial_dependencies(n_grid_points=50)
print(time.clock() - start, "seconds to compute")
print(time.perf_counter() - start, "seconds to compute")
fig

#%%
Expand All @@ -118,17 +118,17 @@
# for a small 2-D search space but likely unsufficient for 5 dimensions or more.
# Here is an example with only 5 samples.

start = time.clock()
start = time.perf_counter()
fig = experiment.plot.partial_dependencies(n_samples=5)
print(time.clock() - start, "seconds to compute")
print(time.perf_counter() - start, "seconds to compute")
fig

#%%
# And now with 200 samples.

start = time.clock()
start = time.perf_counter()
fig = experiment.plot.partial_dependencies(n_samples=200)
print(time.clock() - start, "seconds to compute")
print(time.perf_counter() - start, "seconds to compute")
fig

#%%
Expand Down
2 changes: 1 addition & 1 deletion src/orion/algo/hyperband.py
Original file line number Diff line number Diff line change
Expand Up @@ -345,7 +345,7 @@ def suggest(self, num):
self.space.cardinality,
)
else:
logger.warning(
logger.debug(
f"{self.__class__.__name__} cannot suggest new samples and must wait "
"for trials to complete."
)
Expand Down
Loading