Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[request] Estimate Remaining Time For Node #2685

Open
solonovamax opened this issue Feb 24, 2025 · 1 comment
Open

[request] Estimate Remaining Time For Node #2685

solonovamax opened this issue Feb 24, 2025 · 1 comment
Labels
feature request feature request from the community

Comments

@solonovamax
Copy link

Is your feature request related to a problem? Please describe.
Currently, there is no estimate shown for how long the currently executing node is expected to take.

Describe the solution you'd like
For some node types, this would be difficult to impossible to calculate, however for other node types it would be trivial to calculate.

Some nodes seem to vary in how long they take for each chunk.
However, most nodes seem to follow a pattern where the variance in times taken for each chunk is rather small. (ie. the time taken for a chunk is generally close to the average of all the chunks)
For these types of nodes, you could calculate the remaining time with average(chunk_durations) * chunk_count - execution_time

Perhaps a new method, timeRemaining() could be introduced on the Node class which returns an expected completion time or None if it cannot be estimated for that node type.
The default implementation would return None, and if the time can be reasonably calculated for a node, it would be overridden with the calculation.
This would also allow for calculating the remaining time for nodes where the time for each chunk is known to follow an exponential curve or a linear function, for example.

Of course, this would not calculate the expected execution time for the entire pipeline as that would be significantly more difficult, but it can at least give you an estimation for the current node. It would however require that at least 1 chunk have been completed for the currently executing node.

Describe alternatives you've considered
This can be calculated manually, however it is cumbersome to do. It would be helpful to instead have it presented in the UI.

@solonovamax solonovamax added the feature request feature request from the community label Feb 24, 2025
@natowi
Copy link
Member

natowi commented Feb 27, 2025

We had a prototype some time ago... #842

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request feature request from the community
Projects
None yet
Development

No branches or pull requests

2 participants