Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slowdown with beet web - regression #2182

Closed
cobra2 opened this issue Aug 31, 2016 · 19 comments
Closed

Slowdown with beet web - regression #2182

cobra2 opened this issue Aug 31, 2016 · 19 comments
Labels
needinfo We need more details or follow-up from the filer before this can be tagged "bug" or "feature."

Comments

@cobra2
Copy link

cobra2 commented Aug 31, 2016

There is a massive slowdown in queries with python2 and python3 when using the beet web interface.

When large queries are run, i.e. 'format:flac' on a flac only library, the web interface posts queries 10x slower than before the regression. To clarify that does seem to be a relative time based on the length of time originally taken by the query.

This is caused by a regression in the commit.
5e8ac9e

beet stats
Tracks: 43913
Total time: 51.4 weeks
Approximate total size: 976.18 GiB
Artists: 7345
Albums: 12004
Album artists: 1800

@ghost
Copy link

ghost commented Aug 31, 2016

@cobra2 said that with this commit included it takes 80-100 seconds, and with the change reversed it's about 10 seconds.

@sampsyo sampsyo added the needinfo We need more details or follow-up from the filer before this can be tagged "bug" or "feature." label Aug 31, 2016
@sampsyo
Copy link
Member

sampsyo commented Aug 31, 2016

Thanks for the report. @maxammann, you added this path field—how necessary is it really? We could consider just exposing the real file path, which should be much faster, although I'm not 100% sure why we need the path here at all.

@ghost
Copy link

ghost commented Sep 1, 2016

@sampsyo : probably this /~https://github.com/maxammann/music-cyclon

"Android app to synchronize music or files over network by using the beets web server""

EDIT: definitely that. it says "Waiting for pull request: #2050 " . That's the change that introduced this.

@sampsyo
Copy link
Member

sampsyo commented Sep 2, 2016

Got it; thanks. I'm just not 100% sure why it needs us to generate paths… couldn't that happen client-side?

Anyway, we could make it a config option to decide whether to expose real file paths. (Off by default for privacy's sake.)

@ghost
Copy link

ghost commented Sep 4, 2016

Should we consider this a blocker bug?

@sampsyo
Copy link
Member

sampsyo commented Sep 4, 2016

Maybe we should just roll back the change and call it good? If @maxammann is interested in adding it back, that's of course cool but not worth blocking release.

@ghost
Copy link

ghost commented Sep 4, 2016

So what about #2177 ? You mention that PR as the solution

@sampsyo
Copy link
Member

sampsyo commented Sep 4, 2016

Yeah, I'm not exactly sure what's going on there. It's not entirely clear to me that they need the path in the web API---in any case, it shouldn't be hard to add back if necessary.

@ghost
Copy link

ghost commented Sep 10, 2016

This is also in the changelog, so if it does get backed out, it'd have to be removed from there too.

@ghost ghost added the blocker label Sep 10, 2016
@maxammann
Copy link
Contributor

Currently traveling for this month but I'll look into it when I come home again. For now just revert that commit if it makes trouble.

@maxammann
Copy link
Contributor

I think its still a valuable feature. Maybe we should add a flag to toggle "expensive" output?

@sampsyo
Copy link
Member

sampsyo commented Sep 20, 2016

Yeah, absolutely—I do think it should be an option.

@maxammann
Copy link
Contributor

Back at home, going to fix this and push a pull request in a few days. Is it urgent right now, because it's a blocker? Or does the new release take a few more weeks?

@ghost
Copy link

ghost commented Oct 3, 2016

@maxammann : which route are you gonna take for a fix?

@maxammann
Copy link
Contributor

@jrobeson sorry, had some family related problems the past week, I'll introduce a new flag to disable the expensive output.

@ghost
Copy link

ghost commented Oct 16, 2016

a flag to disable? shouldn't it be a flag to enable? In the future, it shouldn't nearly be so expensive, so hopefully we can can drop the flag all together.

@ghost
Copy link

ghost commented Oct 19, 2016

Only @sampsyo can say how urgent this is. I'm not sure when he's ready to push a new release.

@maxammann
Copy link
Contributor

@jrobeson yeah, sorry, I mean a flag to enable :P

maxammann added a commit to maxammann/beets that referenced this issue Oct 26, 2016
…he 'path' variable"

This reverts commit 5e8ac9e, because of
a slowdown. Resolves beetbox#2182.
@maxammann
Copy link
Contributor

Sorry for the delay, a lot of stuff going on. Just reverted that commit. :D

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needinfo We need more details or follow-up from the filer before this can be tagged "bug" or "feature."
Projects
None yet
Development

No branches or pull requests

3 participants