Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GetKeyValuesAndFlatMap should return error if not retriable #5967

Merged
merged 1 commit into from
Nov 12, 2021

Conversation

nblintao
Copy link
Contributor

@nblintao nblintao commented Nov 12, 2021

I recently find out that the GetKeyValuesAndFlatMap endpoint will retry forever for a non-retriable error (e.g. the "mapper" in user's request is invalid). We need this fix in 7.0 to make the new feature useful.

Code-Reviewer Section

The general guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

  • The PR has a description, explaining both the problem and the solution.
  • The description mentions which forms of testing were done and the testing seems reasonable.
  • Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

  • This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or master if this is the youngest branch)
  • There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

@apple apple deleted a comment from foundationdb-ci Nov 12, 2021
@foundationdb-ci
Copy link
Contributor

AWS CodeBuild CI Report for macOS Catalina 10.15

  • CodeBuild project: foundationdb-pr-macos
  • Commit ID: 6b56b0b
  • Result: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)

@foundationdb-ci
Copy link
Contributor

AWS CodeBuild CI Report for Linux CentOS 7

  • CodeBuild project: foundationdb-pr
  • Commit ID: dcb9a68
  • Result: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)

@foundationdb-ci
Copy link
Contributor

AWS CodeBuild CI Report for Linux CentOS 7

  • CodeBuild project: foundationdb-pr
  • Commit ID: f1e9134
  • Result: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)

Copy link
Contributor

@halfprice halfprice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's your joshua result?

GetKeyValuesAndFlatMapReply _r = wait(flatMap(data, getKeyValuesReply, req.mapper));
r = _r;
} catch (Error& e) {
TraceEvent(SevInfo, "FlatMapError").error(e);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is SevInfo needed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed

@@ -109,17 +110,27 @@ struct IndexPrefetchDemoWorkload : TestWorkload {
mapper,
GetRangeLimits(CLIENT_KNOBS->TOO_MANY)));
showResult(result);
if (self->BAD_MAPPER) {
TraceEvent("IndexPrefetchDemoWorkloadShouldNotReachable").detail("ResultSize", result.size());
// UNREACHABLE();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove commented out code?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed

@foundationdb-ci
Copy link
Contributor

AWS CodeBuild CI Report for Linux CentOS 7

  • CodeBuild project: foundationdb-pr
  • Commit ID: 2d5f924
  • Result: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)

@nblintao nblintao merged commit 08fd69e into apple:master Nov 12, 2021
@nblintao nblintao deleted the flatmap-exception branch November 12, 2021 18:19
nblintao added a commit to nblintao/foundationdb that referenced this pull request Nov 13, 2021
nblintao added a commit to nblintao/foundationdb that referenced this pull request Nov 13, 2021
nblintao added a commit to nblintao/foundationdb that referenced this pull request Nov 13, 2021
nblintao added a commit to nblintao/foundationdb that referenced this pull request Nov 13, 2021
nblintao added a commit to nblintao/foundationdb that referenced this pull request Nov 13, 2021
nblintao added a commit to nblintao/foundationdb that referenced this pull request Nov 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants