Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replicate write failures #23314

Merged
merged 18 commits into from
Apr 19, 2017
Merged

Replicate write failures #23314

Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
56b0517
Replicate write failures
areek Feb 22, 2017
e8e999d
use zlong to serialize seq_no
areek Mar 2, 2017
02b7eda
Incorporate feedback
areek Mar 27, 2017
5e829bb
track write failures in translog as a noop in primary
areek Mar 28, 2017
3b67b88
Add tests for replicating write failures.
areek Mar 29, 2017
c6384c8
Update to master
areek Mar 30, 2017
65c1a2a
update shouldExecuteOnReplica comment
areek Apr 4, 2017
d464285
rename indexshard noop to markSeqNoAsNoOp
areek Apr 4, 2017
d096474
remove redundant conditional
areek Apr 4, 2017
8d4d646
Consolidate possible replica action for bulk item request
areek Apr 5, 2017
4180727
remove bulk shard result abstraction
areek Apr 5, 2017
90e2419
fix failure handling logic for bwc
areek Apr 6, 2017
4878565
add more tests
areek Apr 6, 2017
2f33df8
minor fix
areek Apr 6, 2017
7f6b97a
cleanup
areek Apr 6, 2017
8905c94
incorporate feedback
areek Apr 13, 2017
8f325df
incorporate feedback
areek Apr 18, 2017
d153fdc
add assert to remove handling noop primary response when 5.0 nodes ar…
areek Apr 18, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
incorporate feedback
  • Loading branch information
@areek
areek committed Apr 19, 2017
commit 8f325dfb77952e64b4b9e183b59122753a5f4868
6 changes: 4 additions & 2 deletions core/src/main/java/org/elasticsearch/action/bulk/TransportShardBulkAction.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -440,10 +440,12 @@ public static Translog.Location performOnReplica(BulkShardRequest request, Index
case FAILURE:
final BulkItemResponse.Failure failure = item.getPrimaryResponse().getFailure();
assert failure.getSeqNo() != SequenceNumbersService.UNASSIGNED_SEQ_NO : "seq no must be assigned";
operationResult = executeFailedSeqNoOnReplica(failure, docWriteRequest, replica);
operationResult = executeFailureNoOpOnReplica(failure, replica);
assert operationResult != null : "operation result must never be null when primary response has no failure";
location = syncOperationResultOrThrow(operationResult, location);
break;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a default clause for this switch statement?

default:
throw new IllegalStateException("illegal replica item execution mode for: " + item.request());
}
} catch (Exception e) {
// if its not an ignore replica failure, we need to make sure to bubble up the failure
Expand Down Expand Up @@ -596,7 +598,7 @@ private static Engine.DeleteResult executeDeleteRequestOnReplica(DocWriteRespons
return replica.delete(delete);
}

private static Engine.NoOpResult executeFailedSeqNoOnReplica(BulkItemResponse.Failure primaryFailure, DocWriteRequest docWriteRequest, IndexShard replica) throws IOException {
private static Engine.NoOpResult executeFailureNoOpOnReplica(BulkItemResponse.Failure primaryFailure, IndexShard replica) throws IOException {
final Engine.NoOp noOp = replica.prepareMarkingSeqNoAsNoOp(
primaryFailure.getSeqNo(), primaryFailure.getMessage());
return replica.markSeqNoAsNoOp(noOp);
Expand Down