Search in sources :

Example 1 with MemberDescription

use of org.apache.kafka.clients.admin.MemberDescription in project kafka by apache.

the class DescribeConsumerGroupsHandlerTest method testSuccessfulHandleResponse.

@Test
public void testSuccessfulHandleResponse() {
    Collection<MemberDescription> members = singletonList(new MemberDescription("memberId", "clientId", "host", new MemberAssignment(tps)));
    ConsumerGroupDescription expected = new ConsumerGroupDescription(groupId1, true, members, "assignor", ConsumerGroupState.STABLE, coordinator);
    assertCompleted(handleWithError(Errors.NONE, ""), expected);
}
Also used : MemberAssignment(org.apache.kafka.clients.admin.MemberAssignment) MemberDescription(org.apache.kafka.clients.admin.MemberDescription) ConsumerGroupDescription(org.apache.kafka.clients.admin.ConsumerGroupDescription) Test(org.junit.jupiter.api.Test)

Example 2 with MemberDescription

use of org.apache.kafka.clients.admin.MemberDescription in project kafka by apache.

the class StreamsResetter method maybeDeleteActiveConsumers.

private void maybeDeleteActiveConsumers(final String groupId, final Admin adminClient) throws ExecutionException, InterruptedException {
    final DescribeConsumerGroupsResult describeResult = adminClient.describeConsumerGroups(Collections.singleton(groupId), new DescribeConsumerGroupsOptions().timeoutMs(10 * 1000));
    final List<MemberDescription> members = new ArrayList<>(describeResult.describedGroups().get(groupId).get().members());
    if (!members.isEmpty()) {
        if (options.has(forceOption)) {
            System.out.println("Force deleting all active members in the group: " + groupId);
            adminClient.removeMembersFromConsumerGroup(groupId, new RemoveMembersFromConsumerGroupOptions()).all().get();
        } else {
            throw new IllegalStateException("Consumer group '" + groupId + "' is still active " + "and has following members: " + members + ". " + "Make sure to stop all running application instances before running the reset tool." + " You can use option '--force' to remove active members from the group.");
        }
    }
}
Also used : RemoveMembersFromConsumerGroupOptions(org.apache.kafka.clients.admin.RemoveMembersFromConsumerGroupOptions) MemberDescription(org.apache.kafka.clients.admin.MemberDescription) ArrayList(java.util.ArrayList) DescribeConsumerGroupsResult(org.apache.kafka.clients.admin.DescribeConsumerGroupsResult) DescribeConsumerGroupsOptions(org.apache.kafka.clients.admin.DescribeConsumerGroupsOptions)

Example 3 with MemberDescription

use of org.apache.kafka.clients.admin.MemberDescription in project kafka by apache.

the class DescribeConsumerGroupsHandler method handleResponse.

@Override
public ApiResult<CoordinatorKey, ConsumerGroupDescription> handleResponse(Node coordinator, Set<CoordinatorKey> groupIds, AbstractResponse abstractResponse) {
    final DescribeGroupsResponse response = (DescribeGroupsResponse) abstractResponse;
    final Map<CoordinatorKey, ConsumerGroupDescription> completed = new HashMap<>();
    final Map<CoordinatorKey, Throwable> failed = new HashMap<>();
    final Set<CoordinatorKey> groupsToUnmap = new HashSet<>();
    for (DescribedGroup describedGroup : response.data().groups()) {
        CoordinatorKey groupIdKey = CoordinatorKey.byGroupId(describedGroup.groupId());
        Errors error = Errors.forCode(describedGroup.errorCode());
        if (error != Errors.NONE) {
            handleError(groupIdKey, error, failed, groupsToUnmap);
            continue;
        }
        final String protocolType = describedGroup.protocolType();
        if (protocolType.equals(ConsumerProtocol.PROTOCOL_TYPE) || protocolType.isEmpty()) {
            final List<DescribedGroupMember> members = describedGroup.members();
            final List<MemberDescription> memberDescriptions = new ArrayList<>(members.size());
            final Set<AclOperation> authorizedOperations = validAclOperations(describedGroup.authorizedOperations());
            for (DescribedGroupMember groupMember : members) {
                Set<TopicPartition> partitions = Collections.emptySet();
                if (groupMember.memberAssignment().length > 0) {
                    final Assignment assignment = ConsumerProtocol.deserializeAssignment(ByteBuffer.wrap(groupMember.memberAssignment()));
                    partitions = new HashSet<>(assignment.partitions());
                }
                memberDescriptions.add(new MemberDescription(groupMember.memberId(), Optional.ofNullable(groupMember.groupInstanceId()), groupMember.clientId(), groupMember.clientHost(), new MemberAssignment(partitions)));
            }
            final ConsumerGroupDescription consumerGroupDescription = new ConsumerGroupDescription(groupIdKey.idValue, protocolType.isEmpty(), memberDescriptions, describedGroup.protocolData(), ConsumerGroupState.parse(describedGroup.groupState()), coordinator, authorizedOperations);
            completed.put(groupIdKey, consumerGroupDescription);
        } else {
            failed.put(groupIdKey, new IllegalArgumentException(String.format("GroupId %s is not a consumer group (%s).", groupIdKey.idValue, protocolType)));
        }
    }
    return new ApiResult<>(completed, failed, new ArrayList<>(groupsToUnmap));
}
Also used : HashMap(java.util.HashMap) MemberDescription(org.apache.kafka.clients.admin.MemberDescription) ArrayList(java.util.ArrayList) AclOperation(org.apache.kafka.common.acl.AclOperation) DescribedGroup(org.apache.kafka.common.message.DescribeGroupsResponseData.DescribedGroup) Assignment(org.apache.kafka.clients.consumer.ConsumerPartitionAssignor.Assignment) MemberAssignment(org.apache.kafka.clients.admin.MemberAssignment) MemberAssignment(org.apache.kafka.clients.admin.MemberAssignment) DescribedGroupMember(org.apache.kafka.common.message.DescribeGroupsResponseData.DescribedGroupMember) DescribeGroupsResponse(org.apache.kafka.common.requests.DescribeGroupsResponse) HashSet(java.util.HashSet) ConsumerGroupDescription(org.apache.kafka.clients.admin.ConsumerGroupDescription) Errors(org.apache.kafka.common.protocol.Errors) TopicPartition(org.apache.kafka.common.TopicPartition)

Aggregations

MemberDescription (org.apache.kafka.clients.admin.MemberDescription)3 ArrayList (java.util.ArrayList)2 ConsumerGroupDescription (org.apache.kafka.clients.admin.ConsumerGroupDescription)2 MemberAssignment (org.apache.kafka.clients.admin.MemberAssignment)2 HashMap (java.util.HashMap)1 HashSet (java.util.HashSet)1 DescribeConsumerGroupsOptions (org.apache.kafka.clients.admin.DescribeConsumerGroupsOptions)1 DescribeConsumerGroupsResult (org.apache.kafka.clients.admin.DescribeConsumerGroupsResult)1 RemoveMembersFromConsumerGroupOptions (org.apache.kafka.clients.admin.RemoveMembersFromConsumerGroupOptions)1 Assignment (org.apache.kafka.clients.consumer.ConsumerPartitionAssignor.Assignment)1 TopicPartition (org.apache.kafka.common.TopicPartition)1 AclOperation (org.apache.kafka.common.acl.AclOperation)1 DescribedGroup (org.apache.kafka.common.message.DescribeGroupsResponseData.DescribedGroup)1 DescribedGroupMember (org.apache.kafka.common.message.DescribeGroupsResponseData.DescribedGroupMember)1 Errors (org.apache.kafka.common.protocol.Errors)1 DescribeGroupsResponse (org.apache.kafka.common.requests.DescribeGroupsResponse)1 Test (org.junit.jupiter.api.Test)1