Skip to content

Conversation

@GPrabhudas
Copy link
Contributor

Initial changes to address reader topic not found issue: #553

Changes:

  • create multi-topic reader

@wolfstudy
Copy link
Member

cc @cckellogg PTAL

@wolfstudy wolfstudy requested review from cckellogg, merlimat and wolfstudy and removed request for cckellogg January 12, 2022 14:56
@wolfstudy wolfstudy added this to the v0.8.0 milestone Jan 12, 2022
// Name returns the name of consumer.
Name() string

// lastDequeuedMsg used for setting last dequeued msg id by internal partition consumers
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we should be adding private methods to the public interface. I think these should be removed. Also, it seems these are only relevant to the reader implementation so I think these helper functions should live within the reader files.

NackBackoffPolicy NackBackoffPolicy

// startMessageID internally used by multitopic-reader
startMessageID MessageID
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The ConsumerOptions is a public interface so I don't think we should add package private fields here. Let's remove these.

}

func (pc *partitionConsumer) messagesInQueue() int {
return len(pc.queueCh)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If there are multi go routines consuming and producing to this channel this value might not be useful after being read.

c.handlers.Add(reader)
return reader, nil
if len(topics) <= 1 {
reader, err := newReader(c, options)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the different between a reader and a multi reader? It seems like they should be the same but just consume a different number of partitions?

@wolfstudy wolfstudy modified the milestones: v0.8.0, 0.9.0 Feb 16, 2022
@freeznet freeznet modified the milestones: v0.9.0, v0.10.0 Jul 4, 2022
@RobertIndie RobertIndie modified the milestones: v0.10.0, v0.11.0 Mar 27, 2023
@RobertIndie RobertIndie modified the milestones: v0.11.0, v0.12.0 Jul 4, 2023
@RobertIndie RobertIndie modified the milestones: v0.12.0, v0.13.0 Jan 10, 2024
@RobertIndie RobertIndie modified the milestones: v0.13.0, v0.14.0 Jul 15, 2024
@RobertIndie RobertIndie modified the milestones: v0.14.0, v0.15.0 Oct 8, 2024
@RobertIndie RobertIndie removed this from the v0.15.0 milestone May 15, 2025
@RobertIndie RobertIndie added this to the v0.16.0 milestone May 15, 2025
@RobertIndie RobertIndie modified the milestones: v0.16.0, v0.17.0 Jul 29, 2025
@RobertIndie RobertIndie modified the milestones: v0.17.0, v0.18.0 Oct 23, 2025
@RobertIndie RobertIndie modified the milestones: v0.18.0, v0.19.0 Dec 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants