Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] Support partitioned topic reader #1178

Merged
merged 9 commits into from Feb 23, 2024

Conversation

RobertIndie
Copy link
Member

@RobertIndie RobertIndie commented Feb 20, 2024

Master Issue: #1177

Motivation

Currently, there is an issue with the reader implementation. If the reader is creating, it won't get the topic metadata from the topic. The reader can only read messages from a single topic. If the topic is a partitioned topic, the reader won't know that and will try to create a non-partition topic with the same name. And it will lead to this issue: apache/pulsar#22032

Modifications

  • Support partitioned topic reader

Verifying this change

  • Make sure that the change passes the CI checks.

This change added tests.

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API: (yes / no)
  • The schema: (yes / no / don't know)
  • The default values of configurations: (yes / no)
  • The wire protocol: (yes / no)

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / GoDocs / not documented)
  • If a feature is not applicable for documentation, explain why?
  • If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

@RobertIndie RobertIndie self-assigned this Feb 20, 2024
@RobertIndie RobertIndie marked this pull request as ready for review February 22, 2024 03:36
@RobertIndie RobertIndie changed the title [WIP] Support partitioned topic reader [feat] Support partitioned topic reader Feb 22, 2024
pulsar/consumer_impl.go Outdated Show resolved Hide resolved
@RobertIndie RobertIndie merged commit 3b9b1f8 into apache:master Feb 23, 2024
8 checks passed
@RobertIndie RobertIndie deleted the multi-reader branch February 23, 2024 07:49
@RobertIndie
Copy link
Member Author

This is also an important bug fix for the issue apache/pulsar#22032, so I'm going to cherry-pick to branch-0.12

@RobertIndie RobertIndie added this to the v0.13.0 milestone Feb 23, 2024
RobertIndie added a commit that referenced this pull request Feb 29, 2024
Master Issue: #1177

### Motivation

Currently, there is an issue with the reader implementation. If the reader is creating, it won't get the topic metadata from the topic. The reader can only read messages from a single topic. If the topic is a partitioned topic, the reader won't know that and will try to create a non-partition topic with the same name. And it will lead to this issue: apache/pulsar#22032

### Modifications

- Support partitioned topic reader

(cherry picked from commit 3b9b1f8)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants