Skip to content

[Pull-based Ingestion] Add experimental pull-based ingestion page #9659

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

varunbharadwaj
Copy link

Description

This PR adds a new page for pull-based ingestion. Pull-based ingestion is a new experimental feature introduced in OpenSearch 3.0. We add related details, message format and API details in a single page for now. This will be moved to individual pages once the feature is GA.

Issues Resolved

Closes #9545

Version

3.0 and beyond (experimental feature as of now)

Frontend features

If you're submitting documentation for an OpenSearch Dashboards feature, add a video that shows how a user will interact with the UI step by step. A voiceover is optional.

Checklist

  • [ x] By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review.

@kolchfa-aws kolchfa-aws added the 3 - Tech review PR: Tech review in progress label Apr 21, 2025
@kolchfa-aws
Copy link
Collaborator

Thank you, @varunbharadwaj! Re: page placement, I don't think this topic's best location is Creating and tuning your cluster because this section deals with cluster configuration and performance. I would create a new top-level topic "Ingestion" and move the current "Ingest pipelines" under that topic. And I would place Pull-based ingestion in that topic as well so the new structure would be:
Ingestion
|__ Ingest pipelines
|__ Pull-based ingestion

What do you think, @varunbharadwaj, @msfroh, @andrross?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Tech review PR: Tech review in progress experimental release-notes PR: Include this PR in the automated release notes v3.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[DOC] Create Pull-based ingestion documentation
3 participants