DaaS / Products / Real-Time Event-Driven Search Pipeline

Real-Time Event-Driven Search Pipeline

Configure EventBridge to stream application events in real-time, deliver them to an external API destination or OSS bucket, set up OpenSearch to ingest that data as a managed source, and secure the Elasticsearch/OpenSearch cluster with RAM policies and STS tokens for production access control.

Products involved

Scenario

Configure EventBridge to stream application events in real-time, deliver them to an external API destination or OSS bucket, set up OpenSearch to ingest that data as a managed source, and secure the Elasticsearch/OpenSearch cluster with RAM policies and STS tokens for production access control.

How the products combine

  1. eb · eb-configure-streaming — EventBridge — Configure real-time event streaming

    2. See eb/eb-configure-streaming.

  2. eb · eb-deliver-destinations — EventBridge — Deliver events to external destinations (API/OSS/MQTT)

    3. See eb/eb-deliver-destinations.

  3. opensearch · opensearch-manage-sources — OpenSearch — Manage data sources for ingestion

    4. See opensearch/opensearch-manage-sources.

  4. es · es-manage-access — Elasticsearch — Manage access control and security settings

    5. See es/es-manage-access.

Typical questions

FAQ

Q: How do I configure a real-time event-driven search pipeline that streams events to OpenSearch and secures the cluster? A: You can build this pipeline by configuring EventBridge to stream application events in real-time and deliver them to an external API destination or OSS bucket. OpenSearch subsequently ingests the data as a managed source, and the cluster is secured using RAM policies and STS tokens for production access control.