Skip to main content
Bumped by Community user
Bumped by Community user
Bumped by Community user
Bumped by Community user
briefly explain the issue(s) related with multiple infrastructure parts to carry over state consistently
Source Link
user175557
user175557

I'm designing a small platform based on a series of event-based micro-services. The persistence storage I'm targeting is (the managed) Amazon RDS PostgreSQL (Amazon RDS for PostgreSQL) — although I can go with Amazon Aurora as well.

Basically I'm trying to avoid sending events programmatically within the system. Previously I've used Amazon SQS, Axon Framework, and suchetc., to deliver the same functionality, but there were always issues within the application because of the inconsistencies between the database state and the underlying system publishing the messages. For instance, there were cases where database transactions succeeded, but failures happened on the producer of the events. Having multiple infrastructure pieces at that juncture, in my experience, makes the system more difficult to manage state.

Basically, if I can listen to some built-in stream that captures a time-ordered sequence of item-level modifications in the database I would accomplish the same and it would be more reliable. Problem is that I've been searching throughout the documentation but I can't find anything like it so far.

In the end, Amazon DynamoDB Streams delivers something similar to what I'm looking for, but I can't seem to find this in Amazon RDS (for PostgreSQL) or Amazon Aurora.

I'm open as well to different solutions I haven't considered.

I'm aware of the Transactional Outbox pattern, but I'm trying to use it as a last resort.

I'm designing a small platform based on a series of event-based micro-services. The persistence storage I'm targeting is (the managed) Amazon RDS PostgreSQL (Amazon RDS for PostgreSQL) — although I can go with Amazon Aurora as well.

Basically I'm trying to avoid sending events programmatically within the system. Previously I've used Amazon SQS, Axon Framework, and such to deliver the same functionality, but there were always issues within the application because of the inconsistencies between the database state and the underlying system publishing the messages.

Basically, if I can listen to some built-in stream that captures a time-ordered sequence of item-level modifications in the database I would accomplish the same and it would be more reliable. Problem is that I've been searching throughout the documentation but I can't find anything like it so far.

In the end, Amazon DynamoDB Streams delivers something similar to what I'm looking for, but I can't seem to find this in Amazon RDS (PostgreSQL) or Amazon Aurora.

I'm open as well to different solutions I haven't considered.

I'm aware of the Transactional Outbox pattern, but I'm trying to use it as a last resort.

I'm designing a small platform based on a series of event-based micro-services. The persistence storage I'm targeting is (the managed) Amazon PostgreSQL (Amazon RDS for PostgreSQL) — although I can go with Amazon Aurora as well.

Basically I'm trying to avoid sending events programmatically within the system. Previously I've used Amazon SQS, Axon Framework, etc., to deliver the same functionality, but there were always issues within the application because of the inconsistencies between the database state and the underlying system publishing the messages. For instance, there were cases where database transactions succeeded, but failures happened on the producer of the events. Having multiple infrastructure pieces at that juncture, in my experience, makes the system more difficult to manage state.

Basically, if I can listen to some built-in stream that captures a time-ordered sequence of item-level modifications in the database I would accomplish the same and it would be more reliable. Problem is that I've been searching throughout the documentation but I can't find anything like it so far.

In the end, Amazon DynamoDB Streams delivers something similar to what I'm looking for, but I can't seem to find this in Amazon RDS for PostgreSQL or Amazon Aurora.

I'm open as well to different solutions I haven't considered.

I'm aware of the Transactional Outbox pattern, but I'm trying to use it as a last resort.

Source Link
user175557
user175557

Capture a time-ordered sequence of item-level modifications via events when using Amazon Aurora

I'm designing a small platform based on a series of event-based micro-services. The persistence storage I'm targeting is (the managed) Amazon RDS PostgreSQL (Amazon RDS for PostgreSQL) — although I can go with Amazon Aurora as well.

Basically I'm trying to avoid sending events programmatically within the system. Previously I've used Amazon SQS, Axon Framework, and such to deliver the same functionality, but there were always issues within the application because of the inconsistencies between the database state and the underlying system publishing the messages.

Basically, if I can listen to some built-in stream that captures a time-ordered sequence of item-level modifications in the database I would accomplish the same and it would be more reliable. Problem is that I've been searching throughout the documentation but I can't find anything like it so far.

In the end, Amazon DynamoDB Streams delivers something similar to what I'm looking for, but I can't seem to find this in Amazon RDS (PostgreSQL) or Amazon Aurora.

I'm open as well to different solutions I haven't considered.

I'm aware of the Transactional Outbox pattern, but I'm trying to use it as a last resort.