What data is stored in flink checkpoints?

Question

I have a case to handle restart flink job. I need use checkpointing and use metadata (state of kafkasource input) of it to process. Currently, checkpointing auto use metadata to recovery, but i wanna read info from this file and process something. Documents just intro some method but not your goal: dispose(),getCheckpointId(),getCheckpointProperties(),getMasterStates(),getOperatorStates().toString(),withProperties(CheckpointProperties properties)`

Please clarify your specific problem or provide additional details to highlight exactly what you need. As it's currently written, it's hard to tell exactly what you're asking. — Community
– Community Bot, Commented Jan 22 at 4:00

David Anderson · Accepted Answer · 2025-01-21 20:41:16Z

0

The State Processor API will let you process the data in a checkpoint or savepoint.

Checkpoints and savepoints include everything needed to ensure effectively exactly-once semantics:

non-keyed state (e.g., kafka offsets, transaction IDs)
broadcast state
keyed state
timers

edited Jan 21 at 20:41

answered Jan 21 at 13:38

David Anderson

44.3k4 gold badges41 silver badges73 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

ndycuong Jan 21 at 15:16

actually i wanna know how exactly which things stored in checkpointing , not just about how to operate

David Anderson Jan 21 at 20:41

I've expanded my answer.

Collectives™ on Stack Overflow

What data is stored in flink checkpoints?

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related