Using Protobuf messages in a Pcollection in Apache Beam using Go causing an error

Question

func processPubSubMsgFn(ctx context.Context, in *pubsub.PubsubMessage) v1.someProto {
    someProto := &v1.someProto{}
    if err := proto.Unmarshal((in.Data), someProto); err != nil {
        log.Fatalln("Failed to parse address book:", err)
    }
    return *someProto
}

Causes: bad return type caused by: encoding struct v1.someProto type has unexported field: state

When trying to run the pipeline, In java I would set the coder for the message type, not sure how to do this in the Go Version of Apache Beam

I had to add beam.RegisterType(reflect.TypeOf(v1. someProto{})) to the init() function. — JeffKing54
– JeffKing54, Commented Aug 9, 2021 at 13:01

Jaroslaw · Accepted Answer · 2021-08-09 07:00:19Z

1

From what i see in apache beam sdk you should return *v1.someProto instead of v1.someProto.

answered Aug 9, 2021 at 7:00

Jaroslaw

6564 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

JeffKing54 Over a year ago

Thanks for the help, yes you are correct that worked.

Collectives™ on Stack Overflow

Using Protobuf messages in a Pcollection in Apache Beam using Go causing an error

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related