How To Measure The Size of gRPC Response

Question

I am trying come up with better ways to deal with the 4mb message size limit in grpc. I need a way to measure the size of the grpc response received on client side. When the response exceeds 4mb limit grpc shows a error message like:

could not greet: rpc error: code = ResourceExhausted desc = grpc: received message larger than max (74000087 vs. 4194304)

with "74000087" being the actual size of the response. How is this calculated? Is there a way to get this value?

I have gone through multiple articles on this topic but could find nothing? Can someone please help? Thanks.

My implementation is using golang

Community · Accepted Answer · 2020-06-20 09:12:55Z

6

Computing message size

As per the proto docs,

func Size(m Message) int

Size returns the size in bytes of the wire-format encoding of m.

gRPC message size limits

Also, it might be useful in your case to consider setting grpc.MaxCallRecvMsgSize as a grpc.CallOption to manage limits.

edited Jun 20, 2020 at 9:12

CommunityBot

11 silver badge

answered Jun 5, 2020 at 19:57

Dustin Hooten

1611 silver badge2 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

OhhhThatVarun · Accepted Answer · 2020-04-01 08:28:10Z

3

I figured out a way to do this. The solution is to encode the gRPC response into the byte stream, and then calculate the size using binary.Size()

func GetGRPCResponseSize(val interface{}, desc string) (int, error) {

    var buff bytes.Buffer
    enc := gob.NewEncoder(&buff)
    err := enc.Encode(val)
    if err != nil {
        log.Error("encode error:", err)
        return 0, err
    }
    return binary.Size(buff.Bytes()), nil
}

edited Apr 1, 2020 at 8:28

OhhhThatVarun

4,3703 gold badges35 silver badges56 bronze badges

answered Dec 11, 2019 at 8:36

Ashwin Shirva

1,4792 gold badges14 silver badges32 bronze badges

2 Comments

Sankar Over a year ago

This is not a precise answer. You are just predicting what would be the compression, by doing a gob encoding offline. There is no guarantee that this would be the size of the network payload.

Md. Over a year ago

Is there any Java equivalent?

Collectives™ on Stack Overflow

How To Measure The Size of gRPC Response

2 Answers 2

Computing message size

gRPC message size limits

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Computing message size

gRPC message size limits

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related