How do you set a timeout in Python's gRPC Library

Question

I have a grpc server / client that today will occasionally hang, causing issues. This is being called from a Flask application which is checking in with a background worker process to make sure it's alive / functioning. To make the request to the gRPC server, I have:

try:
        health = self.grpc_client.Health(self.health_ping)
        if health.message == u'PONG':
            return {
                u'healthy': True,
                u'message': {
                    u'healthy': True,
                    u'message': u'success'
                },
                u'status_code': 200
            }
except Exception as e:
        if str(e.code()) == u'StatusCode.UNAVAILABLE':
            return {
                u'healthy': False,
                u'message': {
                    u'healthy': False,
                    u'message': (u'[503 Unavailable] connection to worker '
                                 u'failed')},
                u'status_code': 200}
        elif str(e.code()) == u'StatusCode.INTERNAL':
            return {
                u'healthy': False,
                u'message': {
                    u'healthy': False,
                    u'message': (u'[500 Internal] worker encountered '
                                 u'an error while responding')},
                u'status_code': 200}
        return {
            u'healthy': False,
            u'message': {u'healthy': False, u'message': e.message},
            u'status_code': 500
        }

the client is a stub:

channel = grpc.insecure_channel(address)
stub = WorkerStub(channel)
return stub

the proto is:

syntax = "proto3";

option java_multiple_files = true;
option java_package = "com.company.project.worker";
option java_outer_classname = "ProjectWorker";
option objc_class_prefix = "PJW";

package projectworker;

service Worker {
  rpc Health (Ping) returns (Pong) {}
}

// The request message containing PONG
message Ping {
  string message = 1;
}

// The response message containing PONG
message Pong {
  string message = 1;
}

Using this code, how would I then add a timeout to ensure that I can always respond rather than fail and hang?

Nathaniel Manista At Google · Accepted Answer · 2017-05-09 15:11:14Z

33

timeout is an optional keyword parameter on RPC invocation so you should change

health = self.grpc_client.Health(self.health_ping)

to

health = self.grpc_client.Health(self.health_ping, timeout=my_timeout_in_seconds)

.

answered May 9, 2017 at 15:11

Nathaniel Manista At Google

2,60018 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

kkirsche Over a year ago

Ah, ok. Thank you so much for that information! Can't believe I missed that

spacether Over a year ago

Is there a synonymous setting for the channel options here github.com/grpc/grpc/blob/v1.36.x/include/grpc/impl/codegen/…? is it grpc.grpclb_call_timeout_ms?

Jossef Harush Kadouri · Accepted Answer · 2019-09-20 09:28:26Z

9

To define a timeout on client side, add an optional parameter timeout=<timeout in seconds> when you invoke a service function;

channel = grpc.insecure_channel(...)
stub = my_service_pb2_grpc.MyServiceStub(channel)
request = my_service_pb2.DoSomethingRequest(data='this is my data')
response = stub.DoSomething(request, timeout=0.5)

💡 Note a timeout situation will raise an exception

answered Sep 20, 2019 at 9:28

Jossef Harush Kadouri

34.6k10 gold badges143 silver badges133 bronze badges

Comments

user582175 · Accepted Answer · 2019-07-19 13:57:46Z

6

You may also want to catch and handle timeouts differently than other errors. Sadly the documentation is not quite good on this topic, so here's what you have:

try:
    health = self.grpc_client.Health(self.health_ping, timeout=my_timeout_in_seconds)
except grpc.RpcError as e:
    e.details()
    status_code = e.code()
    status_code.name
    status_code.value

Timeout will return DEADLINE_EXCEEDED status_code.value.

answered Jul 19, 2019 at 13:57

user582175

1,3202 gold badges15 silver badges20 bronze badges

Collectives™ on Stack Overflow

How do you set a timeout in Python's gRPC Library

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related