sagemaker-python-sdk: Increasing the timeout for InvokeEndpoint

@ajaykarpur Any update on this? Switching to batch transforms doesn‘t seem to be interesting for video input.

I agree 60s limit is quite low and I hope they will slightly bump it.

If you need more than 1 minute (and less than 15) you might be interested in the newest SageMaker offering, namely Asynchronous Inference. The client sends the payload to the endpoint and the result will eventually appear in specified S3 bucket. You can set up SNS or Lambda to inform the client that it is ready to consume (and for example generate S3 presigned URL in the process).

More on that here: https://aws.amazon.com/about-aws/whats-new/2021/08/amazon-sagemaker-asynchronous-new-inference-option/

For disabling retries, you should be able to do something like the following (please note I havent tested this code myself, it serves as a reference):

import boto3
from botocore.config import Config
from sagemaker.session import Session

config = Config(
    read_timeout=80,
    retries={
        'max_attempts': 0
    }
)
sagemaker_runtime_client = boto3.client('sagemaker-runtime', config=config)
sagemaker_client = Session(sagemaker_runtime_client=sagemaker_runtime_client)

See:

• https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html
• https://github.com/aws/sagemaker-python-sdk/blob/04a2e75c236752256729e84ccd8eb6163d8daab8/src/sagemaker/session.py#L119-L125

In regards to the feature request, one option is to use SageMaker’s batch transform option (https://docs.aws.amazon.com/sagemaker/latest/dg/batch-transform.html). May not fit your use case though…

I’ve only gotten the invoke timeouts to work after contacting AWS Support and having them configure those. I’ll note they initially didn’t want to do it either, so it’s not quite as simple unfortunately.

No argument you may want to close this ticket, but I’d kindly suggest this is still an improvement that would be a really, really nice to have.

The issue is described pretty well in the original post. I do not have anything to add: https://github.com/aws/sagemaker-python-sdk/issues/1119#issue-521175736

any update?

Any updates on this?

Any update ?

Any updates on this?