azure-sdk-for-java: [BUG] Possible Memory Leak in Storage Blobs

Filing this here on behalf of @jdubois

This issue was reported by a customer doing large selection of blobs.

This is using the new API for blob storage. Please note that those are my notes from discussing with the client, I haven’t reproduced the case myself (for obvious reasons, you need a lot of blobs!), but I am pretty confident he is correct.

Doing a “blobContainerClient.listBlobs().streamByPage()” is causing memory leaks when you have a huge number of blobs, so we probably have some pointer left somewhere there.

Here is his solution, that do indeed work in production:

• use streamByPage and not iterableByPage, as it has a close method
• force clean the body of HTTP requests using the Reactor API, using response.getRequest().setBody(Flux.never());
• disable the buffer copies in Netty: new NettyAsyncHttpClientBuilder().disableBufferCopy(true).build();