kubernetes: Docker failed to create container on windows nodes: Failed to unmarshall layerchain json - invalid character '\\x00' looking for beginning of value"

What happened: Docker failed to create container on windows nodes with error message

Failed to unmarshall layerchain json - invalid character '\\x00' looking for beginning of value"

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Not sure. This happened quite frequently in E2E tests.

Anything else we need to know?:

Environment:

  • Kubernetes version (use kubectl version): 1.14
  • Cloud provider or hardware configuration: GCE
  • OS (e.g: cat /etc/os-release): Windows 1809
  • Kernel (e.g. uname -a):
  • Install tools:
  • Network plugin and version (if this is a network-related bug):
  • Others:

Search result suggested that the file may be corrupted. Once a node ran into this issue for a certain image, it’d no longer be able to create containers using that image.

On the same node, I’ve found error messages (from windows even log) below:

An error was detected on device \Device\Harddisk4\DR125 during a paging operation.
Disk 4 has the same disk identifiers as one or more disks connected to the system. Go to Microsoft's support website (http://support.microsoft.com) and search for KB2983588 to resolve the issue.
The disk signature of disk 4 is equal to the disk signature of disk 1.

I think the device in the error message corresponds to the container, and the error message can be related to the problem, but I’m not sure.

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Reactions: 2
  • Comments: 24 (13 by maintainers)

Most upvoted comments

@Lagicrus: You can’t reopen an issue/PR unless you authored it or you are a collaborator.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.