memcached: Multikey get sometimes fails with ERROR - 1.6.12

Describe the bug On 1.6.12 when I’m fetching values for a long list of keys, sometimes (on the n th run, but typically not on the first run), it returns ERROR instead of the values. For a short list of keys or single key, the operation completes as normal. Using docker latest image.

EDIT: Affected server versions: 1.6.12 NOT affected server versions: 1.6.1, 1.5.22

To Reproduce

EDIT: Minimal example to reproduce with pymemcache (NB., several runs needed, sometimes it will work. The larger the batch size, the more likely it will fail)

from pymemcache.client.base import Client

server = 'SERVER'

client = Client(server)
client.set(f'somekey', '012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789')
many_keys = [f'somekey' for i in range(10000)]
client.get_many(many_keys)

# Sometimes fails with 
# pymemcache.exceptions.MemcacheUnknownCommandError: b'get'

Digging into the source code of pymemcache, the server responds with an ‘ERROR’ in line on https://github.com/pinterest/pymemcache/blob/master/pymemcache/client/base.py#L1026 which is rethrown when processing the response on L1030.

[Obsolete repro with telnet] Minimal example using telnet as below (removed a part of the first response for brevity). The first multikey get suceeds as normal, the seconds fails with an ERROR.

telnet SERVER 11211
Trying SERVER...
Connected to SERVER.
Escape character is '^]'.
set somekey 0 0 100
0123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789
STORED
get somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey
VALUE somekey 0 100
0123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789
VALUE somekey 0 100
0123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789
[...]
0123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789
VALUE somekey 0 100
0123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789
END
get somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey somekey
ERROR

System Information

• OS/Distro: Ubuntu, Docker
• Version of OS/distro: Ubuntu 20.04.3 LTS
• Version of memcached: 1.6.12 from Dockerhub
• Hardware detail: x86

Detail (please include!) Always include the output of stats, stats settings, and optionally stats items and stats slabs. These can be provided to a maintainer privately if necessary. Please sanitize anything secret from the data.

stats
STAT pid 1
STAT uptime 4427
STAT time 1641866741
STAT version 1.6.12
STAT libevent 2.1.12-stable
STAT pointer_size 64
STAT rusage_user 18.983464
STAT rusage_system 47.946604
STAT max_connections 1024
STAT curr_connections 2
STAT total_connections 20
STAT rejected_connections 0
STAT connection_structures 3
STAT response_obj_oom 0
STAT response_obj_count 1
STAT response_obj_bytes 65536
STAT read_buf_count 96
STAT read_buf_bytes 1572864
STAT read_buf_bytes_free 1490944
STAT read_buf_oom 0
STAT reserved_fds 20
STAT cmd_get 947558
STAT cmd_set 900007
STAT cmd_flush 0
STAT cmd_touch 0
STAT cmd_meta 0
STAT get_hits 764479
STAT get_misses 183079
STAT get_expired 0
STAT get_flushed 0
STAT delete_misses 0
STAT delete_hits 0
STAT incr_misses 0
STAT incr_hits 0
STAT decr_misses 0
STAT decr_hits 0
STAT cas_misses 0
STAT cas_hits 0
STAT cas_badval 0
STAT touch_hits 0
STAT touch_misses 0
STAT auth_cmds 0
STAT auth_errors 0
STAT bytes_read 120958693
STAT bytes_written 68483463
STAT limit_maxbytes 67108864
STAT accepting_conns 1
STAT listen_disabled_num 0
STAT time_in_listen_disabled_us 0
STAT threads 4
STAT conn_yields 21283
STAT hash_power_level 17
STAT hash_bytes 1048576
STAT hash_is_expanding 0
STAT slab_reassign_rescues 0
STAT slab_reassign_chunk_rescues 0
STAT slab_reassign_evictions_nomem 0
STAT slab_reassign_inline_reclaim 0
STAT slab_reassign_busy_items 0
STAT slab_reassign_busy_deletes 0
STAT slab_reassign_running 0
STAT slabs_moved 0
STAT lru_crawler_running 0
STAT lru_crawler_starts 12
STAT lru_maintainer_juggles 188389
STAT malloc_fails 0
STAT log_worker_dropped 0
STAT log_worker_written 0
STAT log_watcher_skipped 0
STAT log_watcher_sent 0
STAT log_watchers 0
STAT unexpected_napi_ids 0
STAT round_robin_fallback 0
STAT bytes 15518119
STAT curr_items 120002
STAT total_items 900005
STAT slab_global_page_pool 0
STAT expired_unfetched 0
STAT evicted_unfetched 0
STAT evicted_active 0
STAT evictions 0
STAT reclaimed 0
STAT crawler_reclaimed 0
STAT crawler_items_checked 1200002
STAT lrutail_reflocked 244664
STAT moves_to_cold 1026006
STAT moves_to_warm 249935
STAT moves_within_lru 700
STAT direct_reclaims 0
STAT lru_bumps_dropped 0
END

stats settings
STAT maxbytes 67108864
STAT maxconns 1024
STAT tcpport 11211
STAT udpport 0
STAT inter NULL
STAT verbosity 0
STAT oldest 0
STAT evictions on
STAT domain_socket NULL
STAT umask 700
STAT shutdown_command no
STAT growth_factor 1.25
STAT chunk_size 48
STAT num_threads 4
STAT num_threads_per_udp 4
STAT stat_key_prefix :
STAT detail_enabled no
STAT reqs_per_event 20
STAT cas_enabled yes
STAT tcp_backlog 1024
STAT binding_protocol auto-negotiate
STAT auth_enabled_sasl no
STAT auth_enabled_ascii no
STAT item_size_max 1048576
STAT maxconns_fast yes
STAT hashpower_init 0
STAT slab_reassign yes
STAT slab_automove 1
STAT slab_automove_ratio 0.80
STAT slab_automove_window 30
STAT slab_chunk_max 524288
STAT lru_crawler yes
STAT lru_crawler_sleep 100
STAT lru_crawler_tocrawl 0
STAT tail_repair_time 0
STAT flush_enabled yes
STAT dump_enabled yes
STAT hash_algorithm murmur3
STAT lru_maintainer_thread yes
STAT lru_segmented yes
STAT hot_lru_pct 20
STAT warm_lru_pct 40
STAT hot_max_factor 0.20
STAT warm_max_factor 2.00
STAT temp_lru no
STAT temporary_ttl 61
STAT idle_timeout 0
STAT watcher_logbuf_size 262144
STAT worker_logbuf_size 65536
STAT read_buf_mem_limit 0
STAT track_sizes no
STAT inline_ascii_response no
STAT ext_item_size 512
STAT ext_item_age 4294967295
STAT ext_low_ttl 0
STAT ext_recache_rate 2000
STAT ext_wbuf_size 4194304
STAT ext_compact_under 0
STAT ext_drop_under 0
STAT ext_max_frag 0.80
STAT slab_automove_freeratio 0.010
STAT ext_drop_unread no
STAT ssl_enabled no
STAT ssl_chain_cert (null)
STAT ssl_key (null)
STAT ssl_verify_mode 0
STAT ssl_keyformat 1
STAT ssl_ciphers NULL
STAT ssl_ca_cert NULL
STAT ssl_wbuf_size 16384
STAT ssl_session_cache no
STAT ssl_min_version tlsv1.2
STAT num_napi_ids (null)
STAT memory_file (null)
END

stats items
STAT items:2:number 60000
STAT items:2:number_hot 0
STAT items:2:number_warm 13347
STAT items:2:number_cold 46653
STAT items:2:age_hot 0
STAT items:2:age_warm 4392
STAT items:2:age 4393
STAT items:2:mem_requested 6768890
STAT items:2:evicted 0
STAT items:2:evicted_nonzero 0
STAT items:2:evicted_time 0
STAT items:2:outofmemory 0
STAT items:2:tailrepairs 0
STAT items:2:reclaimed 0
STAT items:2:expired_unfetched 0
STAT items:2:evicted_unfetched 0
STAT items:2:evicted_active 0
STAT items:2:crawler_reclaimed 0
STAT items:2:crawler_items_checked 660000
STAT items:2:lrutail_reflocked 77667
STAT items:2:moves_to_cold 276040
STAT items:2:moves_to_warm 79482
STAT items:2:moves_within_lru 0
STAT items:2:direct_reclaims 0
STAT items:2:hits_to_hot 110870
STAT items:2:hits_to_warm 187
STAT items:2:hits_to_cold 148425
STAT items:2:hits_to_temp 0
STAT items:3:number 60000
STAT items:3:number_hot 0
STAT items:3:number_warm 50
STAT items:3:number_cold 59950
STAT items:3:age_hot 0
STAT items:3:age_warm 957
STAT items:3:age 1213
STAT items:3:mem_requested 8748890
STAT items:3:evicted 0
STAT items:3:evicted_nonzero 0
STAT items:3:evicted_time 0
STAT items:3:outofmemory 0
STAT items:3:tailrepairs 0
STAT items:3:reclaimed 0
STAT items:3:expired_unfetched 0
STAT items:3:evicted_unfetched 0
STAT items:3:evicted_active 0
STAT items:3:crawler_reclaimed 0
STAT items:3:crawler_items_checked 540000
STAT items:3:lrutail_reflocked 166997
STAT items:3:moves_to_cold 749958
STAT items:3:moves_to_warm 170450
STAT items:3:moves_within_lru 700
STAT items:3:direct_reclaims 0
STAT items:3:hits_to_hot 136432
STAT items:3:hits_to_warm 1295
STAT items:3:hits_to_cold 365735
STAT items:3:hits_to_temp 0
STAT items:4:number 2
STAT items:4:number_hot 0
STAT items:4:number_warm 0
STAT items:4:number_cold 2
STAT items:4:age_hot 0
STAT items:4:age_warm 0
STAT items:4:age 569
STAT items:4:mem_requested 339
STAT items:4:evicted 0
STAT items:4:evicted_nonzero 0
STAT items:4:evicted_time 0
STAT items:4:outofmemory 0
STAT items:4:tailrepairs 0
STAT items:4:reclaimed 0
STAT items:4:expired_unfetched 0
STAT items:4:evicted_unfetched 0
STAT items:4:evicted_active 0
STAT items:4:crawler_reclaimed 0
STAT items:4:crawler_items_checked 2
STAT items:4:lrutail_reflocked 0
STAT items:4:moves_to_cold 7
STAT items:4:moves_to_warm 3
STAT items:4:moves_within_lru 0
STAT items:4:direct_reclaims 0
STAT items:4:hits_to_hot 0
STAT items:4:hits_to_warm 0
STAT items:4:hits_to_cold 1534
STAT items:4:hits_to_temp 0
END

stats slabs
STAT 1:chunk_size 96
STAT 1:chunks_per_page 10922
STAT 1:total_pages 1
STAT 1:total_chunks 10922
STAT 1:used_chunks 0
STAT 1:free_chunks 10922
STAT 1:free_chunks_end 0
STAT 1:get_hits 1
STAT 1:cmd_set 3
STAT 1:delete_hits 0
STAT 1:incr_hits 0
STAT 1:decr_hits 0
STAT 1:cas_hits 0
STAT 1:cas_badval 0
STAT 1:touch_hits 0
STAT 2:chunk_size 120
STAT 2:chunks_per_page 8738
STAT 2:total_pages 7
STAT 2:total_chunks 61166
STAT 2:used_chunks 60000
STAT 2:free_chunks 1166
STAT 2:free_chunks_end 0
STAT 2:get_hits 259482
STAT 2:cmd_set 240000
STAT 2:delete_hits 0
STAT 2:incr_hits 0
STAT 2:decr_hits 0
STAT 2:cas_hits 0
STAT 2:cas_badval 0
STAT 2:touch_hits 0
STAT 3:chunk_size 152
STAT 3:chunks_per_page 6898
STAT 3:total_pages 9
STAT 3:total_chunks 62082
STAT 3:used_chunks 60000
STAT 3:free_chunks 2082
STAT 3:free_chunks_end 0
STAT 3:get_hits 503462
STAT 3:cmd_set 660000
STAT 3:delete_hits 0
STAT 3:incr_hits 0
STAT 3:decr_hits 0
STAT 3:cas_hits 0
STAT 3:cas_badval 0
STAT 3:touch_hits 0
STAT 4:chunk_size 192
STAT 4:chunks_per_page 5461
STAT 4:total_pages 1
STAT 4:total_chunks 5461
STAT 4:used_chunks 2
STAT 4:free_chunks 5459
STAT 4:free_chunks_end 0
STAT 4:get_hits 1534
STAT 4:cmd_set 4
STAT 4:delete_hits 0
STAT 4:incr_hits 0
STAT 4:decr_hits 0
STAT 4:cas_hits 0
STAT 4:cas_badval 0
STAT 4:touch_hits 0
STAT active_slabs 4
STAT total_malloced 18874368
END