jaeger: collector: Failed to insert span: failed to Exec query & agent: timeout to collector

Hello, I’m seeing 2 problems and I’m not sure they are related. jaeger is deployed using the production template at https://github.com/jaegertracing/jaeger-kubernetes

problem 1 : collector errors

~ ❯❯❯ kubej logs jaeger-collector-2191353639-87k5x
{"level":"error","ts":1505932275.2450123,"caller":"metrics/table.go:54","msg":"Failed to exec query","query":"[query statement=\"\\n\\t\\tINSERT\\n\\t\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\n\\t\\t\\t\\t    start_time, duration, tags, logs, refs, process)\\n\\t\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \u0019\u000c\u0019\u000c\u0000\u0016̔\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]","error":"String didn't validate.","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:176\ngithub.com/uber/jaeger/pkg/cassandra/metrics.(*Table).Exec\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/cassandra/metrics/table.go:54\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:142\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71"}
{"level":"error","ts":1505932275.248957,"caller":"spanstore/writer.go:237","msg":"Failed to insert span","trace_id":"2a07d8276378df0f","span_id":1370522953428962601,"error":"failed to Exec query '[query statement=\"\\n\\t\\tINSERT\\n\\t\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\n\\t\\t\\t\\t    start_time, duration, tags, logs, refs, process)\\n\\t\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \u0019\u000c\u0019\u000c\u0000\u0016̔\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]': String didn't validate.","errorVerbose":"String didn't validate.\nfailed to Exec query '[query statement=\"\\n\\t\\tINSERT\\n\\t\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\n\\t\\t\\t\\t    start_time, duration, tags, logs, refs, process)\\n\\t\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \u0019\u000c\u0019\u000c\u0000\u0016̔\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]'\ngithub.com/uber/jaeger/pkg/cassandra/metrics.(*Table).Exec\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/cassandra/metrics/table.go:56\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:142\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\nruntime.goexit\n\t/home/travis/.gimme/versions/go1.7.linux.amd64/src/runtime/asm_amd64.s:2086","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:176\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).logError\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:237\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:143\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71"}
{"level":"error","ts":1505932275.249009,"caller":"app/span_processor.go:109","msg":"Failed to save span","error":"Failed to insert span: failed to Exec query '[query statement=\"\\n\\t\\tINSERT\\n\\t\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\n\\t\\t\\t\\t    start_time, duration, tags, logs, refs, process)\\n\\t\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \u0019\u000c\u0019\u000c\u0000\u0016̔\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]': String didn't validate.","errorVerbose":"String didn't validate.\nfailed to Exec query '[query statement=\"\\n\\t\\tINSERT\\n\\t\\tINTO traces(trace_id, span_id, span_hash, parent_id, operation_name, flags,\\n\\t\\t\\t\\t    start_time, duration, tags, logs, refs, process)\\n\\t\\tVALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)\" values=[2a07d8276378df0f 1370522953428962601 -2132593763436613675 685406953 \u0019\u000c\u0019\u000c\u0000\u0016̔\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd\u0001 359177838 1820226890504781 -10 [] [] [] {ServiceName:metrictank Tags:[{Key:jaeger.version ValueType:string ValueString:Go-2.9.1dev ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:hostname ValueType:string ValueString:mt-read02-12574-medium-ops-a-563083619-cjmt5 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]} {Key:ip ValueType:string ValueString:172.20.128.8 ValueBool:false ValueInt64:0 ValueFloat64:0 ValueBinary:[]}]}] consistency=LOCAL_ONE]'\ngithub.com/uber/jaeger/pkg/cassandra/metrics.(*Table).Exec\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/cassandra/metrics/table.go:56\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:142\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\nruntime.goexit\n\t/home/travis/.gimme/versions/go1.7.linux.amd64/src/runtime/asm_amd64.s:2086\nFailed to insert span\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).logError\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:238\ngithub.com/uber/jaeger/plugin/storage/cassandra/spanstore.(*SpanWriter).WriteSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/plugin/storage/cassandra/spanstore/writer.go:143\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:108\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71\nruntime.goexit\n\t/home/travis/.gimme/versions/go1.7.linux.amd64/src/runtime/asm_amd64.s:2086","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:176\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).saveSpan\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:109\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).(github.com/uber/jaeger/cmd/collector/app.saveSpan)-fm\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:95\ngithub.com/uber/jaeger/cmd/collector/app.ChainedProcessSpan.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/model_consumer.go:38\ngithub.com/uber/jaeger/cmd/collector/app.(*spanProcessor).processItemFromQueue\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:132\ngithub.com/uber/jaeger/cmd/collector/app.NewSpanProcessor.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/app/span_processor.go:63\ngithub.com/uber/jaeger/pkg/queue.(*BoundedQueue).StartConsumers.func1\n\t/home/travis/gopath/src/github.com/uber/jaeger/pkg/queue/bounded_queue.go:71"}

note that all messages were at the same time, about 6 days ago. not sure if this provides more info, but fwiw:

~ ❯❯❯ kubej get po
NAME                                READY     STATUS    RESTARTS   AGE
cassandra-0                         1/1       Running   2          27d
cassandra-1                         1/1       Running   2          27d
cassandra-2                         1/1       Running   5          27d
jaeger-agent-1133288941-xlgp3       1/1       Running   18         8d
jaeger-collector-2191353639-87k5x   1/1       Running   2          27d
jaeger-query-241882977-19q89        1/1       Running   2          27d
~ ❯❯❯ kubej logs jaeger-collector-2191353639-87k5x -p
2017/08/30 07:04:43 gocql: unable to dial control conn 172.25.0.4: dial tcp 172.25.0.4:9042: getsockopt: connection refused
{"level":"fatal","ts":1504076683.164841,"caller":"collector/main.go:67","msg":"Unable to build span handlers","error":"gocql: unable to create session: control: unable to connect to initial hosts: dial tcp 172.25.0.4:9042: getsockopt: connection refused","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:209\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:273\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Fatal\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:208\nmain.main\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/collector/main.go:67"}
~ ❯❯❯ date -d @1504076683
Wed Aug 30 09:04:43 CEST 2017

problem 2

my app reports:

2017/09/26 09:17:05 ERROR: error reporting span "getTargetsLocal": write udp 172.21.192.18:42191->100.90.41.92:6831: write: connection refused

i checked the k8s svc and that is setup properly. the agent logs:

~ ❯❯❯ kubej logs jaeger-agent-1133288941-xlgp3
{"level":"info","ts":1506159461.5915134,"caller":"tchannel/bulider.go:89","msg":"Enabling service discovery","service":"jaeger-collector"}
{"level":"info","ts":1506159461.5915678,"caller":"peerlistmgr/peer_list_mgr.go:111","msg":"Registering active peer","peer":"jaeger-collector.jaeger.svc:14267"}
{"level":"info","ts":1506159461.5922403,"caller":"agent/main.go:50","msg":"Starting agent"}
{"level":"info","ts":1506159462.5920308,"caller":"peerlistmgr/peer_list_mgr.go:159","msg":"Not enough connected peers","connected":0,"required":1}
{"level":"info","ts":1506159462.5920768,"caller":"peerlistmgr/peer_list_mgr.go:166","msg":"Trying to connect to peer","host:port":"jaeger-collector.jaeger.svc:14267"}
{"level":"info","ts":1506159462.599572,"caller":"peerlistmgr/peer_list_mgr.go:176","msg":"Connected to peer","host:port":"[::]:14267"}
{"level":"error","ts":1506160384.136238,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160680.4919758,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160682.406441,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160683.9214954,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160684.2446356,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160684.8248649,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160685.1431754,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8288321,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.832627,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8339095,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8357015,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.847109,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8483703,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8502076,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8767972,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8807807,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506160686.8808224,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}
{"level":"error","ts":1506162803.0297039,"caller":"tchannel/reporter.go:131","msg":"Could not submit jaeger batch","error":"tchannel error ErrCodeTimeout: timeout","stacktrace":"github.com/uber/jaeger/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/field.go:191\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).check\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:301\ngithub.com/uber/jaeger/vendor/go.uber.org/zap.(*Logger).Error\n\t/home/travis/gopath/src/github.com/uber/jaeger/vendor/go.uber.org/zap/logger.go:202\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).submitAndReport\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:131\ngithub.com/uber/jaeger/cmd/agent/app/reporter/tchannel.(*Reporter).EmitBatch\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/reporter/tchannel/reporter.go:121\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:137\ngithub.com/uber/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\t/home/travis/gopath/src/github.com/uber/jaeger/thrift-gen/jaeger/agent.go:111\ngithub.com/uber/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\t/home/travis/gopath/src/github.com/uber/jaeger/cmd/agent/app/processors/thrift_processor.go:110"}