file bytes uploading error in jaeger: span too large to send #2628

LiuShuKu · 2023-05-07T10:15:25Z

1. What version of `Go` and system type/arch are you using?

go 1.19

2. What version of `GoFrame` are you using?

2.4.1

问题描述：

外部接口返回了一个 []byte。将[]byte 转换为 formData 文件、然后上传、就会出现 **2023/05/07 17:59:33 multiple errors during transform: span too large to send: ** 这个错误；

流程：

调用BytesToFormData() 后执行 g.Client().ContentType(contentType).PostVar(gctx.New(), requestURL, data) 大概过1-3秒左右就会报错
但是文件能正常的上传、只是jaeger报错。

ps: 上传接口就是个简单的上传；

以下是byte数组转FormData 函数

func (f *file) BytesToFormData(data []byte, fieldName string, fileNames ...string) (err error, formDataContentType string, formData *bytes.Buffer) {

	var (
		fileName string
		formFile io.Writer
		writer   *multipart.Writer
	)
	// 文件名
	{
		if len(fileNames) > 0 {
			fileName = fileNames[0]
		} else {
			fileName = "file.jpg"
		}
	}
	// 初始化 FormFile
	{
		formData = new(bytes.Buffer)
		writer = multipart.NewWriter(formData)
		formFile, err = writer.CreateFormFile(fieldName, fileName)
		if err != nil {
			err = gerror.Wrap(err, "初始化文件失败")
			return
		}
	}
	// 拷贝文件
	{
		_, err = io.Copy(formFile, bytes.NewReader(data))
		if err != nil {
			err = gerror.Wrap(err, "拷贝文件失败")
			return
		}
	}
	// 类型
	{
		formDataContentType = writer.FormDataContentType()
		err = writer.Close()
		if err != nil {
			err = gerror.Wrap(err, "关闭输出对象失败")
			return
		}
	}
	return
}

解决办法尝试过：

1 .尝试过将当前链路上所有的ctx都变成 gctx.New() --> 不管用

尝试过 defer tp.shutdown(ctx) 不管用；

The text was updated successfully, but these errors were encountered:

houseme · 2023-05-07T12:46:56Z

上传的文件大小是多少M？

Issues-translate-bot · 2023-05-07T12:47:09Z

What is the size of the uploaded file in M?

LiuShuKu · 2023-05-07T13:42:57Z

不到1M

Issues-translate-bot · 2023-05-07T13:43:08Z

Less than 1M

zcyc · 2023-05-11T01:19:19Z

试试在配置文件的 server 节点下添加如下配置
clientMaxBodySize = "200MB"

Issues-translate-bot · 2023-05-11T01:19:30Z

Try adding the following configuration under the server node of the configuration file
clientMaxBodySize = "200MB"

LiuShuKu · 2023-05-11T04:29:36Z

不是这个问题追踪到里面去，发现span标签的大小超过Jaeger的限制

Issues-translate-bot · 2023-05-11T04:29:48Z

It’s not that this problem was traced inside, and it was found that the size of the span tag exceeded the limit of Jaeger

houseme · 2023-05-11T04:52:27Z

把整体错误日志内容贴一下，以及控制器方法代码也贴一下

Issues-translate-bot · 2023-05-11T04:52:38Z

Post the content of the overall error log, and the code of the controller method

LiuShuKu · 2023-05-11T04:58:20Z

目前已经改为标准库的http了，现在没有问题了；
使用g.Client的方法进行请求。data为[]byte 就会出现问题，您可以简单的测试一下

Issues-translate-bot · 2023-05-11T04:58:31Z

At present, it has been changed to http in the standard library, and there is no problem now;
Use the method of g.Client to make a request. There will be problems if the data is []byte, you can simply test it

houseme · 2023-05-11T05:17:14Z

大概指导原因了，要不提 pr 修复一下，查一下 otel 的限制值就可以了

Issues-translate-bot · 2023-05-11T05:17:26Z

Probably the reason for the guidance, if you don’t mention pr to fix it, just check the limit value of otel

houseme · 2023-05-11T07:57:05Z

https://github.com/jaegertracing/jaeger-client-go/blob/master/transport_udp.go#L37
https://github.com/open-telemetry/opentelemetry-go/blob/7dea2225a218872e86d2f580e82c089b321617b0/exporters/jaeger/agent.go#L145

限制在这里

Issues-translate-bot · 2023-05-11T07:57:18Z

https://github.com/jaegertracing/jaeger-client-go/blob/master/transport_udp.go#L37
https://github.com/open-telemetry/opentelemetry-go/blob/7dea2225a218872e86d2f580e82c089b321617b0/exporters/jaeger/agent.go#L145

What's the limit here?

LiuShuKu · 2023-05-11T08:00:11Z

我当时断点看到了这个限制了；但是WithMaxPacketSize 这里配置多少都不起作用

houseme · 2023-05-11T08:22:08Z

最终不能超过这个

// udpPacketMaxLength is the max size of UDP packet we want to send, synced with jaeger-agent.
udpPacketMaxLength = 65000

if params.MaxPacketSize <= 0 || params.MaxPacketSize > udpPacketMaxLength {
	params.MaxPacketSize = udpPacketMaxLength
}

详细细节 https://github.com/open-telemetry/opentelemetry-go/blob/7dea2225a218872e86d2f580e82c089b321617b0/exporters/jaeger/agent.go#L123

open-telemetry/opentelemetry-go#2715

jaegertracing/jaeger-client-node#242

https://www.jaegertracing.io/docs/1.18/client-libraries/

#1958

LiuShuKu · 2023-05-11T08:30:35Z

那小于65000 不太现实；可否在g.Client 去除对大[]byte的jaeger的上报吗

Issues-translate-bot · 2023-05-11T08:30:48Z

It is unrealistic if it is less than 65000; can you remove the report of the big []byte jaeger in g.Client

houseme · 2023-05-11T08:34:35Z

可以在启动命令里添加：gf.gtrace.max.content.log.size 给参数赋值，限制大小 @LiuShuKu @Rebellioncry

Issues-translate-bot · 2023-05-11T08:34:46Z

You can add in the startup command: gf.gtrace.max.content.log.size to assign a value to the parameter and limit the size

LiuShuKu · 2023-05-11T08:35:19Z

可以优雅一点吗

Issues-translate-bot · 2023-05-11T08:35:32Z

be more elegant

houseme · 2023-05-11T08:36:57Z

你来提一个 pr 吧，目前框架支持传入命令参数处理！

Issues-translate-bot · 2023-05-11T08:37:12Z

Come and mention a pr, the current framework supports the processing of incoming command parameters!

houseme · 2023-05-12T06:27:29Z

可以使用 otlp 的方式上报 #2641

Issues-translate-bot · 2023-05-12T06:27:39Z

You can use otlp to report #2641

LiuShuKu · 2023-05-12T06:31:17Z

可以给个示例吗

Issues-translate-bot · 2023-05-12T06:31:28Z

can you give an example

houseme · 2023-05-12T06:32:17Z

example/trace/otlp

Issues-translate-bot · 2023-05-12T06:32:29Z

example/trace/otlp

LiuShuKu · 2023-05-12T06:34:42Z

未在主库看到

Issues-translate-bot · 2023-05-12T06:34:54Z

not seen in main library

gqcn · 2023-08-21T14:02:17Z

https://github.com/gogf/gf/tree/master/example/trace/otlp

gqcn changed the title ~~byte[] 文件上传使用jaeger链路追踪报span too large to send~~ file bytes uploading error in jaeger: span too large to send Jul 4, 2023

gqcn closed this as completed Aug 21, 2023

gqcn added enhancement done This issue is done, which may be release in next version. labels Aug 21, 2023

file bytes uploading error in jaeger: span too large to send #2628

file bytes uploading error in jaeger: span too large to send #2628

Comments

LiuShuKu commented May 7, 2023 • edited by houseme Loading

1. What version of Go and system type/arch are you using?

2. What version of GoFrame are you using?

问题描述：

流程：

以下是byte数组转FormData 函数

解决办法尝试过：

houseme commented May 7, 2023

Issues-translate-bot commented May 7, 2023

LiuShuKu commented May 7, 2023

Issues-translate-bot commented May 7, 2023

zcyc commented May 11, 2023

Issues-translate-bot commented May 11, 2023

LiuShuKu commented May 11, 2023

Issues-translate-bot commented May 11, 2023

houseme commented May 11, 2023

Issues-translate-bot commented May 11, 2023

LiuShuKu commented May 11, 2023

Issues-translate-bot commented May 11, 2023

houseme commented May 11, 2023

Issues-translate-bot commented May 11, 2023

houseme commented May 11, 2023 • edited Loading

Issues-translate-bot commented May 11, 2023

LiuShuKu commented May 11, 2023

houseme commented May 11, 2023 • edited Loading

LiuShuKu commented May 11, 2023

Issues-translate-bot commented May 11, 2023

houseme commented May 11, 2023 • edited Loading

Issues-translate-bot commented May 11, 2023

LiuShuKu commented May 11, 2023 • edited Loading

Issues-translate-bot commented May 11, 2023

houseme commented May 11, 2023

Issues-translate-bot commented May 11, 2023

houseme commented May 12, 2023

Issues-translate-bot commented May 12, 2023

LiuShuKu commented May 12, 2023

Issues-translate-bot commented May 12, 2023

houseme commented May 12, 2023

Issues-translate-bot commented May 12, 2023

LiuShuKu commented May 12, 2023

Issues-translate-bot commented May 12, 2023

gqcn commented Aug 21, 2023

LiuShuKu commented May 7, 2023 •

edited by houseme

Loading

1. What version of `Go` and system type/arch are you using?

2. What version of `GoFrame` are you using?

houseme commented May 11, 2023 •

edited

Loading

houseme commented May 11, 2023 •

edited

Loading

houseme commented May 11, 2023 •

edited

Loading

LiuShuKu commented May 11, 2023 •

edited

Loading