Does deepflow-agent affect the performance of the Application ?

[kwenzh]

deepflow version： v6.2.6
kerne version： 5.15.72
k8s version： v1.18.19

deploy deepflow in k8s cluster， We have found a performance degradation in the programs within the cluster, including delays, QPS, and mainly some HTTP services and consumer mq tasks. Performance has decreased by about 40%.

Then I did a simple test, starting an http api and testing it with ab tools
demo code:

#!/user/bin/env python
# -*- coding:utf-8 -*-
"""

"""

from BaseHTTPServer import HTTPServer, BaseHTTPRequestHandler
import urlparse
import json
import random
import string


class HTTPHandler(BaseHTTPRequestHandler):

    def do_GET(self):
        print self.path
        res = urlparse.urlparse(self.path)
        param = urlparse.parse_qs(res.query)

        resp = ""
        for k, v in param.items():
            if k == "num":
                val = v[0]
                rs = random.sample("xxxxsfsdffghehuwfnsajfisddjsddmidsa", 10)
                print k, v[0], rs
                resp = val + "".join(rs)


        self.send_response(200, "OK")
        self.end_headers()
        self.wfile.write(resp)


httserver = HTTPServer(("0.0.0.0", 8001), HTTPHandler)

print ">>>>>>>>>> start "
httserver.serve_forever()

client test eg: ab -n 2000 -c 10 http://k8s-ip:nodeport/get_num?num=22

no deepflow-agent result:

Server Software:        BaseHTTP/0.3
Server Hostname:        10.65.138.101
Server Port:            32246

Document Path:          /get_num?num=22
Document Length:        12 bytes

Concurrency Level:      10
Time taken for tests:   0.458 seconds
Complete requests:      2000
Failed requests:        0
Write errors:           0
Total transferred:      206000 bytes
HTML transferred:       24000 bytes
Requests per second:    4363.35 [#/sec] (mean)
Time per request:       2.292 [ms] (mean)
Time per request:       0.229 [ms] (mean, across all concurrent requests)
Transfer rate:          438.89 [Kbytes/sec] received

deeoflow-agent running:

Document Path:          /get_num?num=22
Document Length:        12 bytes

Concurrency Level:      10
Time taken for tests:   0.628 seconds
Complete requests:      2000
Failed requests:        0
Write errors:           0
Total transferred:      206000 bytes
HTML transferred:       24000 bytes
Requests per second:    3186.86 [#/sec] (mean)
Time per request:       3.138 [ms] (mean)
Time per request:       0.314 [ms] (mean, across all concurrent requests)
Transfer rate:          320.55 [Kbytes/sec] received

It looks like qps has decreased by 25%. I know deepflow-agent uses ebpf technology

so I would like to confirm whether deepflow-agent will affect the linux kernel network forwarding performance or CPU performance of programs between clusters. For example, cpu scheduling and network forwarding

[kwenzh]

and the other test , there is a http post api, compared running DeepFlow-agent to not running in the test
When DeepFlow-agent is running, the QPS drops from 5000+ to 2000.+ , it almost -50%