We have deployed the log colleges system in the k8s cluster before, but have poor performance. The maximum resource of Fluentd is 800M memory and 1 CPU, it can only process and push almost 1500 logs per second. We need performance tuning.
We have deployed the log colleges system in the k8s cluster before, but have poor performance. The maximum resource of Fluentd is 800M memory and 1 CPU, it can only process and push almost 1500 logs per second. We need performance tuning.
之前我们已经在k8s集群中搭建好日志收集系统了,但是经过测试后性能很差,在设置Fulentd的最大资源是800M内存,1核CPU后进行压测,1秒中能处理并推送大约1500条日志,需要调优以提高性能。
After DolphinScheduler was deployed succeeded, I was thinking about how to inject the config data into the project. This document is for recording.
DolphinScheduler搭建好之后,思考了一下在Docker和Kubernetes不同模式下配置参数是如何注入到项目里的。
Recently we are working on deployment dolphinscheduler on docker & k8s following the official guide.
最近在跟着官方文档搭建docker和k8s模式的dolphinscheduler,遇到了一些问题记录下来。
目前在K8s中比较流行的日志收集方案主要是Elasticsearch
、Fluentd
和 Kibana
(EFK)技术栈,也是官方文档中推荐的方案。
我司已经搭建好Log->Kafka->Elasticsearch->Kibana整套流程,我们只需要使用Fluentd收集K8s集群中日志,然后发送到Kafka topic中即可。
先说一下背景,项目中有一个调度页任务是分配数据,然后跳转到指定的URL,然后在这个URL进行操作后,会再次跳转到调度页,然后再跳转到URL。前两天出现了一个很神奇的情况,第一次跳转到调度页是空白,第二次跳转是正常的,然后在指定的URL里操作后,跳转到调度页空白,重新打开调度页正常。
Update your browser to view this website correctly. Update my browser now