Using Prometheus To Monitoring K8s Cluster

Now that our service is deployed in the K8s cluster, we want to deploy a monitoring service to automatically monitor the resources in the K8s cluster. This blog is divided into two parts. First is using Prometheus to monitor the service for our K8s cluster, when the monitor service finds some node or pod has issues and sends an alert as soon as possible, our deployer can fix the issues asap. And the second page is coded as simply Shell scripts to test the cluster’s network.



Support E2E Test && Jenkins Build Pod Could not connect to Ryuk

Now we use DolphinScheduler version 2.0.5 to build our data platform, and we want to improve our platform stability and find the bugs as soon as pissboy, so we want to introduce an E2E test in our project. Writing for recording enabling the E2E test process and the resolution of the Could not connect to Ryuk question.

支持E2E测试 && Jenkins Build Pod Could not connect to Ryuk

我们目前在使用DolphinScheduler 2.0.5版本搭建大数据调度平台,由于想要提高系统稳定性,尽早能发现bug,所以我们想在项目中引入E2E测试。本文记录启用E2E的过程和遇到Could not connect to Ryuk问题的解决过程。

Fluentd Performance Tuning

We have deployed the log colleges system in the k8s cluster before, but have poor performance. The maximum resource of Fluentd is 800M memory and 1 CPU, it can only process and push almost 1500 logs per second. We need performance tuning.

Fluentd 性能优化


DolphinScheduler Start Docker & Kubernetes Config Data Injection Ideas

After DolphinScheduler was deployed succeeded, I was thinking about how to inject the config data into the project. This document is for recording.

DolphinScheduler启动时参数注入思路(Docker & Kubernetes)


DolphinScheduler Deployment on Docker & Kubernetes Question Summary

Recently we are working on deployment dolphinscheduler on docker & k8s following the official guide.

DolphinScheduler部署中的一些坑(Docker & Kubernetes)


Your browser is out-of-date!

Update your browser to view this website correctly. Update my browser now