kubernetes上使用spark operator方式部署任务,并集成volcano框架
- 安装volcano
kubectl apply -f ./volcano-install/volcano-development.yaml
- 参考GoogleCloudPlatform/spark-on-k8s-operator安装spark-on-k8s-operator
- 分别启动spark-pi-volcano-without-operator和spark-pi-volcano,修改deploy参数测试,观察执行过程