workflow-v2.14.0 on kubernetes v1.6.2 issues

[Cryptophobia]

From @xiaoping378 on May 5, 2017 7:45

SETUP:

1. add role for helm

kubectl create clusterrolebinding cluster-admin-helm --clusterrole=cluster-admin --serviceaccount=kube-system:helm

2. helm init --service-account helm

    ➜  helm version
    Client: &version.Version{SemVer:"v2.4.1", GitCommit:"46d9ea82e2c925186e1fc620a8320ce1314cbb02", GitTreeState:"clean"}
    Server: &version.Version{SemVer:"v2.4.1", GitCommit:"46d9ea82e2c925186e1fc620a8320ce1314cbb02", GitTreeState:"clean"}

3. helm update && helm repo add helm repo add deis https://charts.deis.com/workflow

4. helm install deis/workflow --namespace deis

➜ kubectl get po -n deis                         
NAME                                     READY     STATUS             RESTARTS   AGE
deis-builder-1134410811-pnwkl            0/1       Running            1          1h
deis-controller-2000207379-4nw2g         1/1       Running            0          1h
deis-database-244447703-xkzdw            1/1       Running            0          1h
deis-logger-2533678197-wm668             1/1       Running            2          1h
deis-logger-fluentd-45kw4                0/1       CrashLoopBackOff   13         46m
deis-logger-redis-1307646428-pghzd       1/1       Running            0          1h
deis-minio-3195500219-hdxqw              1/1       Running            0          1h
deis-monitor-grafana-59098797-xv98s      1/1       Running            0          1h
deis-monitor-influxdb-168332144-vc7wb    1/1       Running            0          1h
deis-monitor-telegraf-9sjtw              0/1       CrashLoopBackOff   16         1h
deis-nsqd-1042535208-lb1f0               1/1       Running            0          1h
deis-registry-2249489191-9jpgw           1/1       Running            2          1h
deis-registry-proxy-53089                1/1       Running            0          1h
deis-router-3258454730-jh10h             1/1       Running            16         1h
deis-workflow-manager-3582051402-39vrh   1/1       Running            0          1h

the crash fluentd said:

➜  kubectl logs -n deis deis-logger-fluentd-45kw4
/var/log/containers contains broken links
linked /var/lib/docker/containers to /home/Docker/docker/containers
2017-05-05 07:38:41 +0000 [info]: reading config file path="/opt/fluentd/conf/fluentd.conf"
2017-05-05 07:38:41 +0000 [info]: starting fluentd-0.14.15 pid=1
2017-05-05 07:38:41 +0000 [info]: spawn command to main:  cmdline=["/usr/bin/ruby2.3", "-Eascii-8bit:ascii-8bit", "/usr/local/bin/fluentd", "-c", "/opt/fluentd/conf/fluentd.conf", "--under-supervisor"]
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-mixin-config-placeholders' version '0.4.0'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-mixin-rewrite-tag-name' version '0.1.0'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-plugin-deis_output' version '0.1.0'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '1.7.0'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-plugin-kubernetes_metadata_filter' version '0.25.3'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-plugin-remote_syslog' version '0.3.2'
2017-05-05 07:38:41 +0000 [info]: gem 'fluent-plugin-sumologic-mattk42' version '0.0.4'
2017-05-05 07:38:41 +0000 [info]: gem 'fluentd' version '0.14.15'
2017-05-05 07:38:41 +0000 [info]: gem 'fluentd' version '0.14.13'
2017-05-05 07:38:41 +0000 [info]: adding filter pattern="kubernetes.**" type="kubernetes_metadata"
2017-05-05 07:38:41 +0000 [info]: adding match pattern="**" type="copy"
2017-05-05 07:38:41 +0000 [error]: #0 config error file="/opt/fluentd/conf/fluentd.conf" error_class=Fluent::ConfigError error="Exception encountered fetching metadata from Kubernetes API endpoint: 403 Forbidden"
2017-05-05 07:38:41 +0000 [info]: Worker 0 finished unexpectedly with status 2
2017-05-05 07:38:41 +0000 [info]: Received graceful stop

the crashed telegraf said:

➜   kubectl logs -n deis deis-monitor-telegraf-9sjtw
parse error: Invalid numeric literal at line 1, column 5

note.

i have added the cluster-admin role to deis-router serviceaccout, if don't, it will Crash

Copied from original issue: deis/workflow#809

[Cryptophobia]

From @xiaoping378 on May 5, 2017 8:34

kubectl apply -f files-rbac.yml

Worked. all pods are running

[Cryptophobia]

From @Bregor on May 5, 2017 9:38

I'm on a way to make pull request from this gist.
If anybody want to help me with helm, it will be great.