spark-submit: 403 error, client System:anonymous error
up vote
1
down vote
favorite
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.3k94864
asked Nov 19 at 13:29
Tang Dexian
1314
add a comment |
up vote
1
down vote
favorite
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.3k94864
asked Nov 19 at 13:29
Tang Dexian
1314
add a comment |
up vote
1
down vote
favorite
up vote
1
down vote
favorite
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.3k94864
asked Nov 19 at 13:29
Tang Dexian
1314
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?
apache-spark
kubernetes google-kubernetes-engine spark-submit apache-spark
kubernetes google-kubernetes-engine spark-submit edited Nov 19 at 19:11
Rico
24.3k94864
asked Nov 19 at 13:29
Tang Dexian
1314
edited Nov 19 at 19:11
Rico
24.3k94864
asked Nov 19 at 13:29
Tang Dexian
1314
edited Nov 19 at 19:11
Rico
24.3k94864
edited Nov 19 at 19:11
Rico
24.3k94864
edited Nov 19 at 19:11
Rico
24.3k94864
24.3k94864
asked Nov 19 at 13:29
Tang Dexian
1314
asked Nov 19 at 13:29
Tang Dexian
1314
asked Nov 19 at 13:29
Tang Dexian
1314
1314
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.3k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.3k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.3k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
up vote
1
down vote
accepted
up vote
1
down vote
accepted
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.3k94864
From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized
Your credentials expire.
I do this
gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.
Sounds like a timing issue where your new credentials and getting propagated in the cluster.
answered Nov 19 at 19:13
Rico
24.3k94864
answered Nov 19 at 19:13
Rico
24.3k94864
answered Nov 19 at 19:13
Rico
24.3k94864
answered Nov 19 at 19:13
Rico
24.3k94864
24.3k94864
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
1
1
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
thanks for the reply, It's really frustrating hitting these quirks..
– Tang Dexian
Nov 19 at 23:42
add a comment |
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375690%2fspark-submit-403-error-client-systemanonymous-error%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
