spark-submit: 403 error, client System:anonymous error











up vote
1
down vote

favorite












From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?






apache-spark kubernetes google-kubernetes-engine spark-submit







share|improve this question




























    up vote
    1
    down vote

    favorite












    From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?






    apache-spark kubernetes google-kubernetes-engine spark-submit







    share|improve this question


























      up vote
      1
      down vote

      favorite









      up vote
      1
      down vote

      favorite











      From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?






      apache-spark kubernetes google-kubernetes-engine spark-submit







      share|improve this question















      From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized, so I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc., but the weird the part is, I just need to do a simple kubectl get namespace, then it works again, why is that?






      apache-spark kubernetes google-kubernetes-engine spark-submit




      apache-spark kubernetes google-kubernetes-engine spark-submit






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 19 at 19:11









      Rico

      24.3k94864




      24.3k94864










      asked Nov 19 at 13:29









      Tang Dexian

      1314




      1314
























          1 Answer
          1






          active

          oldest

          votes

















          up vote
          1
          down vote



          accepted











          From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized




          Your credentials expire.




          I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.




          Sounds like a timing issue where your new credentials and getting propagated in the cluster.






          share|improve this answer

















          • 1




            thanks for the reply, It's really frustrating hitting these quirks..
            – Tang Dexian
            Nov 19 at 23:42











          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














           

          draft saved


          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375690%2fspark-submit-403-error-client-systemanonymous-error%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          up vote
          1
          down vote



          accepted











          From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized




          Your credentials expire.




          I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.




          Sounds like a timing issue where your new credentials and getting propagated in the cluster.






          share|improve this answer

















          • 1




            thanks for the reply, It's really frustrating hitting these quirks..
            – Tang Dexian
            Nov 19 at 23:42















          up vote
          1
          down vote



          accepted











          From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized




          Your credentials expire.




          I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.




          Sounds like a timing issue where your new credentials and getting propagated in the cluster.






          share|improve this answer

















          • 1




            thanks for the reply, It's really frustrating hitting these quirks..
            – Tang Dexian
            Nov 19 at 23:42













          up vote
          1
          down vote



          accepted







          up vote
          1
          down vote



          accepted







          From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized




          Your credentials expire.




          I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.




          Sounds like a timing issue where your new credentials and getting propagated in the cluster.






          share|improve this answer













          From time to time, when I submit spark job to Google Kubernetes cluster, I got 401 unauthorized




          Your credentials expire.




          I do this gcloud container clusters get-credential my-cluster, but it almost always followed by 403 error, saying client system:anonymous etc.




          Sounds like a timing issue where your new credentials and getting propagated in the cluster.







          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Nov 19 at 19:13









          Rico

          24.3k94864




          24.3k94864








          • 1




            thanks for the reply, It's really frustrating hitting these quirks..
            – Tang Dexian
            Nov 19 at 23:42














          • 1




            thanks for the reply, It's really frustrating hitting these quirks..
            – Tang Dexian
            Nov 19 at 23:42








          1




          1




          thanks for the reply, It's really frustrating hitting these quirks..
          – Tang Dexian
          Nov 19 at 23:42




          thanks for the reply, It's really frustrating hitting these quirks..
          – Tang Dexian
          Nov 19 at 23:42


















           

          draft saved


          draft discarded



















































           


          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375690%2fspark-submit-403-error-client-systemanonymous-error%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          -

          Popular posts from this blog

          404 Error Contact Form 7 ajax form submitting

          Image
          0 The contact form does not work, and affects loading after one try. The chrome console shows the error message: POST http://example.com/wp-json/contact-form-7/v1/contact-forms/50/feedback 404 (Not Found) send @ jquery.js?ver=1.12.4:4 ajax @ jquery.js?ver=1.12.4:4 wpcf7.submit @ scripts.js?ver=5.0.3:346 (anonymous) @ scripts.js?ver=5.0.3:53 dispatch @ jquery.js?ver=1.12.4:3 r.handle @ jquery.js?ver=1.12.4:3 How to solve this issue? thanks in advance javascript wordpress contact-form-7 share | improve this question edited Jul 17 '18 at 5:39 Kiran Shahi 4,745 3 16 43 ...
          Read more

          How to know if a Active Directory user can login interactively

          Image
          1 I would like to know if and how is it possible to know if a AD user can login interactively (on a server) in a domain. I need to know if I can find it out using a LDAP search. Thanks. windows active-directory login user-permissions user-profile share | improve this question edited 1 hour ago yagmoth555 ♦ 11.6k 3 17 42 asked 1 hour ago Luigi Luigi 6 1 New contributor ...
          Read more

          Refactoring coordinates for Minecraft Pi buildings written in Python

          Image
          0 $begingroup$ I'm fairly new to coding and I wrote this script in Python for a house with a roof in Minecraft Pi. I've found different ways to write the coordinates to make the code base shorter, but I'm wondering if it is possible for me to refactor it any further so I don't have to list each coordinate line by line. import mcpi.minecraft as minecraft import mcpi.block as block mc = minecraft.Minecraft.create() p = mc.player.getTilePos() mc.setBlocks(p.x+1, p.y, p.z+1, #Main structure starting coordinates (DO NOT ALTER) p.x+19, p.y+4, p.z+6, #Structure size/coordinates (Alters cube size) block.STONE_BRICK) mc.setBlocks(p.x+2, p.y+1, p.z+2, #Hollowing out main structure interior p.x+18, p.y+3, p.z+5, block.AIR) mc.setBlocks(p.x, p.y...
          Read more