PSD vector inner product with positive vectors











up vote
2
down vote

favorite












Suppose $A in mathbb{R}^{n times n}$ be a PSD matrix. Let $x,y in mathbb{R}^n$ such that $x = [x_1,...,x_n]^T$ and $y = [y_1,...,y_n]^T$. We require that $x,y$ are element-wise positive, that is $x_i >0$ and $y_i > 0$ for all $i in {1,2,...,n}$. In that case can it be concluded that $x^T A y geq 0$ in general?










share|cite|improve this question


























    up vote
    2
    down vote

    favorite












    Suppose $A in mathbb{R}^{n times n}$ be a PSD matrix. Let $x,y in mathbb{R}^n$ such that $x = [x_1,...,x_n]^T$ and $y = [y_1,...,y_n]^T$. We require that $x,y$ are element-wise positive, that is $x_i >0$ and $y_i > 0$ for all $i in {1,2,...,n}$. In that case can it be concluded that $x^T A y geq 0$ in general?










    share|cite|improve this question
























      up vote
      2
      down vote

      favorite









      up vote
      2
      down vote

      favorite











      Suppose $A in mathbb{R}^{n times n}$ be a PSD matrix. Let $x,y in mathbb{R}^n$ such that $x = [x_1,...,x_n]^T$ and $y = [y_1,...,y_n]^T$. We require that $x,y$ are element-wise positive, that is $x_i >0$ and $y_i > 0$ for all $i in {1,2,...,n}$. In that case can it be concluded that $x^T A y geq 0$ in general?










      share|cite|improve this question













      Suppose $A in mathbb{R}^{n times n}$ be a PSD matrix. Let $x,y in mathbb{R}^n$ such that $x = [x_1,...,x_n]^T$ and $y = [y_1,...,y_n]^T$. We require that $x,y$ are element-wise positive, that is $x_i >0$ and $y_i > 0$ for all $i in {1,2,...,n}$. In that case can it be concluded that $x^T A y geq 0$ in general?







      linear-algebra






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked 2 hours ago









      rajatsen91

      33918




      33918






















          3 Answers
          3






          active

          oldest

          votes

















          up vote
          2
          down vote



          accepted










          No. Let
          $$M=newcommandbmat{begin{pmatrix}}newcommandemat{end{pmatrix}}bmat 0 & 1 \ -1 & 0 emat,$$
          then $$bmat x & y emat bmat 0 & 1 \ -1 & 0 emat bmat a \ bemat = bx-ay,$$
          so in particular when $x=a$, $y=b$, we have that the quadratic form corresponding to $M$ is always zero on any vector, so $M$ is PSD.



          However if $a=y=1$, $x=b=frac{1}{2}$, then the product of the vectors with the matrix will be $frac{1}{4}-1=frac{-3}{4}$.



          The Idea:



          The idea is that rotation by 90 degrees is PSD, since the dot product of a vector and its 90 degree rotation will always be zero.



          However, if we choose the vector to be rotated by 90 degrees to already be closer to the $y$-axis, and the vector to compare it to to be closer to the $x$-axis, then the final product will be a dot product of vectors with an obtuse angle between them, which will be negative.



          The same idea allows us to replace $M$ with a matrix which is e.g. rotation by 45 degrees to get a positive definite matrix which also doesn't have $v^TMu>0$ for positive vectors $v$ and $u$.






          share|cite|improve this answer




























            up vote
            3
            down vote













            No. Take any large positive $n$ and consider
            $$
            pmatrix{1&n}pmatrix{5&-2\ -2&1}pmatrix{1\ 1}=3-n.
            $$






            share|cite|improve this answer




























              up vote
              2
              down vote













              I believe the matrix $A=pmatrix{1&-1\0&1}$ is PSD, however $pmatrix{1&0}^TApmatrix{0&1}=-1$. You can replace $0$ by small enough $epsilon>0$ and it will not change the fact that this results in a negative number.






              share|cite|improve this answer























                Your Answer





                StackExchange.ifUsing("editor", function () {
                return StackExchange.using("mathjaxEditing", function () {
                StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
                StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
                });
                });
                }, "mathjax-editing");

                StackExchange.ready(function() {
                var channelOptions = {
                tags: "".split(" "),
                id: "69"
                };
                initTagRenderer("".split(" "), "".split(" "), channelOptions);

                StackExchange.using("externalEditor", function() {
                // Have to fire editor after snippets, if snippets enabled
                if (StackExchange.settings.snippets.snippetsEnabled) {
                StackExchange.using("snippets", function() {
                createEditor();
                });
                }
                else {
                createEditor();
                }
                });

                function createEditor() {
                StackExchange.prepareEditor({
                heartbeatType: 'answer',
                autoActivateHeartbeat: false,
                convertImagesToLinks: true,
                noModals: true,
                showLowRepImageUploadWarning: true,
                reputationToPostImages: 10,
                bindNavPrevention: true,
                postfix: "",
                imageUploader: {
                brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
                contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
                allowUrls: true
                },
                noCode: true, onDemand: true,
                discardSelector: ".discard-answer"
                ,immediatelyShowMarkdownHelp:true
                });


                }
                });














                draft saved

                draft discarded


















                StackExchange.ready(
                function () {
                StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3046861%2fpsd-vector-inner-product-with-positive-vectors%23new-answer', 'question_page');
                }
                );

                Post as a guest















                Required, but never shown

























                3 Answers
                3






                active

                oldest

                votes








                3 Answers
                3






                active

                oldest

                votes









                active

                oldest

                votes






                active

                oldest

                votes








                up vote
                2
                down vote



                accepted










                No. Let
                $$M=newcommandbmat{begin{pmatrix}}newcommandemat{end{pmatrix}}bmat 0 & 1 \ -1 & 0 emat,$$
                then $$bmat x & y emat bmat 0 & 1 \ -1 & 0 emat bmat a \ bemat = bx-ay,$$
                so in particular when $x=a$, $y=b$, we have that the quadratic form corresponding to $M$ is always zero on any vector, so $M$ is PSD.



                However if $a=y=1$, $x=b=frac{1}{2}$, then the product of the vectors with the matrix will be $frac{1}{4}-1=frac{-3}{4}$.



                The Idea:



                The idea is that rotation by 90 degrees is PSD, since the dot product of a vector and its 90 degree rotation will always be zero.



                However, if we choose the vector to be rotated by 90 degrees to already be closer to the $y$-axis, and the vector to compare it to to be closer to the $x$-axis, then the final product will be a dot product of vectors with an obtuse angle between them, which will be negative.



                The same idea allows us to replace $M$ with a matrix which is e.g. rotation by 45 degrees to get a positive definite matrix which also doesn't have $v^TMu>0$ for positive vectors $v$ and $u$.






                share|cite|improve this answer

























                  up vote
                  2
                  down vote



                  accepted










                  No. Let
                  $$M=newcommandbmat{begin{pmatrix}}newcommandemat{end{pmatrix}}bmat 0 & 1 \ -1 & 0 emat,$$
                  then $$bmat x & y emat bmat 0 & 1 \ -1 & 0 emat bmat a \ bemat = bx-ay,$$
                  so in particular when $x=a$, $y=b$, we have that the quadratic form corresponding to $M$ is always zero on any vector, so $M$ is PSD.



                  However if $a=y=1$, $x=b=frac{1}{2}$, then the product of the vectors with the matrix will be $frac{1}{4}-1=frac{-3}{4}$.



                  The Idea:



                  The idea is that rotation by 90 degrees is PSD, since the dot product of a vector and its 90 degree rotation will always be zero.



                  However, if we choose the vector to be rotated by 90 degrees to already be closer to the $y$-axis, and the vector to compare it to to be closer to the $x$-axis, then the final product will be a dot product of vectors with an obtuse angle between them, which will be negative.



                  The same idea allows us to replace $M$ with a matrix which is e.g. rotation by 45 degrees to get a positive definite matrix which also doesn't have $v^TMu>0$ for positive vectors $v$ and $u$.






                  share|cite|improve this answer























                    up vote
                    2
                    down vote



                    accepted







                    up vote
                    2
                    down vote



                    accepted






                    No. Let
                    $$M=newcommandbmat{begin{pmatrix}}newcommandemat{end{pmatrix}}bmat 0 & 1 \ -1 & 0 emat,$$
                    then $$bmat x & y emat bmat 0 & 1 \ -1 & 0 emat bmat a \ bemat = bx-ay,$$
                    so in particular when $x=a$, $y=b$, we have that the quadratic form corresponding to $M$ is always zero on any vector, so $M$ is PSD.



                    However if $a=y=1$, $x=b=frac{1}{2}$, then the product of the vectors with the matrix will be $frac{1}{4}-1=frac{-3}{4}$.



                    The Idea:



                    The idea is that rotation by 90 degrees is PSD, since the dot product of a vector and its 90 degree rotation will always be zero.



                    However, if we choose the vector to be rotated by 90 degrees to already be closer to the $y$-axis, and the vector to compare it to to be closer to the $x$-axis, then the final product will be a dot product of vectors with an obtuse angle between them, which will be negative.



                    The same idea allows us to replace $M$ with a matrix which is e.g. rotation by 45 degrees to get a positive definite matrix which also doesn't have $v^TMu>0$ for positive vectors $v$ and $u$.






                    share|cite|improve this answer












                    No. Let
                    $$M=newcommandbmat{begin{pmatrix}}newcommandemat{end{pmatrix}}bmat 0 & 1 \ -1 & 0 emat,$$
                    then $$bmat x & y emat bmat 0 & 1 \ -1 & 0 emat bmat a \ bemat = bx-ay,$$
                    so in particular when $x=a$, $y=b$, we have that the quadratic form corresponding to $M$ is always zero on any vector, so $M$ is PSD.



                    However if $a=y=1$, $x=b=frac{1}{2}$, then the product of the vectors with the matrix will be $frac{1}{4}-1=frac{-3}{4}$.



                    The Idea:



                    The idea is that rotation by 90 degrees is PSD, since the dot product of a vector and its 90 degree rotation will always be zero.



                    However, if we choose the vector to be rotated by 90 degrees to already be closer to the $y$-axis, and the vector to compare it to to be closer to the $x$-axis, then the final product will be a dot product of vectors with an obtuse angle between them, which will be negative.



                    The same idea allows us to replace $M$ with a matrix which is e.g. rotation by 45 degrees to get a positive definite matrix which also doesn't have $v^TMu>0$ for positive vectors $v$ and $u$.







                    share|cite|improve this answer












                    share|cite|improve this answer



                    share|cite|improve this answer










                    answered 2 hours ago









                    jgon

                    12k21840




                    12k21840






















                        up vote
                        3
                        down vote













                        No. Take any large positive $n$ and consider
                        $$
                        pmatrix{1&n}pmatrix{5&-2\ -2&1}pmatrix{1\ 1}=3-n.
                        $$






                        share|cite|improve this answer

























                          up vote
                          3
                          down vote













                          No. Take any large positive $n$ and consider
                          $$
                          pmatrix{1&n}pmatrix{5&-2\ -2&1}pmatrix{1\ 1}=3-n.
                          $$






                          share|cite|improve this answer























                            up vote
                            3
                            down vote










                            up vote
                            3
                            down vote









                            No. Take any large positive $n$ and consider
                            $$
                            pmatrix{1&n}pmatrix{5&-2\ -2&1}pmatrix{1\ 1}=3-n.
                            $$






                            share|cite|improve this answer












                            No. Take any large positive $n$ and consider
                            $$
                            pmatrix{1&n}pmatrix{5&-2\ -2&1}pmatrix{1\ 1}=3-n.
                            $$







                            share|cite|improve this answer












                            share|cite|improve this answer



                            share|cite|improve this answer










                            answered 2 hours ago









                            user1551

                            71.2k566125




                            71.2k566125






















                                up vote
                                2
                                down vote













                                I believe the matrix $A=pmatrix{1&-1\0&1}$ is PSD, however $pmatrix{1&0}^TApmatrix{0&1}=-1$. You can replace $0$ by small enough $epsilon>0$ and it will not change the fact that this results in a negative number.






                                share|cite|improve this answer



























                                  up vote
                                  2
                                  down vote













                                  I believe the matrix $A=pmatrix{1&-1\0&1}$ is PSD, however $pmatrix{1&0}^TApmatrix{0&1}=-1$. You can replace $0$ by small enough $epsilon>0$ and it will not change the fact that this results in a negative number.






                                  share|cite|improve this answer

























                                    up vote
                                    2
                                    down vote










                                    up vote
                                    2
                                    down vote









                                    I believe the matrix $A=pmatrix{1&-1\0&1}$ is PSD, however $pmatrix{1&0}^TApmatrix{0&1}=-1$. You can replace $0$ by small enough $epsilon>0$ and it will not change the fact that this results in a negative number.






                                    share|cite|improve this answer














                                    I believe the matrix $A=pmatrix{1&-1\0&1}$ is PSD, however $pmatrix{1&0}^TApmatrix{0&1}=-1$. You can replace $0$ by small enough $epsilon>0$ and it will not change the fact that this results in a negative number.







                                    share|cite|improve this answer














                                    share|cite|improve this answer



                                    share|cite|improve this answer








                                    edited 2 hours ago

























                                    answered 2 hours ago









                                    SmileyCraft

                                    1,666111




                                    1,666111






























                                        draft saved

                                        draft discarded




















































                                        Thanks for contributing an answer to Mathematics Stack Exchange!


                                        • Please be sure to answer the question. Provide details and share your research!

                                        But avoid



                                        • Asking for help, clarification, or responding to other answers.

                                        • Making statements based on opinion; back them up with references or personal experience.


                                        Use MathJax to format equations. MathJax reference.


                                        To learn more, see our tips on writing great answers.





                                        Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


                                        Please pay close attention to the following guidance:


                                        • Please be sure to answer the question. Provide details and share your research!

                                        But avoid



                                        • Asking for help, clarification, or responding to other answers.

                                        • Making statements based on opinion; back them up with references or personal experience.


                                        To learn more, see our tips on writing great answers.




                                        draft saved


                                        draft discarded














                                        StackExchange.ready(
                                        function () {
                                        StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3046861%2fpsd-vector-inner-product-with-positive-vectors%23new-answer', 'question_page');
                                        }
                                        );

                                        Post as a guest















                                        Required, but never shown





















































                                        Required, but never shown














                                        Required, but never shown












                                        Required, but never shown







                                        Required, but never shown

































                                        Required, but never shown














                                        Required, but never shown












                                        Required, but never shown







                                        Required, but never shown







                                        Popular posts from this blog

                                        404 Error Contact Form 7 ajax form submitting

                                        How to know if a Active Directory user can login interactively

                                        TypeError: fit_transform() missing 1 required positional argument: 'X'