Python 3, post method misleading












0















Here are two examples that demonstrate successful POST requests. But i cannot replicate this autonomously.



Example1



visually required: data={'SearchTxt':'bla'}



actually required: data={'page':'search', 'SearchTxt':'bla'}



import requests
session = requests.Session()
a = session.head('https://www.axemusic.com')
session.cookies['Lm722stores'] = None
session.cookies.set('Lm722stores', '5h5i1rm6q3ur4mg67rs7kb77p4', domain='.axemusic.com', path='/')
response = session.post('https://www.axemusic.com/', data={'page':'search', 'SearchTxt':'bla'})
if response.text.find('Search results for bla') != -1: print('found')
else: print('not found')


Example2



visually required: https://stackoverflow.com data={'q':'bla'}



actually required: https://stackoverflow.com/search data={'q':'bla'}



import requests
session = requests.Session()
a = session.head('https://stackoverflow.com')
session.cookies['prov'] = None
session.cookies.set('prov', '2922137c-e851-cd7e-8df4-9e5eb968ab33', domain='.stackoverflow.com', path='/')
response = session.post('https://stackoverflow.com/search', data={'q':'bla'})
if response.text.find('highlight">bla</span>') != -1: print('found')
else: print('not found')


Is there a way to make this process more autonomous. I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST.










share|improve this question




















  • 1





    What are you talking about? I am sorry I cannot understand. Could you make it clearer? What is "visually required"?

    – Sraw
    Nov 22 '18 at 22:03











  • when you go to stackoverflow.com ... you have the option to search ... but this is not true with requests .... only stackoverflow.com/search allows you the option to search

    – Rhys
    Nov 22 '18 at 22:43











  • It isn't related to requests. You just don't understand how site works. You have the option to search on domain.com doesn't mean all your requests are sent to this route. Obviously some or most of your requests are sent to other specifical routes.

    – Sraw
    Nov 22 '18 at 23:08
















0















Here are two examples that demonstrate successful POST requests. But i cannot replicate this autonomously.



Example1



visually required: data={'SearchTxt':'bla'}



actually required: data={'page':'search', 'SearchTxt':'bla'}



import requests
session = requests.Session()
a = session.head('https://www.axemusic.com')
session.cookies['Lm722stores'] = None
session.cookies.set('Lm722stores', '5h5i1rm6q3ur4mg67rs7kb77p4', domain='.axemusic.com', path='/')
response = session.post('https://www.axemusic.com/', data={'page':'search', 'SearchTxt':'bla'})
if response.text.find('Search results for bla') != -1: print('found')
else: print('not found')


Example2



visually required: https://stackoverflow.com data={'q':'bla'}



actually required: https://stackoverflow.com/search data={'q':'bla'}



import requests
session = requests.Session()
a = session.head('https://stackoverflow.com')
session.cookies['prov'] = None
session.cookies.set('prov', '2922137c-e851-cd7e-8df4-9e5eb968ab33', domain='.stackoverflow.com', path='/')
response = session.post('https://stackoverflow.com/search', data={'q':'bla'})
if response.text.find('highlight">bla</span>') != -1: print('found')
else: print('not found')


Is there a way to make this process more autonomous. I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST.










share|improve this question




















  • 1





    What are you talking about? I am sorry I cannot understand. Could you make it clearer? What is "visually required"?

    – Sraw
    Nov 22 '18 at 22:03











  • when you go to stackoverflow.com ... you have the option to search ... but this is not true with requests .... only stackoverflow.com/search allows you the option to search

    – Rhys
    Nov 22 '18 at 22:43











  • It isn't related to requests. You just don't understand how site works. You have the option to search on domain.com doesn't mean all your requests are sent to this route. Obviously some or most of your requests are sent to other specifical routes.

    – Sraw
    Nov 22 '18 at 23:08














0












0








0








Here are two examples that demonstrate successful POST requests. But i cannot replicate this autonomously.



Example1



visually required: data={'SearchTxt':'bla'}



actually required: data={'page':'search', 'SearchTxt':'bla'}



import requests
session = requests.Session()
a = session.head('https://www.axemusic.com')
session.cookies['Lm722stores'] = None
session.cookies.set('Lm722stores', '5h5i1rm6q3ur4mg67rs7kb77p4', domain='.axemusic.com', path='/')
response = session.post('https://www.axemusic.com/', data={'page':'search', 'SearchTxt':'bla'})
if response.text.find('Search results for bla') != -1: print('found')
else: print('not found')


Example2



visually required: https://stackoverflow.com data={'q':'bla'}



actually required: https://stackoverflow.com/search data={'q':'bla'}



import requests
session = requests.Session()
a = session.head('https://stackoverflow.com')
session.cookies['prov'] = None
session.cookies.set('prov', '2922137c-e851-cd7e-8df4-9e5eb968ab33', domain='.stackoverflow.com', path='/')
response = session.post('https://stackoverflow.com/search', data={'q':'bla'})
if response.text.find('highlight">bla</span>') != -1: print('found')
else: print('not found')


Is there a way to make this process more autonomous. I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST.










share|improve this question
















Here are two examples that demonstrate successful POST requests. But i cannot replicate this autonomously.



Example1



visually required: data={'SearchTxt':'bla'}



actually required: data={'page':'search', 'SearchTxt':'bla'}



import requests
session = requests.Session()
a = session.head('https://www.axemusic.com')
session.cookies['Lm722stores'] = None
session.cookies.set('Lm722stores', '5h5i1rm6q3ur4mg67rs7kb77p4', domain='.axemusic.com', path='/')
response = session.post('https://www.axemusic.com/', data={'page':'search', 'SearchTxt':'bla'})
if response.text.find('Search results for bla') != -1: print('found')
else: print('not found')


Example2



visually required: https://stackoverflow.com data={'q':'bla'}



actually required: https://stackoverflow.com/search data={'q':'bla'}



import requests
session = requests.Session()
a = session.head('https://stackoverflow.com')
session.cookies['prov'] = None
session.cookies.set('prov', '2922137c-e851-cd7e-8df4-9e5eb968ab33', domain='.stackoverflow.com', path='/')
response = session.post('https://stackoverflow.com/search', data={'q':'bla'})
if response.text.find('highlight">bla</span>') != -1: print('found')
else: print('not found')


Is there a way to make this process more autonomous. I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST.







python python-3.x session python-requests urllib






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 22 '18 at 21:42









khelwood

30.9k74363




30.9k74363










asked Nov 22 '18 at 21:40









RhysRhys

1,734122848




1,734122848








  • 1





    What are you talking about? I am sorry I cannot understand. Could you make it clearer? What is "visually required"?

    – Sraw
    Nov 22 '18 at 22:03











  • when you go to stackoverflow.com ... you have the option to search ... but this is not true with requests .... only stackoverflow.com/search allows you the option to search

    – Rhys
    Nov 22 '18 at 22:43











  • It isn't related to requests. You just don't understand how site works. You have the option to search on domain.com doesn't mean all your requests are sent to this route. Obviously some or most of your requests are sent to other specifical routes.

    – Sraw
    Nov 22 '18 at 23:08














  • 1





    What are you talking about? I am sorry I cannot understand. Could you make it clearer? What is "visually required"?

    – Sraw
    Nov 22 '18 at 22:03











  • when you go to stackoverflow.com ... you have the option to search ... but this is not true with requests .... only stackoverflow.com/search allows you the option to search

    – Rhys
    Nov 22 '18 at 22:43











  • It isn't related to requests. You just don't understand how site works. You have the option to search on domain.com doesn't mean all your requests are sent to this route. Obviously some or most of your requests are sent to other specifical routes.

    – Sraw
    Nov 22 '18 at 23:08








1




1





What are you talking about? I am sorry I cannot understand. Could you make it clearer? What is "visually required"?

– Sraw
Nov 22 '18 at 22:03





What are you talking about? I am sorry I cannot understand. Could you make it clearer? What is "visually required"?

– Sraw
Nov 22 '18 at 22:03













when you go to stackoverflow.com ... you have the option to search ... but this is not true with requests .... only stackoverflow.com/search allows you the option to search

– Rhys
Nov 22 '18 at 22:43





when you go to stackoverflow.com ... you have the option to search ... but this is not true with requests .... only stackoverflow.com/search allows you the option to search

– Rhys
Nov 22 '18 at 22:43













It isn't related to requests. You just don't understand how site works. You have the option to search on domain.com doesn't mean all your requests are sent to this route. Obviously some or most of your requests are sent to other specifical routes.

– Sraw
Nov 22 '18 at 23:08





It isn't related to requests. You just don't understand how site works. You have the option to search on domain.com doesn't mean all your requests are sent to this route. Obviously some or most of your requests are sent to other specifical routes.

– Sraw
Nov 22 '18 at 23:08












1 Answer
1






active

oldest

votes


















0















I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST




Yes, by reading documentation for public APIs. E.g., https://api.stackexchange.com/docs



For non public APIs like axemusic you're on your own. It's like asking "how does the baker like his eggs cooked?" No idea 😁






share|improve this answer























    Your Answer






    StackExchange.ifUsing("editor", function () {
    StackExchange.using("externalEditor", function () {
    StackExchange.using("snippets", function () {
    StackExchange.snippets.init();
    });
    });
    }, "code-snippets");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "1"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53438267%2fpython-3-post-method-misleading%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0















    I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST




    Yes, by reading documentation for public APIs. E.g., https://api.stackexchange.com/docs



    For non public APIs like axemusic you're on your own. It's like asking "how does the baker like his eggs cooked?" No idea 😁






    share|improve this answer




























      0















      I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST




      Yes, by reading documentation for public APIs. E.g., https://api.stackexchange.com/docs



      For non public APIs like axemusic you're on your own. It's like asking "how does the baker like his eggs cooked?" No idea 😁






      share|improve this answer


























        0












        0








        0








        I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST




        Yes, by reading documentation for public APIs. E.g., https://api.stackexchange.com/docs



        For non public APIs like axemusic you're on your own. It's like asking "how does the baker like his eggs cooked?" No idea 😁






        share|improve this answer














        I'd rather not have to manually test every input in the browser and manually and examine the GET output before knowing what the requests actually requires to perform the POST




        Yes, by reading documentation for public APIs. E.g., https://api.stackexchange.com/docs



        For non public APIs like axemusic you're on your own. It's like asking "how does the baker like his eggs cooked?" No idea 😁







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Nov 22 '18 at 23:52









        rikAteerikAtee

        4,83552958




        4,83552958






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Stack Overflow!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53438267%2fpython-3-post-method-misleading%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            404 Error Contact Form 7 ajax form submitting

            How to know if a Active Directory user can login interactively

            TypeError: fit_transform() missing 1 required positional argument: 'X'