Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
montubhardwaj
Specialist
Specialist

how to pull data from URL which requires credentials

I am trying to fetch some information from one site (URL).Generally I have to logon with my credentials to view the information. When I tried to pull the information (using QV)from the site, it says as below:
"You are not authorized to view this page You do not have permission to view this directory or page"

I know that because it requires a USERID and PWD to get to the information. How can I get it done the same in QV?

19 Replies
montubhardwaj
Specialist
Specialist
Author

Can anyone guide me through ?

erichshiino
Partner - Master
Partner - Master

Hi,

If the website works like this, you can try a syntax like this:

http(s)://username:password@server/resource.ext

montubhardwaj
Specialist
Specialist
Author

Thanks Erich.

To test this, I just tried to access my gmail but I was not successfull. I did input username and pwd. Am I making some mistake somewhere ?

montubhardwaj
Specialist
Specialist
Author

I have the access to the URL after entering my USER ID and Password. But I am not able to pull the information using QV. I tried the approach suggested by Erich but that too is not working. It says that "You are not authorized to view this page......."

I am not getting what is going on here.Using the same Id and Pwd, I can view the all the site contents but not by using QV. 

erichshiino
Partner - Master
Partner - Master

I guess it can depend on the website.

I saw on the internet that the syntax for gmail is:

https://www.google.com/accounts/ServiceLoginAuth?service=mail&Email=yourID&Passwd=yourPWD

I tried it with Qv but I didn't work for me. I got an error...

The website you are trying to read may also impact the results.

QV must identify tables in the source code it receives from the server...

montubhardwaj
Specialist
Specialist
Author

are there any settings in QV which we need to do to enable this content? Provided UserID and Pwd, QV must be able to log on..... any other work around for this ?

rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

Login flow varies by site and QV does not provide many options for handling login. You may want to try a command line tool like CURL http://curl.haxx.se/ that will let you script the http fetch into a flat file. And then have QV load the flat file.

-Rob

hectorgarcia
Partner - Creator III
Partner - Creator III

If you are not being successfull connecting directly QV to the website because of the credentials , let me sugest a workaround that is working for me.

You can use wget in a bat file that can be controlled with the execute function in the QV script, wget can bring you any kind of content , put it into your computer and after that you have the data from the URL  and the manipulate as you need.

hector garcia

fdelacal
Specialist
Specialist

hgarcia you can put an example??...
Sharma finally you can do that?. thnaks.