Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...Site Crawler cURL AuthenticationSite Crawler cURL Authentication
Previous
 
Next
New Post
9/9/2015 9:11 AM
 

I'm not sure if this is the right forum to post this in, but here goes:

We have a company that's supposed to be doing a site crawling service for us to check for broken links, mis-spellings, compliance, etc...

They are unable to authenticate using a PERL cURL POST and believe that javascript is in use during the authentication process.  Here are the steps they are taking:

1.       We use a PERL cURL request to get the contents of http://www.yoursite.com

2.       Scrape the contents of http://www.yoursite.comfor the input hidden field values needed for the authentication POST.

3.       Obtain the session cookies on the http://www.yoursite.com for use with the POST

4.       Submit a PERL cURL POST to http://www.yoursite.com containing all of the parameters/cookies. (See the attached POST.txt for more details on the POST parameters/cookies used)

 

After doing the steps above we get a Response back from your server, I’ve attached the body of the response (response.txt).

 

The fact that we failed to authenticate after the POST and that I spotted some javascript in the request that appears to be login functionality leads me to believe that JavaScript is required to login to your site. Unfortunately our crawler cannot execute JavaScript during the authentication process. We can only submit POST’s with specified values (or hidden values).

 

 
New Post
9/9/2015 12:38 PM
 

sorry, we don't see either file you mention

As to DNN, we do not use javascript for login, it's a standard asp.net webform , so wont work by default as it needs various values (e.g. viewstate/eventvalidation etc.) so that it can prove that the POST from the request came from the page that was loaded via a GET initially


Buy the new Professional DNN7: Open Source .NET CMS Platform book Amazon US
 
New Post
9/9/2015 4:08 PM
 

Attached are the files they say they are sending/receiving

 

 

POST.txt (password changed to x's)

response.txt

 

 

 

 
New Post
9/9/2015 4:22 PM
 
those are .Net form, I fear it will be very difficult to use pearl to mock it.
I suggest using a different approach of logging into the site.

Cheers from Germany,
Sebastian Leupold

dnnWerk - The DotNetNuke Experts   German Spoken DotNetNuke User Group

Speed up your DNN Websites with TurboDNN
 
New Post
9/10/2015 12:03 PM
 
I think I've got this figured out. The company doing the testing was using the homepage login control to scrape for the viewstates and such. We used fiddler and the login.aspx page and it seems to be working now.
 
Previous
 
Next
HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...Site Crawler cURL AuthenticationSite Crawler cURL Authentication


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out