web scraping - Getting mobile version of a web page instead of the desktop version with selenium webdriver -


I Debian'm using headless Firefox on a remote server in order to get some data scrap with selenium Vebdrivr and later Skapere Be close Instead of getting the desktop version, I'm getting the mobile version of the web page from which I'm trying to scrape data. I need the desktop version! I think I need to send the proper user agent string and I how to do it: 

  def call_via_proxy (PROXY_HOST, PROXY_PORT): fp = webdriver.FirefoxProfile () # Direct = 0; manual = 1, PAC = 2, Otodetekt = 4, system = 5 fp.set_preference ( "network.proxy.type", 1) fp.set_preference ( "network.proxy.http", Proksi_host) fp.set_preference ( "network. proxy. Http_port ", int (PROXY_PORT)) fp.set_preference (" general.useragent.override "," Mozilla / 5.0 (Windows NT 6.1; WOW64; rv: 31.0) Gecko / 20100101 Firefox / 31.0 ") fp.update_preferences () Return Webdriver Firefox (Firefox_Prop I = FP) #create webdriver driver = call_via_proxy ("us.proxymesh.com", "31280") driver.get (response.url)

The code works fine on my desktop machine (Win7) but on the server (Debian) where the code needs to be run I am getting a mobile version of the web page. Even if I use the Phantom's S, then the same is PhantomJS user_agent = ("Mozilla / 5.0 (Macintosh; Intel Mac OS X L0_8_4) # user agents #set for ") dcap = dict (desitionalCapabilities.PHANTOMJS) dcap [" phantomjs.page.settings .userAgent "] = user_agent driver = webdriver.PhantomJS ( '/ usr / local / share / phantomjs-1.9.7-linux-i686 / bina / phantomjs', Wanchit_kapshn = dcap) driver.get (response.url)

what HTTP response code to a web page with selenium Is there any way to get it? I wonder what is wrong here? I do not believe that there is something to do with dependence on the platform? Any advice?

I have this problem with some mobile responsive templates that go by the size of the screen. In this example, the phantom appears to be my own set of rules for desktop browser size ( driver.manage (. Code.wall.size) ) starts working for me.

I do not have a Java code for this, but in C # this would be: 

  _driver.Manage (). Window size = new size (1024768);

I remember that there is a dimension value that you can pass instead I do this and the desktop page comes once again!


-

Comments

Post a Comment

Popular posts from this blog

Member with no value in F# -

After I am trying to convert F # to the following C # code: [StructLayout (LayoutKind.Sequential, charset = CharSet.Ansi)] Private class DOCINFOA {[MarshalAs (UnmanagedType.LPStr)] public string nomeDocumento; [Marshall (UnmanagedType.LPStr)] Public string arquivoSaida; [Marshall (UnmanagedType.LPStr)] Public String Tipodo; } I am doing the following: Named place printer module RawPrinterHelper = [& LT; StructLayout (LayoutKind.Sequential, charset = CharSet.Ansi) & gt;] Type DOCINFOA = [& LT; MarshalAs (UnmanagedType.LPStr) & gt;] Member this.nomeDocumento [& LT; MarshalAs (UnmanagedType.LPStr) & gt;] Member this.arquivoSaida [& LT; MarshalAs (UnmanagedType.LPStr) & gt;] Member This Tipoda [/ code> But I get: One type of definition is necessary for one or more members . Can I vacate these members? you val code> member : [& lt; StructLayout (LayoutKind.Sequential, charset = CharSet.Ansi) & gt;] Type DOCINFOA = [...
Read more

java - Joda Time Interval Not returning what I expect -

मेरे पास निम्न प्रोग्राम है import java.util। *; Import java.text। *; आयात करें org.joda.time। *; सार्वजनिक श्रेणी के स्कोप कंट्रोल {सार्वजनिक स्थिर अंतराल मिलनसार () {दिनांक समय currDate = नया दिनांक समय (2008, 4, 4, 15, 30, 0, 0); दिनांक समय epochDate = नया दिनांकटाइम (2000, 1, 1, 12, 0, 0, 0); अंतराल अंतराल = नया अंतराल (युरोप डेट, करोडेट); वापसी अंतराल; } सार्वजनिक स्थिर शून्य मुख्य (स्ट्रिंग [] आर्ग्स) {डबल दिनबात = मिलते समय ()। ToDurationMillis () / 1000/60/60/24; StdOut.println (daysBtween); }} मुझे आउटपुट मिल रहा है: 3016.0 लेकिन जो मैं देख रहा हूं वह है: 3016.1458333333 मैं क्या कर रहा हूँ ? toDurationMillis एक लंबा लौटा देता है, और प्रत्येक प्रभाग को int के रूप में घोषित किया जाता है। जावा इस प्रकार इनट्स को लॉन्ग में परिवर्तित कर देगा और डिवीजन को लंबे समय तक लौटाना होगा। परिणाम को अंत में दोहरे रूप में परिवर्तित करना। डबल्स का उपयोग करके अभिव्यक्ति करने के लिए जावा को बताने के लिए, अभिव्यक्ति के किसी भी घटक को दोहरे रूप में घोषित करें। उदाहरण के लिए: ...
Read more

c# - Showing a SelectedItem's Property -

So I have enabled a rightclick option for my DataGrid. I want to display the only chosen property but it is not behaving like what I would like it to display my name and additional. Public category Paymentinfo {public int PaymentNo {get; Set; } Public string date {get; Set; } Public Double Pay {get; Set; } Public Double Principle {get; Set; } Public Double Interest {get; Set; } Public Double Balance {Received; Set; }} Private Zero MenuItem_OnClick (Object Sender, RoutedEventArgs e) {MessageBox.Show (AmortGrid.SelectedItem.ToString ()); } I'm trying to apply it without using a View Module! If I place a breakpoint where the messagebox and the recipient place it on selected ITEM, then this property will display the payment. A date-payment-principle-interest-balance is the only value that needs payment. Was hoping that it would be something like this MessageBox.Show (AmortGrid.SelectedItem.PaymentNo.ToString ()); When you call ToString () So you get the class typ...
Read more