This Google Scraper enables you to scrape Google Search Engine Results Pages (SERPs) and extract organic and paid results, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Select country or language and extraction of custom attributes, and download your data, no coding needed.

Specifies the country of the IP address used for the search and the Google Search domain (e.g. <code>google.es</code> for Spain). By default, the actor uses United States (<code>google.com</code>).

Country

Custom JavaScript function to extract additional attributes from the HTML of the Google Search result pages. The function accepts the same parameters as <a href='https://crawlee.dev/api/cheerio-crawler/interface/CheerioCrawlerOptions#handlePageFunction'>CheerioCrawler.handlePageFunction</a> in Crawlee. The return value of the function is saved to the results as the <code>customData</code> property.

Custom data function

If checked, the lower quality results that Google normally filters out will be included. This usually consists of a few hundred extra results.

Include unfiltered results

Language for the search results, which is passed to Google Search as the <code>hl</code> URL query parameter. Only set this if you want to use a non-default language for the selected country.

Language

The code for the exact location for the Google search. It's passed to Google Search as the <code>uule</code> URL query parameter. You can use the <a href='https://padavvan.github.io/' target='_blank'>UULE code generator</a>. Learn more about <a href='https://moz.com/ugc/geolocation-the-ultimate-tip-to-emulate-local-search' target='_blank'>emulating local search</a>.

Exact location (Google UULE parameter)

Maximum number of search results pages the scraper will load in parallel. A higher number means you will get your results faster, but it will also burn through your available proxies quicker.

Max concurrency

Maximum number of Google Search result pages crawled for each search term or URL. Please note that Google limits the number of search results pages it shows you to between 300 and 400.

Max pages per search term or URL

If checked, the scraper will return results for the mobile version of the Google search. By default, desktop results are returned.

Mobile results

Google Search terms (e.g. <code>food in NYC</code>) and/or full URLs (e.g. <code>https://www.google.com/search?q=food+NYC</code>). Please enter one item per line.

Search terms or URLs

Number of search results for each Google result page. By default, Google Search returns 10 results per page. The allowed values are: <code>10</code>, <code>20</code>, <code>30</code>, <code>40</code>, <code>50</code> and <code>100</code>. Since our Free plan contains 100 free SERP proxies, and every request consumes 1 proxy, you will get exactly 100 free requests, no matter the amount of results you will get per each. This is why to get maximum value from this scraper, we recommend setting up this parameter to its maximum, <code>100</code>.

Results per Google page

If checked, the HTML of the Google Search results pages will be stored to the default dataset, under the <code>html</code> property. This is useful if you need to process the HTML, but it makes the dataset large and reduces performance.

Save HTML to dataset

If checked, the HTML of the Google Search results pages will be stored to the default key-value store and links to the files stored to the dataset under the <code>htmlSnapshotUrl</code> property. This is useful for debugging, since you can easily view the pages in the browser. However, the use of this feature may present some performance penalty.