Extracting search results into a spreadsheet is a seemingly simple thing.
However, due to the limitations of automated queries placed by Google and other search engines, it can become prohibitively expensive to scrape the SERPs.
This problem is compounded by the fact that there aren’t many tools that can do this in an easy way that results in a spreadsheet with the data you are looking for.
The following is an overview of how to export Google search results to a spreadsheet, including relevant keyword data.
Extract SERPs in a spreadsheet with a Chrome extension
First on the list is (arguably) the best Chrome extension for pulling search results directly into a spreadsheet.
There are many other extensions that fetch SERPs, but they don’t actually pull the data into a spreadsheet.
For example, Surfer SEO has an amazing Chrome extension that can extract a significant amount of useful information about top 10 ranked sites, as well as provide keyword data that can help in writing an article.
But, it doesn’t actually export the SERPs into a spreadsheet.
There’s one that does this very well, and it’s from SEOquake.
SEOquake Chrome Extension
SEOquake offers a free SEO Chrome extension that provides several SEO data points overlaid directly on search results, including numbers corresponding to each website’s search position listed in the SERPs.
The extension will count each People Also Ask question as a search result, so a SERP with 10 results plus four People Also Ask will thus be listed as having 14 search results.
In order to export only a simple list of search results, it is necessary to first remove all parameters from the report.
Otherwise, the report will contain much more information than necessary.
Step 1: The Settings button
The first step is to click on the Settings menu button:
Step 2: Deselect Settings
What happens next is that a drop-down menu appears on the search results.
The drop-down menu contains a multitude of settings.
Uncheck all settings.
Step 3: Export to CSV
You are now ready to download search results directly into a spreadsheet.
In the left menu, there is an item labeled Export to CSV. Just click on it and the spreadsheet will start downloading.
SEOquake is a convenient way to download top 10 search results directly into a spreadsheet.
Export search functionality to a spreadsheet
Another useful tool is searchanalyzer Chrome’s SERP Keyword Scraper extension.
SERP Keyword Scraper by searchanalyzer
This tool focuses on extracting keyword phrases that are found in Google’s search features.
SERP Keyword Scraper produces useful information about keywords related to your keyword phrase as displayed in Google’s search functions.
The Chrome extension exports the following search features:
- Research Suggestions.
- Associated researches.
- Search refinements.
- FAQ-rich results.
- Image entities.
The Chrome extension extracts keyword data from:
- Google search.
- Google Shopping.
- Google image search.
- Bing search.
Using the tool is super easy.
Simply install the plugin and pin it to the browser so that it is easily accessible.
The next step is to search Google (or Bing) and click on the SERP Keyword Scraper icon, and the keywords are instantly copied to a clipboard.
Finally, open a spreadsheet and paste. It’s that simple. Here it is, right?
The spreadsheet produced by the extension is clean and tidy, so it’s easy to figure out what all the features are.
The tool first lists all the keyword phrases pulled from the visible part of the search features (like People Also Ask, etc.).
There is a small trick to use this extension to know.
Before clicking on the Chrome extension icon to generate the report, be sure to click in the search box to generate the Google Suggest keywords.
For example, for the key phrase, What is structured data:
- The first set of keywords in the spreadsheet are taken from Google Suggest.
- The second set of keywords in the spreadsheet are taken from the People Also Ask search function.
- The third set of keyword phrases is taken from the Related Searches search function.
- The fourth group of keywords was extracted from the FAQ rich results.
- The fifth group of keyword phrases was taken from the People Also Search For search function.
This is quite useful data and easy to extract.
Simply click the icon button and the data is saved to the copy clipboard. All you have to do then is paste it into a spreadsheet.
What I particularly like about the SERP Keyword Scraper Chrome extension is that it respects your privacy.
The tool does not collect any of your browsing data and does not sell it.
According to privacy practices:
“How does the SERP Keyword Scraper work?
Everything happens on your machine! We access the source code of the search result and extract the data for you. The plugin does not use any third party data.
The publisher has stated that they will not collect or use your data
This publisher declares that your data is:
Not to be sold to third parties, outside of approved use cases.
Not to be used or transferred for any purpose unrelated to the primary functionality of the item.
Not to be used or transferred for determining creditworthiness or for lending purposes. »
Scrape Google SERPs with Screaming Frog
It is possible to use Screaming Frog to scrape search results and search features.
In fact, there are many other scraping tools that can do this as well. But, Google may ban your IP address.
If this happens, you will no longer be able to use Google.
It should also be noted that Google strictly prohibits automated search queries.
Google’s Terms of Service has a section unambiguously titled “No automated query.”
Google’s prohibition statement states:
“You may not send automated queries of any kind to Google’s system without the prior express permission of Google.
Note that “sending automated requests” includes, among other things:
use any software that queries Google to determine how a website or webpage “ranks” on Google for various queries; »
Scraping Google with automated queries can get your IP address banned.
SerpsBot is an API that allows you to extract search results from Google, including all search features such as People Also Ask and featured snippets.
Search results are exported to a JSON file, which can then be converted to a spreadsheet if that’s what you want.
This is an API, so you would need to be able to program languages.
Plenty of ways to pull SERPs
If you search online, you will find websites, workarounds, and tools to export search results from Google.
I have found that some of the online tools can display the first page of Google SERPs and provide a way to export them to a spreadsheet.
One such site is SERPs to Excel. It does a decent job of fetching all 10 search results.
However, the site does not count search results in featured snippets or video results. It provides results based on the old 10 blue links paradigm.
For example, a search for [what is google palm?] yields seven search results minus featured snippets and videos and includes a search result from page two of the SERPs.
Results for anything above the second page of the SERPs cost $2 for over 100 search results.
A good thing about this website is that it does not follow you on your browser as a Chrome extension.
But, if you prefer the convenience of downloading data directly from search results, a Chrome extension is better suited for this type of workflow.
Keyword Tool Workarounds
There are many tools that offer rank tracking and keyword research. But surprisingly, there aren’t many free tools that provide this functionality without having to do a bit Workaround to get what you need.
Semrush Keyword Presentation Tool
For example, the free version of Semrush offers the Keyword Overview tool which can give you the SERPs conveniently.
Step 1: Select Keyword Submitter
In the left navigation menu, select the Keyword Overview link found in the Keyword Research section.
Step 2: Research keywords
Next, look at the top right of the page, where there is a search box.
Enter the keyword and click the Search button.
Step 3: SERP analysis
Once the tool has retrieved the search results, scroll down to the section titled SERP Analysis.
Here it is possible to copy the list of URLs ranked in the top 10 for the chosen keyword phrase.
Step 4: paste into a spreadsheet
Finally, copy the list of search result URLs and paste it into a spreadsheet.
As you can see, it is possible to create a top 10 spreadsheet for various search results using free keyword research tools, but it is an imperfect solution.
Extracting search results to a spreadsheet
At first, it may seem like extracting search results into a spreadsheet is easy, but it’s not.
There are several solutions available, but they each have their advantages and disadvantages.
Ultimately, it’s up to you to find out which tool best suits your workflow.
Featured Image: Gorodenkoff/Shutterstock