How to Collect 100+ Questions About Your Target Keywords?
Posted: Wed Dec 04, 2024 10:57 am
As search engine visibility becomes increasingly important – especially as social media engagement and following declines – SEO has become an increasingly competitive channel.
So how can your website rank among the vast results the web provides? The answers may lie in the questions!
In today’s article, we’ll create a “People Also Ask” scraper that aggregates hundreds (or even thousands) of related questions around your target keywords , allowing you to create a more comprehensive topic set , optimize your content, and improve search intent.
What is "People Also Ask"?
Google's "People Also Ask" feature is a section in search results that displays austria phone number resource related questions and answers from other sources. It helps users find more information about their query or explore different aspects of a topic.
People also ask - Google
This feature is dynamic and can expand or change based on user interaction.
PPA - Dynamic questions
Using PAA Questions to Boost Your SEO
While “People Also Ask” (PAA) is primarily an end-user feature, it can be a great ally when creating and optimizing your site’s content.
The idea behind PAA is to help users find additional information about their query or to assist lost users who are not sure how to search for an information, so Google needs to "guess" the intent behind the search.
Do you understand now?
PAA questions are a great way to identify potential questions your content should answer – increasing topic authority – or to identify new topics to build content around your main keyword.
For example, let's say you want to write a post about doing keyword research. What should you cover?
Most people will Google their target term, see what’s already ranking, and call it a day.
However, if we check the PAA box we can come up with some interesting ideas:
What is keyword research?
How do I find good research keywords?
Is Google Keyword Tool free?
Is SEO the same as keyword research?
How to do keyword research in 2023?
From these questions alone we can determine a few things:
The question “Is SEO the same as keyword research?” tells us that this is a very introductory topic, so people searching for this term are beginners and we need to set the tone for them.
It is an evolving topic that needs to be updated frequently because it is a question that is relevant to the current year.
We should add a section titled “What is Keyword Research?” and “How Do I Find Good Search Keywords?” – I wouldn’t use the latter exactly like that, but you get the idea.
As part of the tutorial we have to talk about how to use the "Google Keyword Planner" because Google connects it to the query.
We can learn a lot of valuable information about our keywords, create a list of related keywords, optimize our content to answer common questions around the target keyword, and come up with new topic ideas to create complete topic clusters .
Collecting "People Also Ask" Questions with Python
There is a challenge though. Gathering all of these questions to use for our existing content or to support our content planning is time-consuming and resource-intensive .
SEOs and content managers already do a lot of work adding extra research, so how do we solve this?
Simple, we automate the process!
We will create a web scraper:
Get a list of keywords
Go to keyword SERP
Remove all PAA questions
Export information to a CSV
In this tutorial, we will use Python with a simple tool to handle all the complexity and you will be able to use the resulting code by just changing the keywords.
Are you ready? Let's get started.
Step 1: Set Up Your Project
The first thing you need to do is create a new folder for your project (name it paa-scraper) and create a new paa_scraper.py file inside it.
If you are using a Mac, you already have a version of Python installed on your machine. If you are using Windows, follow this tutorial to install it on your machine .
Next, open the folder in VScode and a new terminal.
Open a new terminal in VScode
From there enter the following command.
pip install requests pandas
The above command will install two useful tools (dependencies):
Requests will allow us to request the information we want to extract
Pandas will help us export the information as CSV file
To complete this step, import both dependencies at the top of the file.
import requests import pandas as pd
Step 2: Sending Our Request via ScraperAPI
Traditionally, to get the data we are looking for, we would have to create a scraper that goes to Google, search for the information using CSS selectors, select the information, format it... you know what I mean? This usually requires a lot of logic.
Open a new terminal in VScode
Instead, we can use a web scraping tool to reduce costs, implementation time, and maintenance .
By sending our request through ScraperAPI's structured data endpoints, we will be able to receive PAA queries of any query without worrying about parsing HTML, getting blocked, or any other issues we may encounter.
To get started, create a free ScraperAPI account and go to your dashboard to copy your API key.
Next, we will create a payload as follows:
payload = { 'api_key': 'YOUR_API_KEY', 'country': 'us', 'query': 'keyword+research', }
The country parameter will tell ScraperAPI where to send your requests from - remember that Google shows different results based on your location - while the query parameter holds your keyword.
So how can your website rank among the vast results the web provides? The answers may lie in the questions!
In today’s article, we’ll create a “People Also Ask” scraper that aggregates hundreds (or even thousands) of related questions around your target keywords , allowing you to create a more comprehensive topic set , optimize your content, and improve search intent.
What is "People Also Ask"?
Google's "People Also Ask" feature is a section in search results that displays austria phone number resource related questions and answers from other sources. It helps users find more information about their query or explore different aspects of a topic.
People also ask - Google
This feature is dynamic and can expand or change based on user interaction.
PPA - Dynamic questions
Using PAA Questions to Boost Your SEO
While “People Also Ask” (PAA) is primarily an end-user feature, it can be a great ally when creating and optimizing your site’s content.
The idea behind PAA is to help users find additional information about their query or to assist lost users who are not sure how to search for an information, so Google needs to "guess" the intent behind the search.
Do you understand now?
PAA questions are a great way to identify potential questions your content should answer – increasing topic authority – or to identify new topics to build content around your main keyword.
For example, let's say you want to write a post about doing keyword research. What should you cover?
Most people will Google their target term, see what’s already ranking, and call it a day.
However, if we check the PAA box we can come up with some interesting ideas:
What is keyword research?
How do I find good research keywords?
Is Google Keyword Tool free?
Is SEO the same as keyword research?
How to do keyword research in 2023?
From these questions alone we can determine a few things:
The question “Is SEO the same as keyword research?” tells us that this is a very introductory topic, so people searching for this term are beginners and we need to set the tone for them.
It is an evolving topic that needs to be updated frequently because it is a question that is relevant to the current year.
We should add a section titled “What is Keyword Research?” and “How Do I Find Good Search Keywords?” – I wouldn’t use the latter exactly like that, but you get the idea.
As part of the tutorial we have to talk about how to use the "Google Keyword Planner" because Google connects it to the query.
We can learn a lot of valuable information about our keywords, create a list of related keywords, optimize our content to answer common questions around the target keyword, and come up with new topic ideas to create complete topic clusters .
Collecting "People Also Ask" Questions with Python
There is a challenge though. Gathering all of these questions to use for our existing content or to support our content planning is time-consuming and resource-intensive .
SEOs and content managers already do a lot of work adding extra research, so how do we solve this?
Simple, we automate the process!
We will create a web scraper:
Get a list of keywords
Go to keyword SERP
Remove all PAA questions
Export information to a CSV
In this tutorial, we will use Python with a simple tool to handle all the complexity and you will be able to use the resulting code by just changing the keywords.
Are you ready? Let's get started.
Step 1: Set Up Your Project
The first thing you need to do is create a new folder for your project (name it paa-scraper) and create a new paa_scraper.py file inside it.
If you are using a Mac, you already have a version of Python installed on your machine. If you are using Windows, follow this tutorial to install it on your machine .
Next, open the folder in VScode and a new terminal.
Open a new terminal in VScode
From there enter the following command.
pip install requests pandas
The above command will install two useful tools (dependencies):
Requests will allow us to request the information we want to extract
Pandas will help us export the information as CSV file
To complete this step, import both dependencies at the top of the file.
import requests import pandas as pd
Step 2: Sending Our Request via ScraperAPI
Traditionally, to get the data we are looking for, we would have to create a scraper that goes to Google, search for the information using CSS selectors, select the information, format it... you know what I mean? This usually requires a lot of logic.
Open a new terminal in VScode
Instead, we can use a web scraping tool to reduce costs, implementation time, and maintenance .
By sending our request through ScraperAPI's structured data endpoints, we will be able to receive PAA queries of any query without worrying about parsing HTML, getting blocked, or any other issues we may encounter.
To get started, create a free ScraperAPI account and go to your dashboard to copy your API key.
Next, we will create a payload as follows:
payload = { 'api_key': 'YOUR_API_KEY', 'country': 'us', 'query': 'keyword+research', }
The country parameter will tell ScraperAPI where to send your requests from - remember that Google shows different results based on your location - while the query parameter holds your keyword.