Feed Scraper

Feed Scraper

Do you want to take advantage of what PPC Bee has to offer, but you're missing the data source? With Feed Scraper, you can easily create your own feed using sitemap


In the menu, open the data source tab and use the + button to select the Create new data source option. You will see a list of available data sources, this time you will select Scraper.



Choose the name of your future data source and enter the URL of the sitemap you want to scrape.


If you want to select only specific URLs from the web (or addresses contained in the sitemap), select the Filter data option.




Here you can enter selected URLs that will appear in the final feed and that will be excluded. If you want to work with different content in URLs, use regular expression formatting here.


Within the scrapping itself, you have the option to choose between  A) automatic or B) manual scrapping.



A) Automatic scrapping is governed by default Html tags. Page title, H1, meta descriptions, etc.

B) Within manual scrapping, you can choose to select Html tags that will not be scrapped.




Using the Scraped more data button, you can use the CSS selector to select information from your site, which will then be loaded as attributes in your new data source. You can either do this manually or use our Scraper Wizard, which allows you to select the data in a visual way. You can read more here.Sni_mek_obrazovky_2021-08-26_v_11.36.25.png

If your site needs Javascript to render content, turn on the Real browser scraping to load content button. Use this option only as the last possible option.



At the bottom of the page, you can choose the frequency of your daily sync. Using the Upgrade button will redirect you to your subscription settings.


Then you can choose, what will PPC Bee do if the input data source contains 0 items. 

In the preview on the right side, you can clearly check the URLs that will be further scrapped. In the Variables tab, you will see the data that will be scrapped by specific URL pages. If you are satisfied with your settings, select the Add data Source option.




You will then be redirected back to the data source menu, where a new source will appear after synchronization. Please be patient, it takes longer to load the Feed scraper than with a regular XML feed.



Within the new source, you can make (as with classic feeds) advanced adjustments, work with your own variables or filter individual items.



Blog post
Was this article helpful?
Didn’t find what you were looking for?
Ask a question