crawl website for all urls

Semalt Presents Cool Web Crawler And An Auto Post Plugin For Wordpress

Scrapes is a new WordPress plugin that can copy data from all kinds of sites to your WordPress website as many times as you want. It can also post content on your blog automatically.

This plugin is much more efficient than the majority of data scraping software, and it also possesses numerous superior features, and the most important ones are outlined below:

Ease of use

Scrapes is very easy to use and it does not require any programming skills or experience. In fact, it is designed for great user experience. You don't even need any API. You only need to schedule your scraping request, and it will work on autopilot 24/7 like a robot.

Requirements

It works with minimum requirements, so virtually all hosting providers support it. Also, it is always ready to go. It does not require any lengthy configuration.

Multitasking

The application can handle content from multiple websites without any limitation in a single run. It will be of great benefit to you if you need to scrape content from over 100 web pages every day. You only need to set it once, and that's all. The bot will continue to work 24/7 in the background. Your website will always be up-to-date.

Ability to post content on your blog

Another striking feature of this plugin is its ability to format scraped content and post it on your blog depending on your instructions. This is why it has several auto-blogging options. If you have people who visit your blog regularly for information, with this tool, your blog will be updated as often as you want.

It supports all kinds of devices

The program can be used on any device. You can access your dashboard on your smartphone, tablet, and even your PC. With it, you can scrape content on the go.

It has the ability to remove text from images

Sometimes, some images have text embedded in them as a label. For instance, to prevent content theft, some sites label all their images. Scrapes can extract the image and remove all the text from it.

Mathematical calculation

After scraping numeric data, it has the ability to perform some mathematical calculations on them, and it can also display the result. This will help to build good statistics. For instance, if your website displays current values of stock, you may want to calculate and display the percentage increase or decrease in the value of stock whose prices change.

So, you only need to define it for the plugin, it will not only scrape the new prices but also calculate and display percentage change.

Compatibility with all major browsers

It is compatible with all major browsers like Microsoft Edge, Google Chrome, Safari, and Mozilla Firefox. You won't have any compatibility issue.

Regular update

Despite its level of efficiency, it is regularly updated. It was launched on 23rd November 2016, and it has been updated several times. In fact, last time it was updated is 23rd of October, 2017.

Finally, the plugin is suitable for a wide diversity of use cases. Some of the use cases are:

  • Scraping of the latest currency information;
  • Scraping of the latest weather forecast;
  • Scraping of freelance job listings;
  • Scraping of restaurants and their locations;
  • Scraping of information on airports and their flight schedules;

In fact, it can be used for a lot of scraping tasks. The tasks listed above are just a small fraction of what it can handle. It is also important to point out the fact that all the features outlined above are not the only features of Scrapes. So, try the plugin out today, and you may not require any other web scraping tool again!