Web Crawler Spider Documentation

Getting Started

Welcome

Thanks for purchasing our Web Crawler Spider :)

It is our great pleasure that you purchased our scraping tools.

If you have any questions, feel free to contact us at support@designcollection.in.

Features

  • Easy sign-in and sign-up
  • Password recovery via email
  • Scrape data from "Google.com"
  • Scrape data from "Maps.google.com"
  • Scrape data based on Keywords
  • Scrape text content data from images
  • Scrape email IDs, contact numbers, website URLs, and more
  • Receive filtered data
  • Instant WhatsApp sending and Email sending feature
  • Download data in CSV file format
  • Scraped data may be up to 80% accurate

Change Log

    :: VERSION 4.0 WAS RELEASED ::
  • Redesign Dashboard
  • Added User Dashboard
  • Added Image Data Scraper
  • Added Business Directory Scraper
  • Added WhatsApp sending feature
  • Added Email sending feature
  • Added Whois Domain Database
    :: VERSION 3.0 WAS RELEASED ::
  • Added Google Search Engine
  • Added Document Data Scraper
  • Added New Dashboard UI
    :: VERSION 2.0 WAS RELEASED ::
  • Added Website Data Scraper
  • Added Google Map Extractor
  • Redesign Dashboard
    :: VERSION 1.0 WAS RELEASED ::
  • Initial Release

Installation

Exe File

  • You will have received the web_crawler_spider.exe file
  • You should have received a file named 'web_crawler_spider.exe', compatible with various operating systems like macOS, Linux, or Windows. To start, simply click on the 'web_crawler_spider.exe' file on your laptop to open it.



  • After clicking 'Run Anyway', a new screen will appear. It will look something like this.


    • Authentication


    01. Sign up

    To Sign up, you'll need to tpye your full name, email address, create a password, and then confirm that password


    02. Sign in

    Your next step is to complete the sign-in process.


    Dashboard


    User Dashboard

    The user dashboard provides a comprehensive view of overall working performance metrics, including:

    • Total Records Processed: Displays the total number of records the user has worked with.
    • Total Websites Scraped: Shows the cumulative number of websites successfully scraped by the user.
    • Total Emails Scraped: Indicates the total number of email addresses extracted during the user’s activities.
    This dashboard enables users to monitor their progress and performance through easy-to-understand metrics.




    Google Search Scraper

    Google Search Scraper is a specific type of web scraping tool designed to scrape information from Google's search results pages. This tool simulates a user making queries to Google's search engine and then collects data from the displayed search results.

    You can scrape data by searching keywords on Google.com in which you will see website name, email ID, contact no. and more.




    Google Map Scraper

    The Google Map Scraper is to gather information available on Google Maps. This could include details about business listings, such as names, addresses, contact no. , ratings, reviews, and more.

    You can scrape data by searching keywords on map.google.com in which you will see website name, email ID, contact no. and more.




    Document Data Scraper

    The document scraper extracts contact information, specifically email addresses and phone numbers, from supported document types. Key features include:

    • Email Extraction: Automatically identifies and extracts valid email addresses from the uploaded documents.
    • Phone Number Extraction: Extracts phone numbers for the selected country, ensuring accurate and localized data collection.
    • Supported Document Types: The scraper supports a variety of file formats, including .TXT, .CSV, .DOC, .DOCX, .PDF, .HTML, .JSON, and .XLS, allowing for versatile document processing.
    This tool simplifies the extraction process by gathering key contact details directly from the documents, making it a valuable resource for users.




    Image Data Scraper

    The image data scraper is designed to extract contact information, such as emails and phone numbers, from images. Key features include:

    • Email Extraction: Detects and extracts email addresses embedded within images.
    • Phone Number Extraction: Extracts phone numbers for the selected country, ensuring precise and localized data collection.
    • Supported Image Formats: The scraper supports popular image formats such as JPG, PNG, and WEBP, ensuring efficient and accurate data extraction from a wide range of image types.
    This tool provides an efficient solution for extracting contact details from image-based content, tailored to meet country-specific requirements.




    Business Directory Scraper

    The business directory scraper allows users to extract contact information from specific online directories. Key features include:

    • URL Input: Users provide URLs from business directories, such as Yellow Pages, for scraping.
    • Phone Number Extraction: Extracts phone numbers from the provided URLs.
    • Email Extraction: Gathers email addresses from the directory pages.
    This tool streamlines the process of collecting contact information from online business directories, making it faster and easier for users to obtain valuable data.




    Whois Domain Database

    The WHOIS domain database tool allows users to access and download domain registration data for specific time periods. Key features include:

    • Year and Month Selection: Users can select a particular year and month to download domain data.
    • Country-Specific Data: The tool provides domain data for every country, giving users the ability to filter and download country-specific domain information.
    • Comprehensive Data: The database includes essential information such as domain registration details, ownership data, and more, based on the selected time frame.
    • Year and Month Selection: Users can select a particular year and month to download domain data.
    This tool simplifies access to WHOIS domain data, offering a convenient way for users to retrieve historical domain information across countries.




    Google Search Scraper

    Google Search Scraper is a specific type of web scraping tool designed to scrape information from Google's search results pages. This tool simulates a user making queries to Google's search engine and then collects data from the displayed search results.

    You can scrape data by searching keywords on Google.com in which you will see website name, email ID, contact no. and more.




    Profile

    In the profile section, a user has the ability to edit their details such as country, city, company, and contact no. . However, it's important to note that fields like full name, email ID, and purchase code will be in a disabled mode, meaning they cannot be edited. Once you purchase tools, your status will be updated to 'activated.'

    Support

    If you have any questions, feel free to contact us at support@designcollection.in.