Skip to content

Latest commit

 

History

History
18 lines (15 loc) · 937 Bytes

README.md

File metadata and controls

18 lines (15 loc) · 937 Bytes
Raw

ResultCount Crawler - Scientific Search Engines

  • Crawls searchTerm results over years out of Scientific Search Engines
  • Written to prove and verify scientifc assumptions of a paper
  • Exports Charts if you need them, just add at the bottom of the script:
    • downloadSearchTermAndSave("<source>", "<term>", <start_year>, <end_year e.g. getCurrentYear()>, <steps=1>)

Example

  • downloadSearchTermAndSave("base", "nuclear", 2020, getCurrentYear(),1)
  • returns:
    • base_nuclear__2020_to_2023__2023_06_13T02_20_30.852856_tzPlus_00_00_CHART.png
    • base_nuclear__2020_to_2023__2023_06_13T02_20_30.852856_tzPlus_00_00.csv

Installation

  • pip install -r requirements.txty
  • hint: maybe you want to configure TOR as http request proxy ;-)

Usage

  • python3 main.py