ScappySianClawler

SOFTWARE DEVELOPMENT PRACTICE II PROJECT

ScappySianClawler

**This Project is for educational purposes**
Explore the docs »

View Demo · Report Bug · Request Feature

Table of Contents

1. About The Project
   • Requirement
2. Getting Started
   • Prerequisites
   • UML Class diagram
   • TAB 1 TWEEPY
   • TAB 2 WEB_CRAWLER
   • TAB 3 DATABASE_S

About The Project

Hello This is our Project for SOFTWARE DEVELOPMENT PRACTICE II about tweepy and web scappy in our Year2 at King Mongkut's University of Technology North Bangkok

(back to top)

Requirement

• Python 3.9.0 64-bit
  • numpy
  • pandas
  • tweepy
  • nltk
  • bs4 (BeautifulSoup)
  • PyQt5
• API Key
  • Twitter API Key
  • AI for thai Key

(back to top)

Getting Started

The Main application we use is "Tweetmain.py"

UML Class diagram

Prerequisites

You should have Requirement before running the program

Running the program

We have 3 Tab for the whole program.we will start at Tab1 "Tweepy"

TAB 1 TWEEPY

In first tab "Tweepy" have the 4 main content

• 1. Insert Keyword

  • Type keyword that you want in textbox (We recommanded to type "#" before keyword. ex.#Liverpool the keyword is Liverpool)
  • Select Date
  • Press the Search Button and wait the progreebar come to 100%

• 2. The data will display on this layer

• 3. The data of relate hashtag(keyword) will display on this layer

• 4. The Trending keyword

TAB 2 WEB_CRAWLER

In Second tab "Web_Crawler" have the 3 main content

• 1. Insert Keyword

  • Type keyword that you want in textbox
  • Press the Search Button and wait the progreebar come to 100%

• 2. The data will display on this layer

• 3. The data of relate word will display on this layer

TAB 3 DATABASE_S

In Third tab "Database_S" have the 4 main content

• 1. Insert Keyword

  • Type keyword that you want to search from your directory in textbox
  • Warning If youwant to search data from web crawler that you search
    • Press check the "Web Search" checkbox before Search and not use "Use date" checkbox
    • If you want to search data from tweepy that you search Don't check the "Web(keyword)" and "Web Search" checkbox
  • Press the Search Button

• 2. The data will display on this layer

• 3. Export

  • "Export Use button" for data tweet to data visualization
  • "Export All button" for all data that display in (2)

• 4. Your Directory

(back to top)