Twitter gathering tool - This script will allow users to specify hashtags and capture from the twitter faucet new tweets with the given hashtag.Twitter hydration tool - This script will hydrate tweet ID’s provided by others.Social Media Mining Toolkit (SMMT) Extra Information Data Acquisition Tools: If you used SMMT and liked it, please cite the following paper:
#SOCIAL MEDIA TOOLKIT HOW TO#
This is a very important step, if you do not have any Twitter API keys, none of the software that uses Twitter API will work without it How to cite our work: If you still have issues or the Firefox window is popping up through your X11, follow this: GeckoDriver - v0.26.0 sudo yum install jqīash SMMT/data_acquisition/geckoDriverInstall.sh Pyvirtualdisplay - v0.25 pip install pyvirtualdisplay Configuration of these items is very finicky but there is plenty of documentation online. These dependencies are needed for the headless browsing automation tasks (no need to have a screen open for them). NOTE: If you are using the scraping utility, install the following dependencies. Each tool and their usage is described on the README file on each category of tools folder.Īll the libraries used in this toolkit can be installed using the following command.Make sure you have your Twitter API keys handy if you are gathering any Twitter Data.
Data Annotation and Standardization Tools: Utilities to make automatic NER annotations on preprocessed tweets, plugins to use popular annotation tools and NER systems Data Preprocessing Tools: Utilities to parse social media 'raw' data and to separate by termsģ. Data Acquisition Tools: Utilities to gather data from social media sitesĢ.
We separated this toolkit in three categories (each one on an individual folder):ġ. This centralized repository depends on other widely available libraries that need to be installed.
The set of tools collected and presented here are designed with the purpose of facilitating the acquisition, preprocessing, and initial exploration of social media data (mostly Twitter for now).
0 kommentar(er)
