misha/search-mastodon
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity

Added some comments

Browse source
This commit is contained in:
Misha 2023-08-08 01:02:02 -05:00
parent 929639a394
commit 49d1102a45
1 changed files with 4 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
mastodon-get-posts.org
View file

@ -1,7 +1,7 @@
* Import * Import
#+begin_src python #+begin_src python
import json import json # to parse data
import requests import requests # to get data
import pandas as pd import pandas as pd
from mastodon import Mastodon # to get the user id from mastodon import Mastodon # to get the user id
from datetime import date # to get the current date from datetime import date # to get the current date
@ -10,6 +10,7 @@ from bs4 import BeautifulSoup # to more easily read the html output
#+end_src #+end_src
* Get/refresh data * Get/refresh data
- I used [[https://jrashford.com/2023/02/13/how-to-scrape-mastodon-timelines-using-python-and-pandas/][this]] setup. - I used [[https://jrashford.com/2023/02/13/how-to-scrape-mastodon-timelines-using-python-and-pandas/][this]] setup.
- Only have to be refreshed (run) every now and then
#+begin_src python #+begin_src python
# Get access token # Get access token
personal_access_token=subprocess.check_output(["pass", 'mastodon/access_token']).strip().decode('utf-8') personal_access_token=subprocess.check_output(["pass", 'mastodon/access_token']).strip().decode('utf-8')
@ -51,7 +52,7 @@ df.to_csv(file_name_save, index=False)
#+end_src #+end_src
* Use/search data * Use/search data
Use existing data multiple times. - You don't have to load all data for every search.
#+begin_src python #+begin_src python
df=pd.read_csv(file_name_save) df=pd.read_csv(file_name_save)