Offray/Socialmetrica
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Improving nitter user getting pages.

Browse Source
This commit is contained in:
ruidajo 2022-04-12 16:05:59 -05:00
parent 2c61055b38
commit bcf67809a8
2 changed files with 6 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
Socialmetrica.package/NitterUser.class/instance/collectRawTweetsForPages..st
View File

@ -2,7 +2,7 @@ accessing
collectRawTweetsForPages: anInteger collectRawTweetsForPages: anInteger
| pagesDict response | | pagesDict response |
pagesDict := self getPagesContentsUntil: anInteger. pagesDict := self getPagesContentsUpto: anInteger.
response := TweetsCollection new. response := TweetsCollection new.
response query: pagesDict keys. response query: pagesDict keys.
pagesDict keysAndValuesDo: [ :key :rawTweets | | temp | pagesDict keysAndValuesDo: [ :key :rawTweets | | temp |

9
Socialmetrica.package/NitterUser.class/instance/getPagesContentsUntil..st → Socialmetrica.package/NitterUser.class/instance/getPagesContentsUpto..st
View File

@ -1,5 +1,5 @@
accessing accessing
getPagesContentsUntil: anInteger getPagesContentsUpto: anInteger
"I retroactively get all pages contents until a specified page number. "I retroactively get all pages contents until a specified page number.
TO DO: should this be splitted back to two methods, one getting the page urls and other its content? TO DO: should this be splitted back to two methods, one getting the page urls and other its content?
@ -10,9 +10,10 @@ getPagesContentsUntil: anInteger
response := OrderedDictionary new. response := OrderedDictionary new.
response at: self userNameLink put: self documentTree. response at: self userNameLink put: self documentTree.
previousPageLink := self userNameLink. previousPageLink := self userNameLink.
anInteger - 1 timesRepeat: [ anInteger - 1 timesRepeat: [ | pageCursor |
nextPageLink := self userNameLink, (self pageCursorFor:previousPageLink) keys first. pageCursor := self pageCursorFor:previousPageLink.
response at: nextPageLink put: (self pageCursorFor:previousPageLink) values first. nextPageLink := self userNameLink, pageCursor keys first.
response at: nextPageLink put: pageCursor values first.
previousPageLink := nextPageLink previousPageLink := nextPageLink
]. ].
^ response ^ response