Commit Graph

200 Commits

Author SHA1 Message Date
ruidajo 722b2d2066 Creating word cloud data by language and a BUG at install commons. 2022-06-09 13:43:48 -05:00
ruidajo 07516e4dc6 Creating get remote messages from html and Modifying nitter provider. 2022-06-09 13:10:25 -05:00
ruidajo 773d94383c Modifyng wordcloud data filtering. 2022-06-09 12:29:38 -05:00
ruidajo c535993e47 Modifyng nitter user as dictionary for worcloud data exporter. 2022-06-09 12:15:48 -05:00
ruidajo 0577beb724 Creating a word cloud data for web static exporter. 2022-06-09 11:53:27 -05:00
ruidajo 8d9a66e012 Creating week report contract and Modifying tweets histogram for empty tweets. 2022-06-08 17:26:29 -05:00
ruidajo 8f3c63dc71 Modifying tweets parser due to a change in twitter ids. 2022-06-08 16:40:43 -05:00
ruidajo 94b104e0e8 Creating retweets static web report histogram. 2022-06-04 17:49:18 -05:00
ruidajo 91744733bd Creating replies and quotes static web report histogram. 2022-06-03 19:43:01 -05:00
ruidajo c713ad9d28 Modifying asDictionary for exporting as static web report. 2022-06-01 23:32:31 -05:00
ruidajo 3ad7148e62 Creating export as static web report. 2022-06-01 15:52:32 -05:00
ruidajo 5fdad7fa69 Modifying nitter user parse as dictionary and as tiddler. 2022-05-31 13:08:05 -05:00
ruidajo cb8bdbbaee Creating nitter user parsing as tiddler. 2022-05-25 16:23:15 -05:00
ruidajo 33805fd903 Modifying export overview LaTex with automated weeks. 2022-05-25 12:31:53 -05:00
ruidajo 9544a92392 Modifying export overview LaTex and nitter user id for deleted users. 2022-05-25 11:50:30 -05:00
ruidajo 7a7058f30c Merge 71484b16b0 2022-05-21 22:17:47 -05:00
ruidajo cee2682e7a Modifying tweets filtering for id change. 2022-05-21 22:15:14 -05:00
Offray Vladimir Luna Cárdenas 71484b16b0 Not found user: starting implementation. 2022-05-21 21:45:14 -05:00
ruidajo f9b7fdf6bb Modifying newest and oldest tweet selection. 2022-05-15 17:15:12 -05:00
Offray Vladimir Luna Cárdenas 75290c2538 Merge 7fa248e4fa 2022-05-15 16:32:33 -05:00
Offray Vladimir Luna Cárdenas bc6a4fb9eb Tweets scraping: updating from web until the most recently stored. 2022-05-15 16:32:06 -05:00
ruidajo 7fa248e4fa Merge 7717f00185 2022-05-15 13:58:56 -05:00
ruidajo f467129c42 Fixing tweets by date filtering and replies. 2022-05-15 13:56:39 -05:00
Offray Vladimir Luna Cárdenas 7717f00185 Tweets scraping: updating from web until the most recently stored. 2022-05-15 13:51:33 -05:00
Offray Vladimir Luna Cárdenas 9ae819722f Merge 463781085b 2022-05-15 12:40:08 -05:00
Offray Vladimir Luna Cárdenas 7c6d7d9d80 Improving tweets scraping. 2022-05-15 12:39:10 -05:00
ruidajo 463781085b Fixing tweets filtering and write words for external cloud. 2022-05-15 12:31:23 -05:00
Offray Vladimir Luna Cárdenas a515a24a81 Refactoring tweets scrapping: getting oldest ones. 2022-05-15 08:50:22 -05:00
Offray Vladimir Luna Cárdenas a61de2ecb7 Refactoring tweets scrapping. 2022-05-15 08:23:21 -05:00
ruidajo ac5d935ce1 Fixing messages for nitter user and tweets filtering. 2022-05-14 19:39:21 -05:00
Offray Vladimir Luna Cárdenas 390a6c3ef1 Bugfix: Avatar picture. 2022-05-14 18:17:34 -05:00
Offray Vladimir Luna Cárdenas fa1cf4a6d8 Merge 7d6c8259f6 2022-05-14 17:46:54 -05:00
Offray Vladimir Luna Cárdenas c16f109067 Bugfix: Tweets and avatar 2022-05-14 17:45:58 -05:00
ruidajo defb1a8819 Modifyng installer for commons. 2022-05-14 16:56:07 -05:00
Offray Vladimir Luna Cárdenas c32a351932 Dealing with changes in user Id. 2022-05-04 22:43:23 -05:00
Offray Vladimir Luna Cárdenas 459502cd5f Implementing reporting periods to limit messages processing inside a predefined timespan. 2022-05-04 07:27:25 -05:00
Offray Vladimir Luna Cárdenas 4abb9fe987 First draft to limit the reporting period. Future ones should have a TweetsCollection property to define such limits. 2022-05-03 23:08:54 -05:00
ruidajo a2d5d80e57 Modifying newest tweet selection. 2022-05-03 21:25:22 -05:00
ruidajo a08073232d Modifying newest tweet selection. 2022-05-03 20:50:20 -05:00
ruidajo 35d9d037d3 Modifying oldest tweet selection and oldest tweet for nitter user. 2022-05-03 12:32:05 -05:00
ruidajo ae652fdf3a Modifying bars, quotes and replies histograms. 2022-05-03 11:05:56 -05:00
Offray Vladimir Luna Cárdenas 21b4f432c4 Temporal bugfix to deal with Twitter changes in user id. 2022-05-03 08:32:10 -05:00
ruidajo 419aa176ab Modifying date displays in histograms and fixing empty replies and quotes exporter. 2022-05-02 22:31:41 -05:00
ruidajo 6a628fddd3 Modyfing nitter user created at parsing. 2022-05-02 20:15:19 -05:00
ruidajo aa5cf9cbba Modyfing nitter user sanitization for tex exporter. 2022-04-29 17:58:03 -05:00
ruidajo 104fe9e348 Fixing method for geting oldest tweets, modifying store avoiding duplication. 2022-04-28 16:17:56 -05:00
ruidajo 06b0d5748d Creating download tweets from oldest up to a page, modifying histograms exporters and external word cloud without mask. 2022-04-27 23:51:53 -05:00
ruidajo ac963c753f Minor change in oldest tweet selection. 2022-04-27 15:51:40 -05:00
ruidajo d2d0f739a8 Modifying nitter user for mustache template. 2022-04-27 15:38:10 -05:00
ruidajo ad26072420 Fixing replies filtering and modifying tweets collection messages. 2022-04-26 14:05:58 -05:00
ruidajo bd69b73529 Fixing raw tweets collection and tweets filtering from html. 2022-04-25 18:59:10 -05:00
ruidajo b964460fa3 Fixing page contents downloader and modifying tweets collection. 2022-04-25 18:21:13 -05:00
ruidajo a38124638d Creating tweet testing, and modifyng nitter user asdictonary. 2022-04-25 17:12:04 -05:00
Offray Vladimir Luna Cárdenas 3ff8dfc86a Code review: improved modularity. A second pass on #downloadWithRenaming: still pending. 2022-04-25 09:13:04 -05:00
Offray Vladimir Luna Cárdenas bd279b1fd3 Code Review: Formatting and ward clause. Method should be made more modular. 2022-04-25 06:26:54 -05:00
ruidajo bbfae14949 Creating exporter for report in LaTeX format. 2022-04-21 12:11:53 -05:00
ruidajo f66d93e2ca Refactoring: minor changes in histogram exporters. 2022-04-20 16:59:57 -05:00
ruidajo 57adfca53a Creating quotes histogram exporter. 2022-04-20 16:44:34 -05:00
ruidajo 66298fc248 Fixing and creating retweets histogram exporters. 2022-04-20 16:27:54 -05:00
ruidajo cde55509bf Creating retweets and quotes sorted by occurrences. 2022-04-20 15:49:50 -05:00
ruidajo e840f733fe Tweet user bug fix. 2022-04-20 14:56:08 -05:00
ruidajo 1e06d16801 Removing unnecessary methods. 2022-04-20 14:13:02 -05:00
ruidajo e43b375a6b Creating exporter for retweets. 2022-04-19 13:55:39 -05:00
Offray Vladimir Luna Cárdenas 4e6b134848 Merge 4ab8c6f0dd 2022-04-19 00:20:42 -05:00
Offray Vladimir Luna Cárdenas 99a03c0ad1 Tweets collection now inherits from OrderedCollection to improve reusability. 2022-04-19 00:19:23 -05:00
Offray Vladimir Luna Cárdenas 4ab8c6f0dd Recommiting changes in ee905 and two latter (why they were reverted?) 2022-04-18 22:36:10 -05:00
Offray Vladimir Luna Cárdenas b92102a9d1 Merge dc945dd8f9 2022-04-18 22:16:00 -05:00
Offray Vladimir Luna Cárdenas c2078d032f Minor fix in quotes scraping. 2022-04-18 22:14:17 -05:00
ruidajo dc945dd8f9 Modifying histograms exporters. 2022-04-18 19:19:49 -05:00
ruidajo 2383ea4459 Refactoring collect tweets. 2022-04-18 19:00:58 -05:00
ruidajo 29c6deb617 Creating quotes filtering for nitter user messages. 2022-04-18 18:52:56 -05:00
ruidajo 3a58d281e2 Merge e98fd45083 2022-04-18 18:47:07 -05:00
ruidajo a687e1b688 Creating metadata parsing from nitter html. 2022-04-18 18:44:52 -05:00
Offray Vladimir Luna Cárdenas e98fd45083 Improving creation date processing/transfomation from different formats. #retrieveContents should also load local messages. 2022-04-18 18:36:52 -05:00
ruidajo 906b29a7ef Creating quotes metadata parsing. 2022-04-18 18:36:07 -05:00
ruidajo 8d87ee3ed7 Creating replies and retweets filtering and modifying histograms. 2022-04-18 17:29:09 -05:00
ruidajo bfa2a2ab99 Modifying documentTree for downloading replies. 2022-04-18 16:14:01 -05:00
ruidajo ad592beaf8 Creating replies download and recognition from nitter html. 2022-04-18 15:53:57 -05:00
Offray Vladimir Luna Cárdenas 49d5529934 Fixing creation date return depending on type of scrapping. 2022-04-17 12:30:28 -05:00
Offray Vladimir Luna Cárdenas 7de47a4959 Fixing tweets rendeting: loading users from local DB or remote scrapping. 2022-04-16 22:36:46 -05:00
Offray Vladimir Luna Cárdenas ee9050a9b9 Fixing tweets rendeting by loading local users from DB. 2022-04-16 19:53:33 -05:00
Offray Vladimir Luna Cárdenas 50a3ef901b Code review: More modular code. 2022-04-16 12:08:30 -05:00
ruidajo 5d457e824a Creating histogram exporter for tweets and modifyng install external word cloud commons. 2022-04-16 01:59:52 -05:00
ruidajo f28e884a79 Creating default exporter for tex template. 2022-04-16 01:37:11 -05:00
ruidajo c9d9ec9620 Creating installation for template. 2022-04-16 01:32:02 -05:00
ruidajo 1f081f58cf Creating time spans division for tweets collection. 2022-04-15 18:53:06 -05:00
Offray Vladimir Luna Cárdenas 2de7cf1d11 Now external word cloud installs its common files and loads required data. 2022-04-15 14:35:11 -05:00
Offray Vladimir Luna Cárdenas 986f4a83bc Better variable namings 2022-04-15 08:49:20 -05:00
Offray Vladimir Luna Cárdenas 382dcd9954 Calculating time subperiods for tweets histogram. 2022-04-15 07:36:53 -05:00
Offray Vladimir Luna Cárdenas 0da5c06527 Initial methods for tweets histogram. 2022-04-15 00:05:17 -05:00
Offray Vladimir Luna Cárdenas d61490e96c Making word cloud reproducible in local copy. 2022-04-14 20:27:26 -05:00
ruidajo 216832c3e2 Fixing external word cloud commons installation. 2022-04-14 20:00:06 -05:00
ruidajo a50e37dce1 Modifying external cloud commons installation. 2022-04-14 19:39:46 -05:00
ruidajo 4341383a8c Modifying external word cloud parameters. 2022-04-14 19:20:45 -05:00
Offray Vladimir Luna Cárdenas f97b193c5e Renaming methods for clarity. 2022-04-14 17:40:41 -05:00
ruidajo b9eedc6ec3 Fixing connection to ReStore DB in tweets collection. 2022-04-14 16:43:31 -05:00
Offray Vladimir Luna Cárdenas 02ab2bd74a Local storage: getting messages from local DB. 2022-04-12 21:58:51 -05:00
ruidajo f563f964b2 Creating testing for twitter user in ReStore. 2022-04-12 18:59:12 -05:00
ruidajo 8f2ed277fb Modifying tweet created for ReStore definition. 2022-04-12 18:23:08 -05:00
ruidajo a445100e58 Fixing tweet form nitter html and collecting tweets for nitteruser. 2022-04-12 18:13:31 -05:00