Commit Graph

200 Commits

Author SHA1 Message Date
ruidajo bd69b73529 Fixing raw tweets collection and tweets filtering from html. 2022-04-25 18:59:10 -05:00
ruidajo b964460fa3 Fixing page contents downloader and modifying tweets collection. 2022-04-25 18:21:13 -05:00
ruidajo a38124638d Creating tweet testing, and modifyng nitter user asdictonary. 2022-04-25 17:12:04 -05:00
Offray Vladimir Luna Cárdenas 3ff8dfc86a Code review: improved modularity. A second pass on #downloadWithRenaming: still pending. 2022-04-25 09:13:04 -05:00
Offray Vladimir Luna Cárdenas bd279b1fd3 Code Review: Formatting and ward clause. Method should be made more modular. 2022-04-25 06:26:54 -05:00
ruidajo bbfae14949 Creating exporter for report in LaTeX format. 2022-04-21 12:11:53 -05:00
ruidajo f66d93e2ca Refactoring: minor changes in histogram exporters. 2022-04-20 16:59:57 -05:00
ruidajo 57adfca53a Creating quotes histogram exporter. 2022-04-20 16:44:34 -05:00
ruidajo 66298fc248 Fixing and creating retweets histogram exporters. 2022-04-20 16:27:54 -05:00
ruidajo cde55509bf Creating retweets and quotes sorted by occurrences. 2022-04-20 15:49:50 -05:00
ruidajo e840f733fe Tweet user bug fix. 2022-04-20 14:56:08 -05:00
ruidajo 1e06d16801 Removing unnecessary methods. 2022-04-20 14:13:02 -05:00
ruidajo e43b375a6b Creating exporter for retweets. 2022-04-19 13:55:39 -05:00
Offray Vladimir Luna Cárdenas 4e6b134848 Merge 4ab8c6f0dd 2022-04-19 00:20:42 -05:00
Offray Vladimir Luna Cárdenas 99a03c0ad1 Tweets collection now inherits from OrderedCollection to improve reusability. 2022-04-19 00:19:23 -05:00
Offray Vladimir Luna Cárdenas 4ab8c6f0dd Recommiting changes in ee905 and two latter (why they were reverted?) 2022-04-18 22:36:10 -05:00
Offray Vladimir Luna Cárdenas b92102a9d1 Merge dc945dd8f9 2022-04-18 22:16:00 -05:00
Offray Vladimir Luna Cárdenas c2078d032f Minor fix in quotes scraping. 2022-04-18 22:14:17 -05:00
ruidajo dc945dd8f9 Modifying histograms exporters. 2022-04-18 19:19:49 -05:00
ruidajo 2383ea4459 Refactoring collect tweets. 2022-04-18 19:00:58 -05:00
ruidajo 29c6deb617 Creating quotes filtering for nitter user messages. 2022-04-18 18:52:56 -05:00
ruidajo 3a58d281e2 Merge e98fd45083 2022-04-18 18:47:07 -05:00
ruidajo a687e1b688 Creating metadata parsing from nitter html. 2022-04-18 18:44:52 -05:00
Offray Vladimir Luna Cárdenas e98fd45083 Improving creation date processing/transfomation from different formats. #retrieveContents should also load local messages. 2022-04-18 18:36:52 -05:00
ruidajo 906b29a7ef Creating quotes metadata parsing. 2022-04-18 18:36:07 -05:00
ruidajo 8d87ee3ed7 Creating replies and retweets filtering and modifying histograms. 2022-04-18 17:29:09 -05:00
ruidajo bfa2a2ab99 Modifying documentTree for downloading replies. 2022-04-18 16:14:01 -05:00
ruidajo ad592beaf8 Creating replies download and recognition from nitter html. 2022-04-18 15:53:57 -05:00
Offray Vladimir Luna Cárdenas 49d5529934 Fixing creation date return depending on type of scrapping. 2022-04-17 12:30:28 -05:00
Offray Vladimir Luna Cárdenas 7de47a4959 Fixing tweets rendeting: loading users from local DB or remote scrapping. 2022-04-16 22:36:46 -05:00
Offray Vladimir Luna Cárdenas ee9050a9b9 Fixing tweets rendeting by loading local users from DB. 2022-04-16 19:53:33 -05:00
Offray Vladimir Luna Cárdenas 50a3ef901b Code review: More modular code. 2022-04-16 12:08:30 -05:00
ruidajo 5d457e824a Creating histogram exporter for tweets and modifyng install external word cloud commons. 2022-04-16 01:59:52 -05:00
ruidajo f28e884a79 Creating default exporter for tex template. 2022-04-16 01:37:11 -05:00
ruidajo c9d9ec9620 Creating installation for template. 2022-04-16 01:32:02 -05:00
ruidajo 1f081f58cf Creating time spans division for tweets collection. 2022-04-15 18:53:06 -05:00
Offray Vladimir Luna Cárdenas 2de7cf1d11 Now external word cloud installs its common files and loads required data. 2022-04-15 14:35:11 -05:00
Offray Vladimir Luna Cárdenas 986f4a83bc Better variable namings 2022-04-15 08:49:20 -05:00
Offray Vladimir Luna Cárdenas 382dcd9954 Calculating time subperiods for tweets histogram. 2022-04-15 07:36:53 -05:00
Offray Vladimir Luna Cárdenas 0da5c06527 Initial methods for tweets histogram. 2022-04-15 00:05:17 -05:00
Offray Vladimir Luna Cárdenas d61490e96c Making word cloud reproducible in local copy. 2022-04-14 20:27:26 -05:00
ruidajo 216832c3e2 Fixing external word cloud commons installation. 2022-04-14 20:00:06 -05:00
ruidajo a50e37dce1 Modifying external cloud commons installation. 2022-04-14 19:39:46 -05:00
ruidajo 4341383a8c Modifying external word cloud parameters. 2022-04-14 19:20:45 -05:00
Offray Vladimir Luna Cárdenas f97b193c5e Renaming methods for clarity. 2022-04-14 17:40:41 -05:00
ruidajo b9eedc6ec3 Fixing connection to ReStore DB in tweets collection. 2022-04-14 16:43:31 -05:00
Offray Vladimir Luna Cárdenas 02ab2bd74a Local storage: getting messages from local DB. 2022-04-12 21:58:51 -05:00
ruidajo f563f964b2 Creating testing for twitter user in ReStore. 2022-04-12 18:59:12 -05:00
ruidajo 8f2ed277fb Modifying tweet created for ReStore definition. 2022-04-12 18:23:08 -05:00
ruidajo a445100e58 Fixing tweet form nitter html and collecting tweets for nitteruser. 2022-04-12 18:13:31 -05:00
ruidajo bcf67809a8 Improving nitter user getting pages. 2022-04-12 16:05:59 -05:00
Offray Vladimir Luna Cárdenas 2c61055b38 Improved naming to better convey intention and more TO DO's. 2022-04-12 12:03:48 -05:00
Offray Vladimir Luna Cárdenas 52b90dd8dd New TO DO annotations and improving formating. 2022-04-12 10:15:24 -05:00
Offray Vladimir Luna Cárdenas 9b99ed0e33 Now each tweet stores metadata about the Nitter timeline where it appears. 2022-04-11 20:46:22 -05:00
ruidajo db1a8e0502 Improving nitter user getting and parsing tweets. 2022-04-11 14:18:52 -05:00
Offray Vladimir Luna Cárdenas bc168c4f0a Code review: Modularization. 2022-04-11 12:11:10 -05:00
Offray Vladimir Luna Cárdenas 65c36e924c Code review. Improving modularization and naming. 2022-04-11 11:42:54 -05:00
Offray Vladimir Luna Cárdenas 89a73603a3 Spliting between local and remote messages. Minor UI improvements. 2022-04-11 10:05:21 -05:00
Offray Vladimir Luna Cárdenas 2c2ee3b132 08.1376 Migration: Tweets previews problems deprecating BlLazyElement by BrAsyncWidget. 2022-04-10 12:37:25 -05:00
Offray Vladimir Luna Cárdenas 94ce588376 08.1376 Migration: Fixing profile previews problems caused by BlLazyElement deprecation. 2022-04-10 11:22:59 -05:00
Offray Vladimir Luna Cárdenas 01a62b2b2a 08.1376 Migration: Fixing profile previews problems caused by BlLazyElement deprecation. 2022-04-09 23:09:23 -05:00
Offray Vladimir Luna Cárdenas 36c261d534 Migrating to 08.1376, fixing code smells and refining UI elements because of external deprecation (but old problems arise). 2022-04-09 19:31:10 -05:00
ruidajo a84e9504f9 Improving tweets parsing from nitter timeline item. 2022-04-08 23:50:31 -05:00
ruidajo d9af46ec37 Improving tweet parsing from nitter timeline item. 2022-04-08 22:02:27 -05:00
Offray Vladimir Luna Cárdenas e8f9e1ddd9 Merge pull request 'detach-recovery' (#1) from detach-recovery into master
Reviewed-on: https://code.tupale.co/Offray/Socialmetrica/pulls/1
2022-04-08 11:24:42 -05:00
Offray Vladimir Luna Cárdenas 907fffe4be Merge 2e6e480668 2022-04-08 11:17:21 -05:00
Offray Vladimir Luna Cárdenas 8c9e302fdd Fixing conflict. 2022-04-08 11:15:04 -05:00
Offray Vladimir Luna Cárdenas ba05b8d0bb Changing profileImageUrl definition to ease ReStore serialization. Tip: Maybe derived keys can be used to serialize url as Strings in SQLite. 2022-04-08 11:10:24 -05:00
ruidajo 1e4f3d1190 Merge 2e6e480668 2022-04-07 14:20:57 -05:00
ruidajo b198bde247 Improving urls for load more tweets and removing unnecessary method. ref 5b169c4ebf 2022-04-07 14:17:17 -05:00
Offray Vladimir Luna Cárdenas 2e6e480668 Merge 610c8e4ca1 2022-04-07 13:35:11 -05:00
Offray Vladimir Luna Cárdenas 17b39ec4ad Fixing TwitterUser id detection. 2022-04-07 13:33:46 -05:00
ruidajo 610c8e4ca1 Improving nitter user profile image exporter. 2022-04-07 11:28:18 -05:00
Offray Vladimir Luna Cárdenas 6a60f4f13f Code smell: redundant information of folder name and file name. 2022-04-06 13:24:51 -05:00
Offray Vladimir Luna Cárdenas 7bab421f80 Code review: Fixing some code smells. 2022-04-06 13:09:38 -05:00
Offray Vladimir Luna Cárdenas 69941fbcfb Recovering changes after GT malfunction and image restarting. 2022-04-06 12:46:32 -05:00
Offray Vladimir Luna Cárdenas 062a0ac309 Storing several tweets. 2022-04-06 11:21:08 -05:00
Offray Vladimir Luna Cárdenas a899ba9a9d Storing several tweets. 2022-04-06 11:16:01 -05:00
Offray Vladimir Luna Cárdenas 112765cc72 Merge 5b169c4ebf 2022-04-06 09:51:00 -05:00
Offray Vladimir Luna Cárdenas 9d3769b21a Tweet ODBM preliminar model working. TwitterUser storage needs fixing. 2022-04-06 09:50:50 -05:00
ruidajo 5b169c4ebf Creating nitter user collection of urls for load more tweets and default config folder. 2022-04-05 19:29:34 -05:00
ruidajo 311c422216 Improving nitter user words file and external word cloud. 2022-04-05 17:37:42 -05:00
Offray Vladimir Luna Cárdenas 20f12bfcfc Draft for visualization. 2022-04-05 16:39:07 -05:00
Offray Vladimir Luna Cárdenas 1f665368c1 Improving temporal storage as STON files. 2022-04-05 16:16:09 -05:00
Offray Vladimir Luna Cárdenas 570010efca Refining local data storage. 2022-04-05 15:49:10 -05:00
Offray Vladimir Luna Cárdenas 3ef2289bbe Merge cdac1e3af7 2022-04-05 15:31:21 -05:00
Offray Vladimir Luna Cárdenas d23211abbc Persistance: Object Database mapper. 2022-04-05 15:30:52 -05:00
ruidajo cdac1e3af7 Improved store contents for NitterUser. 2022-04-04 19:06:21 -05:00
ruidajo 3ebaa05ea0 Refactoring nitter user exporter. 2022-04-04 16:41:12 -05:00
Offray Vladimir Luna Cárdenas 128c557d2f STON preview and starting SQLite storage. 2022-04-04 16:34:55 -05:00
Offray Vladimir Luna Cárdenas 1aea7b1b7c Improved tweet metadata to reconstruct timelines and queries. 2022-04-04 10:42:39 -05:00
Offray Vladimir Luna Cárdenas 92b8d90d1b Adding tweet metadata and improving storage. 2022-04-02 12:00:26 -05:00
Offray Vladimir Luna Cárdenas 3d2a3d8696 Merge 9b46b5cc83 2022-04-01 20:10:22 -05:00
Offray Vladimir Luna Cárdenas 6fba4b8186 Nitter: Improving tweets preview, metadata and collections management. 2022-04-01 20:10:12 -05:00
ruidajo 9b46b5cc83 Merge 9fd074b572 2022-04-01 19:50:32 -05:00
ruidajo 301f4aac27 Creating storeContents of NitterUser in STON format file. 2022-04-01 19:49:39 -05:00
Offray Vladimir Luna Cárdenas 9fd074b572 Merge dcb2a4590d 2022-04-01 19:46:32 -05:00
Offray Vladimir Luna Cárdenas 032e6fd7da Nitter: Improving tweets preview, metadata and collections management. 2022-04-01 19:34:30 -05:00
ruidajo dcb2a4590d Recovering Nitter/TwitterUser changes from 292cb444b4 commit. 2022-04-01 19:02:35 -05:00
Offray Vladimir Luna Cárdenas f7d6d3ea34 Massive rebranding to prepare launching... 2022-04-01 17:22:33 -05:00