Commit Graph

295 Commits

Author SHA1 Message Date
Ted Unangst 8187aea4f2 cache jonker for a bit 2019-10-07 15:47:37 -04:00
Ted Unangst 2fc3103ad4 cache jonks for AP fetches 2019-10-07 15:22:10 -04:00
Ted Unangst b1e42fdae9 use cache interface for some more things 2019-10-07 14:45:02 -04:00
Ted Unangst 4059b207a1 revise rejection log messages 2019-10-06 22:48:23 -04:00
Ted Unangst 2ae79a2cc1 we need some more debugging for the friendibonks 2019-10-06 22:07:39 -04:00
Ted Unangst d5b99e2b9a allow resubscribing 2019-10-06 21:33:10 -04:00
Ted Unangst a0b6756206 html escape summary fields 2019-10-06 15:23:42 -04:00
Ted Unangst a320b1a2a6 rework markdown module, prepare for embetterment 2019-10-06 15:01:23 -04:00
Ted Unangst d08eab8712 better handling of times and places.. 2019-10-05 16:49:56 -04:00
Ted Unangst 25c46f5839 grotesque workaround for friendica style repeats 2019-10-05 02:46:01 -04:00
Ted Unangst 50e43569e4 finish up some hfcs matching work 2019-10-04 21:47:27 -04:00
Ted Unangst 5672db2380 reduce max size a little 2019-10-04 21:24:15 -04:00
Ted Unangst de36230cec enough of the honk filtering and censoring system (hfcs) to get going. 2019-10-04 16:30:33 -04:00
Ted Unangst 73d6331c2d reset currettid too 2019-10-03 12:37:15 -04:00
Ted Unangst bcb36d8cff if we make it this far without context, fake one 2019-10-03 12:35:17 -04:00
Ted Unangst 140e96f80e save convoy here 2019-10-03 12:33:19 -04:00
Ted Unangst 341577c35c try a limiter here 2019-10-03 01:17:43 -04:00
Ted Unangst e98366ccb7 add an intake length limit 2019-10-03 00:23:46 -04:00
Ted Unangst 3cd2f57f9e handle durations for times 2019-10-03 00:11:02 -04:00
Ted Unangst 99f0e73394 support inline images in received posts 2019-10-02 23:02:01 -04:00
Ted Unangst 93e541d2a0 look for location as property not just tag 2019-10-02 21:24:40 -04:00
Ted Unangst e3fdf87a00 events with start times. because... because. 2019-10-02 18:20:14 -04:00
Ted Unangst 16212d9dab don't go down if we're going up 2019-10-01 00:01:45 -04:00
Ted Unangst e89bff3051 rework save code to gobble up replies 2019-09-30 23:32:10 -04:00
Ted Unangst 49a2107fdb make a note of replies we see 2019-09-30 23:16:54 -04:00
Ted Unangst 5efa912126 rm useless log 2019-09-30 22:48:55 -04:00
Ted Unangst 3e9899f800 treat tombstone as delete 2019-09-30 14:28:57 -04:00
Ted Unangst d4688e3ff9 rework some of the front end styles for consistency 2019-09-30 14:17:58 -04:00
Ted Unangst a333026b44 cleanup intake a bit, fast path for delete 2019-09-30 01:30:39 -04:00
Ted Unangst dbe8a3c55c split media into separate database. keeps main db nice and tidy. 2019-09-29 21:40:37 -04:00
Ted Unangst 0d0a5677a0 add url to places 2019-09-29 16:07:35 -04:00
Ted Unangst 409d1e9932 media skipping for naughty people 2019-09-28 17:40:24 -04:00
Ted Unangst 42fb29c4e1 process place in updates 2019-09-28 17:16:19 -04:00
Ted Unangst 1b0dc71a71 try harder to not deliver to self. 2019-09-28 17:13:57 -04:00
Ted Unangst 91afec7070 unravel a bit of the big mess 2019-09-28 17:03:05 -04:00
Ted Unangst 0b058562e5 parse location on input 2019-09-28 00:28:26 -04:00
Ted Unangst 2cfa3a71e2 location checkins! waaahahaha 2019-09-28 00:12:50 -04:00
Ted Unangst c4d210fdfb some fixups for the way friendica does context 2019-09-25 12:27:02 -04:00
Ted Unangst d26d4a972c technically, should undo read instead of sending ignore.
not using ignore activity yet
2019-09-22 20:29:10 -04:00
Ted Unangst da7cca5351 prefer object date 2019-09-21 18:28:57 -04:00
Ted Unangst 99efbe1d1f preserve image extension 2019-09-18 15:34:29 -04:00
Ted Unangst d62486db27 fix memes 2019-09-18 14:02:49 -04:00
Ted Unangst 2584f31e17 save honks in markdown, convert on the fly 2019-09-18 13:46:42 -04:00
Ted Unangst 4ee7268ca7 don't need this log 2019-09-17 19:00:46 -04:00
Ted Unangst aa0c99ae68 better handling of attachments during edit 2019-09-17 10:44:00 -04:00
Ted Unangst bef74481c8 check for bogus hashtags 2019-09-17 09:53:01 -04:00
Ted Unangst 65eae9dbfc this could never work 2019-09-16 18:05:46 -04:00
Ted Unangst ce764c468d move update log 2019-09-16 18:05:09 -04:00
Ted Unangst b8df8a9b93 beta/prototype of Update 2019-09-16 18:00:13 -04:00
Ted Unangst 4d95d2290a combine delete code into a function 2019-09-16 17:00:50 -04:00
Ted Unangst cba1a5d297 remove extra log 2019-09-12 17:19:17 -04:00
Ted Unangst 56141dbb6f cleanup the honk save code 2019-09-11 16:20:22 -04:00
Ted Unangst ead0b2995e i think this is enough for image descriptions 2019-09-09 09:55:04 -04:00
Ted Unangst 6eb416eea3 another faster check for blocked stuff 2019-09-06 14:44:29 -04:00
Ted Unangst a4fe9fcf25 more info about some errors 2019-08-30 10:16:59 -04:00
Ted Unangst 194c9a1223 few refinements to tags 2019-08-28 12:07:46 -04:00
Ted Unangst 03e948fe3c unbonking should work now 2019-08-27 22:15:53 -04:00
Ted Unangst 91fc33c5dd experimental unbonking 2019-08-27 21:22:59 -04:00
Ted Unangst be64eff398 and save tags on incoming 2019-08-24 23:18:19 -04:00
Ted Unangst 368b4d067e quick fix before tags can go live 2019-08-24 23:11:53 -04:00
Ted Unangst f74b91e15b we're starting to get there with hashtags 2019-08-24 23:03:05 -04:00
Ted Unangst 9a1b98e402 more detail in logging 2019-08-22 11:06:31 -04:00
Ted Unangst 9f26779377 federate read/ignore activities for ack and deack 2019-08-21 01:23:00 -04:00
Ted Unangst e9c5b28217 add approved replies to AP object collection 2019-08-18 23:25:11 -04:00
Ted Unangst 27b5bc5f5f prefetch handle info instead of waiting for load 2019-08-18 18:32:44 -04:00
Ted Unangst 840224e3b9 schema change to add flags to honks 2019-08-16 15:13:33 -04:00
Ted Unangst 35388f6d3f supreme court says organizations are people 2019-08-16 00:32:18 -04:00
Ted Unangst fbe47a0895 every database exec must have error checking 2019-08-16 00:15:55 -04:00
Ted Unangst 617cdd5fd8 better handle AP usernames. don't require manual entry 2019-08-15 23:27:55 -04:00
Ted Unangst 6a0fc08c32 better retry effort to cope with timeouts 2019-08-14 13:15:11 -04:00
Ted Unangst 1c6bb1fef4 don't decode images that are too large 2019-08-07 12:01:57 -04:00
Ted Unangst 2a197e157c every time I try to get a post from pixelfed, I get a 502 error.
workaround by sleeping and trying again when the PHP cools down.
2019-08-02 10:45:42 -04:00
Ted Unangst e15d81638b remove spicy peppers sensitivity 2019-08-01 20:36:22 -04:00
Ted Unangst 5a621af47e go ten replies up a thread chain 2019-07-29 14:24:45 -04:00
Ted Unangst d6cc646200 a little more type safety with less interface 2019-07-28 20:01:12 -04:00
Ted Unangst a6b45e4c92 reduce code by using library 2019-07-28 19:54:39 -04:00
Ted Unangst 7e1bf702cc switch to common version of httpsig code 2019-07-28 19:44:27 -04:00
Ted Unangst a84f5d8a50 better effort to avoid duplicte deliveries 2019-07-24 20:27:13 -04:00
Ted Unangst 26cb0ee381 allow modifying url patterns to better imitate other software. kinda. 2019-07-23 13:21:09 -04:00
Ted Unangst a1648667ec handle the case where inreplyto is an object 2019-07-22 00:09:16 -04:00
Ted Unangst 4e03d728b8 if the created object is url, fetch it 2019-07-20 23:01:04 -04:00
Ted Unangst a53f9b7917 allow attributedto to be object 2019-07-20 22:45:43 -04:00
Ted Unangst 68bed3837c only log first error if retrying during get 2019-07-18 15:13:10 -04:00
Ted Unangst 5b10e20388 try grabbing the name if no summary 2019-07-16 03:35:04 -04:00
Ted Unangst 4aba1ba5fd simplify cleanup command 2019-07-15 20:49:01 -04:00
Ted Unangst 46a50e5b80 servername in user-agent to play nice 2019-07-15 12:57:50 -04:00
Ted Unangst 1a095fdecf more realistically, only (long) timeout errors can be fixed by retries 2019-07-11 01:25:50 -04:00
Ted Unangst 0023fac43d implement a short timeout for some get operations 2019-07-11 01:20:53 -04:00
Ted Unangst 2a2019743f if it's sensitive but we don't know why, make up a reason 2019-07-10 14:46:43 -04:00
Ted Unangst 7b6321302a support a few more actor types 2019-07-10 01:21:56 -04:00
Ted Unangst 598e3aa3c4 try collecting upstream for any activity 2019-07-08 15:02:49 -04:00
Ted Unangst 02aaa2d134 icon should probably be Image type 2019-07-08 15:02:03 -04:00
Ted Unangst 663ee79877 better effort at combining thread id 2019-07-06 13:31:11 -04:00
Ted Unangst c78a6828fb only say honks, not bonks, are qonks. the silliness never ends. 2019-07-06 13:25:25 -04:00
Ted Unangst 5d0fb4d41c don't save large attachments that sneak in 2019-07-04 18:47:45 -04:00
Ted Unangst d2870d8207 if we didn't convert image, don't save data 2019-07-04 18:46:15 -04:00
Ted Unangst ff73147e28 some fixes and changes necessary to support peertube links 2019-07-01 10:43:38 -04:00
Ted Unangst 3a026f0c09 relax incoming image restriction slightly 2019-06-27 16:28:08 -04:00
Ted Unangst e89d24ac20 add some more info to bonks.
notably adding /followers is required for pleroma to ack it.
2019-06-26 17:19:45 -04:00
Ted Unangst eb735e538b refine the spicy post logic 2019-06-23 19:07:28 -04:00
Ted Unangst 2f72fe0ce0 fix unfollow. needs object field in follow object. 2019-06-20 23:47:05 -04:00
Ted Unangst 22401dfbdb tombstones for zonks 2019-06-17 12:18:37 -04:00
Ted Unangst 50f0222eb1 allow import the most recent honks for a xonker 2019-06-16 22:36:52 -04:00
Ted Unangst 507e4b6c6b include hashtags in AP metadata 2019-06-15 18:24:18 -04:00
Ted Unangst 5586f2a4ec ah, use the big \U unicode escape. 2019-06-13 22:28:06 -04:00
Ted Unangst d56b3023ed oops, working with unicode emoji is a pain. fix spicy meter. 2019-06-13 22:22:32 -04:00
Ted Unangst cbb382b188 mark the spicy honks as sensitive 2019-06-13 16:46:56 -04:00
Ted Unangst c925160853 readonly qonk support 2019-06-11 23:03:53 -04:00
Ted Unangst 889026e80d push the junky json code out a little more 2019-06-11 10:14:12 -04:00
Ted Unangst d76dc7bf98 rework all the follow stuff a bit 2019-06-10 23:57:03 -04:00
Ted Unangst 261ff367cf retry follow requests 2019-06-10 23:51:04 -04:00
Ted Unangst 02ca7e2849 make some effort to fill in thread when missing 2019-06-07 11:15:46 -04:00
Ted Unangst f4b8fd8b97 better image toolkit for prettier screenshots 2019-06-05 02:13:01 -04:00
Ted Unangst ed0c28b6a2 dig into actor url to verify id 2019-06-03 03:20:03 -04:00
Ted Unangst 170d3ee858 don't need to print this 2019-06-03 00:52:25 -04:00
Ted Unangst f29f31d32c less awkard use of xonkers table 2019-06-03 00:15:06 -04:00
Ted Unangst 14fd3a64cd don't need to log the whole follow accept 2019-06-02 16:08:24 -04:00
Ted Unangst 2fdd553d8e even if we don't save the file, save a donk 2019-05-28 04:23:36 -04:00
Ted Unangst 4c2d24a05c maybe works better if we set the magic directMessage flag 2019-05-28 03:54:03 -04:00
Ted Unangst 0faf2b0556 allow replying to private messages with private replies 2019-05-28 02:36:47 -04:00
Ted Unangst 233f80fa4a log excessive attachment separately 2019-05-25 14:34:46 -04:00
Ted Unangst dcc055ace1 cleanup images after 30 days if we don't need them 2019-05-25 13:34:41 -04:00
Ted Unangst 09b471b8de stop abusing rid for deletion, just use xid like normal 2019-05-21 19:32:43 -04:00
Ted Unangst fc4f13d9e0 the number of unreliable servers in the federation is too damn high! 2019-05-21 19:09:28 -04:00
Ted Unangst d8d439e596 consume activities in a goroutine other than the web handler 2019-05-21 18:51:04 -04:00
Ted Unangst d4d2483ee0 add better origin checks for all activities 2019-05-21 13:56:15 -04:00
Ted Unangst 18bb5dbd99 log reception of xonk 2019-05-20 10:53:16 -04:00
Ted Unangst 8fe575dcf3 reget bonks even when embedded 2019-05-20 10:51:15 -04:00
Ted Unangst 5e7ed058c1 user-agent for posts as well 2019-05-20 10:48:42 -04:00
Ted Unangst 24006757e0 rework honk to make local and remote about the same.
indicate the difference with a flag, not magic values in various columns.
2019-05-20 10:48:02 -04:00
Ted Unangst 90c7001e15 rework honk schema to store more information.
add original honker for bonks.
add separate precis field for summary.
add format to prepare for changing how html is saved.
2019-05-15 16:27:50 -04:00
Ted Unangst ed357653a8 some minor cleanup 2019-05-13 13:02:12 -04:00
Ted Unangst e10c9d801b support Page objects too 2019-05-13 09:36:28 -04:00
Ted Unangst 6be21e9f0b can cache fishing results in db 2019-05-10 18:18:32 -04:00
Ted Unangst f1b4c45088 try logging only unknown activities for a while 2019-05-07 20:55:11 -04:00
Ted Unangst adcc0a1339 don't leave attachment linkage in db after deletion in case id is reused 2019-05-05 13:52:46 -04:00
Ted Unangst af849f4371 switch image code to webs 2019-05-04 18:05:15 -04:00
Ted Unangst 996cd76baa the danger zone 2019-05-04 12:28:00 -04:00
Ted Unangst bf18145db8 zonking of bonking 2019-05-03 14:43:08 -04:00
Ted Unangst 90a6e0f7c3 people really want to believe that deletion can work.
i think it's dangerous to perpetuate this belief,
but i'm not interested in being the internet archive either.
2019-05-03 13:42:39 -04:00
Ted Unangst 64d9c67c35 more than 4 attachments seems execessive, leave the rest off. 2019-05-01 23:13:00 -04:00
Ted Unangst dee1eda34e pixelfed sends attachments as Image.
as most implementations probably should actually.
2019-05-01 14:25:06 -04:00
Ted Unangst 99c41825ed more context about xonks we're ignoring 2019-04-30 15:51:09 -04:00
Ted Unangst ef7880cadc rework xonk saving to avoid crawling threads we won't ever save 2019-04-29 14:06:34 -04:00
Ted Unangst 370268399d convert a few one off db queries to statements 2019-04-28 22:48:46 -04:00
Ted Unangst cd7626a515 save links to the external attachments we don't want to save 2019-04-28 22:28:59 -04:00
Ted Unangst 46cc488d19 set a user-agent 2019-04-28 17:30:32 -04:00
Ted Unangst b0b0ad21df bloaty pig posters and their images of unusual size 2019-04-26 17:01:17 -04:00
Ted Unangst 6ce45d2f23 expansive search of the federation did not reveal any signs of intelligent gifs 2019-04-26 15:46:55 -04:00
Ted Unangst 2a0c9e5082 take me off this list!!! 2019-04-26 15:31:42 -04:00