Commit Graph

385 Commits

Author SHA1 Message Date
Ted Unangst 50e43569e4 finish up some hfcs matching work 2019-10-04 21:47:27 -04:00
Ted Unangst 5672db2380 reduce max size a little 2019-10-04 21:24:15 -04:00
Ted Unangst de36230cec enough of the honk filtering and censoring system (hfcs) to get going. 2019-10-04 16:30:33 -04:00
Ted Unangst 73d6331c2d reset currettid too 2019-10-03 12:37:15 -04:00
Ted Unangst bcb36d8cff if we make it this far without context, fake one 2019-10-03 12:35:17 -04:00
Ted Unangst 140e96f80e save convoy here 2019-10-03 12:33:19 -04:00
Ted Unangst 341577c35c try a limiter here 2019-10-03 01:17:43 -04:00
Ted Unangst e98366ccb7 add an intake length limit 2019-10-03 00:23:46 -04:00
Ted Unangst 3cd2f57f9e handle durations for times 2019-10-03 00:11:02 -04:00
Ted Unangst 99f0e73394 support inline images in received posts 2019-10-02 23:02:01 -04:00
Ted Unangst 93e541d2a0 look for location as property not just tag 2019-10-02 21:24:40 -04:00
Ted Unangst e3fdf87a00 events with start times. because... because. 2019-10-02 18:20:14 -04:00
Ted Unangst 16212d9dab don't go down if we're going up 2019-10-01 00:01:45 -04:00
Ted Unangst e89bff3051 rework save code to gobble up replies 2019-09-30 23:32:10 -04:00
Ted Unangst 49a2107fdb make a note of replies we see 2019-09-30 23:16:54 -04:00
Ted Unangst 5efa912126 rm useless log 2019-09-30 22:48:55 -04:00
Ted Unangst 3e9899f800 treat tombstone as delete 2019-09-30 14:28:57 -04:00
Ted Unangst d4688e3ff9 rework some of the front end styles for consistency 2019-09-30 14:17:58 -04:00
Ted Unangst a333026b44 cleanup intake a bit, fast path for delete 2019-09-30 01:30:39 -04:00
Ted Unangst dbe8a3c55c split media into separate database. keeps main db nice and tidy. 2019-09-29 21:40:37 -04:00
Ted Unangst 0d0a5677a0 add url to places 2019-09-29 16:07:35 -04:00
Ted Unangst 409d1e9932 media skipping for naughty people 2019-09-28 17:40:24 -04:00
Ted Unangst 42fb29c4e1 process place in updates 2019-09-28 17:16:19 -04:00
Ted Unangst 1b0dc71a71 try harder to not deliver to self. 2019-09-28 17:13:57 -04:00
Ted Unangst 91afec7070 unravel a bit of the big mess 2019-09-28 17:03:05 -04:00
Ted Unangst 0b058562e5 parse location on input 2019-09-28 00:28:26 -04:00
Ted Unangst 2cfa3a71e2 location checkins! waaahahaha 2019-09-28 00:12:50 -04:00
Ted Unangst c4d210fdfb some fixups for the way friendica does context 2019-09-25 12:27:02 -04:00
Ted Unangst d26d4a972c technically, should undo read instead of sending ignore.
not using ignore activity yet
2019-09-22 20:29:10 -04:00
Ted Unangst da7cca5351 prefer object date 2019-09-21 18:28:57 -04:00
Ted Unangst 99efbe1d1f preserve image extension 2019-09-18 15:34:29 -04:00
Ted Unangst d62486db27 fix memes 2019-09-18 14:02:49 -04:00
Ted Unangst 2584f31e17 save honks in markdown, convert on the fly 2019-09-18 13:46:42 -04:00
Ted Unangst 4ee7268ca7 don't need this log 2019-09-17 19:00:46 -04:00
Ted Unangst aa0c99ae68 better handling of attachments during edit 2019-09-17 10:44:00 -04:00
Ted Unangst bef74481c8 check for bogus hashtags 2019-09-17 09:53:01 -04:00
Ted Unangst 65eae9dbfc this could never work 2019-09-16 18:05:46 -04:00
Ted Unangst ce764c468d move update log 2019-09-16 18:05:09 -04:00
Ted Unangst b8df8a9b93 beta/prototype of Update 2019-09-16 18:00:13 -04:00
Ted Unangst 4d95d2290a combine delete code into a function 2019-09-16 17:00:50 -04:00
Ted Unangst cba1a5d297 remove extra log 2019-09-12 17:19:17 -04:00
Ted Unangst 56141dbb6f cleanup the honk save code 2019-09-11 16:20:22 -04:00
Ted Unangst ead0b2995e i think this is enough for image descriptions 2019-09-09 09:55:04 -04:00
Ted Unangst 6eb416eea3 another faster check for blocked stuff 2019-09-06 14:44:29 -04:00
Ted Unangst a4fe9fcf25 more info about some errors 2019-08-30 10:16:59 -04:00
Ted Unangst 194c9a1223 few refinements to tags 2019-08-28 12:07:46 -04:00
Ted Unangst 03e948fe3c unbonking should work now 2019-08-27 22:15:53 -04:00
Ted Unangst 91fc33c5dd experimental unbonking 2019-08-27 21:22:59 -04:00
Ted Unangst be64eff398 and save tags on incoming 2019-08-24 23:18:19 -04:00
Ted Unangst 368b4d067e quick fix before tags can go live 2019-08-24 23:11:53 -04:00
Ted Unangst f74b91e15b we're starting to get there with hashtags 2019-08-24 23:03:05 -04:00
Ted Unangst 9a1b98e402 more detail in logging 2019-08-22 11:06:31 -04:00
Ted Unangst 9f26779377 federate read/ignore activities for ack and deack 2019-08-21 01:23:00 -04:00
Ted Unangst e9c5b28217 add approved replies to AP object collection 2019-08-18 23:25:11 -04:00
Ted Unangst 27b5bc5f5f prefetch handle info instead of waiting for load 2019-08-18 18:32:44 -04:00
Ted Unangst 840224e3b9 schema change to add flags to honks 2019-08-16 15:13:33 -04:00
Ted Unangst 35388f6d3f supreme court says organizations are people 2019-08-16 00:32:18 -04:00
Ted Unangst fbe47a0895 every database exec must have error checking 2019-08-16 00:15:55 -04:00
Ted Unangst 617cdd5fd8 better handle AP usernames. don't require manual entry 2019-08-15 23:27:55 -04:00
Ted Unangst 6a0fc08c32 better retry effort to cope with timeouts 2019-08-14 13:15:11 -04:00
Ted Unangst 1c6bb1fef4 don't decode images that are too large 2019-08-07 12:01:57 -04:00
Ted Unangst 2a197e157c every time I try to get a post from pixelfed, I get a 502 error.
workaround by sleeping and trying again when the PHP cools down.
2019-08-02 10:45:42 -04:00
Ted Unangst e15d81638b remove spicy peppers sensitivity 2019-08-01 20:36:22 -04:00
Ted Unangst 5a621af47e go ten replies up a thread chain 2019-07-29 14:24:45 -04:00
Ted Unangst d6cc646200 a little more type safety with less interface 2019-07-28 20:01:12 -04:00
Ted Unangst a6b45e4c92 reduce code by using library 2019-07-28 19:54:39 -04:00
Ted Unangst 7e1bf702cc switch to common version of httpsig code 2019-07-28 19:44:27 -04:00
Ted Unangst a84f5d8a50 better effort to avoid duplicte deliveries 2019-07-24 20:27:13 -04:00
Ted Unangst 26cb0ee381 allow modifying url patterns to better imitate other software. kinda. 2019-07-23 13:21:09 -04:00
Ted Unangst a1648667ec handle the case where inreplyto is an object 2019-07-22 00:09:16 -04:00
Ted Unangst 4e03d728b8 if the created object is url, fetch it 2019-07-20 23:01:04 -04:00
Ted Unangst a53f9b7917 allow attributedto to be object 2019-07-20 22:45:43 -04:00
Ted Unangst 68bed3837c only log first error if retrying during get 2019-07-18 15:13:10 -04:00
Ted Unangst 5b10e20388 try grabbing the name if no summary 2019-07-16 03:35:04 -04:00
Ted Unangst 4aba1ba5fd simplify cleanup command 2019-07-15 20:49:01 -04:00
Ted Unangst 46a50e5b80 servername in user-agent to play nice 2019-07-15 12:57:50 -04:00
Ted Unangst 1a095fdecf more realistically, only (long) timeout errors can be fixed by retries 2019-07-11 01:25:50 -04:00
Ted Unangst 0023fac43d implement a short timeout for some get operations 2019-07-11 01:20:53 -04:00
Ted Unangst 2a2019743f if it's sensitive but we don't know why, make up a reason 2019-07-10 14:46:43 -04:00
Ted Unangst 7b6321302a support a few more actor types 2019-07-10 01:21:56 -04:00
Ted Unangst 598e3aa3c4 try collecting upstream for any activity 2019-07-08 15:02:49 -04:00
Ted Unangst 02aaa2d134 icon should probably be Image type 2019-07-08 15:02:03 -04:00
Ted Unangst 663ee79877 better effort at combining thread id 2019-07-06 13:31:11 -04:00
Ted Unangst c78a6828fb only say honks, not bonks, are qonks. the silliness never ends. 2019-07-06 13:25:25 -04:00
Ted Unangst 5d0fb4d41c don't save large attachments that sneak in 2019-07-04 18:47:45 -04:00
Ted Unangst d2870d8207 if we didn't convert image, don't save data 2019-07-04 18:46:15 -04:00
Ted Unangst ff73147e28 some fixes and changes necessary to support peertube links 2019-07-01 10:43:38 -04:00
Ted Unangst 3a026f0c09 relax incoming image restriction slightly 2019-06-27 16:28:08 -04:00
Ted Unangst e89d24ac20 add some more info to bonks.
notably adding /followers is required for pleroma to ack it.
2019-06-26 17:19:45 -04:00
Ted Unangst eb735e538b refine the spicy post logic 2019-06-23 19:07:28 -04:00
Ted Unangst 2f72fe0ce0 fix unfollow. needs object field in follow object. 2019-06-20 23:47:05 -04:00
Ted Unangst 22401dfbdb tombstones for zonks 2019-06-17 12:18:37 -04:00
Ted Unangst 50f0222eb1 allow import the most recent honks for a xonker 2019-06-16 22:36:52 -04:00
Ted Unangst 507e4b6c6b include hashtags in AP metadata 2019-06-15 18:24:18 -04:00
Ted Unangst 5586f2a4ec ah, use the big \U unicode escape. 2019-06-13 22:28:06 -04:00
Ted Unangst d56b3023ed oops, working with unicode emoji is a pain. fix spicy meter. 2019-06-13 22:22:32 -04:00
Ted Unangst cbb382b188 mark the spicy honks as sensitive 2019-06-13 16:46:56 -04:00
Ted Unangst c925160853 readonly qonk support 2019-06-11 23:03:53 -04:00
Ted Unangst 889026e80d push the junky json code out a little more 2019-06-11 10:14:12 -04:00
Ted Unangst d76dc7bf98 rework all the follow stuff a bit 2019-06-10 23:57:03 -04:00
Ted Unangst 261ff367cf retry follow requests 2019-06-10 23:51:04 -04:00
Ted Unangst 02ca7e2849 make some effort to fill in thread when missing 2019-06-07 11:15:46 -04:00
Ted Unangst f4b8fd8b97 better image toolkit for prettier screenshots 2019-06-05 02:13:01 -04:00
Ted Unangst ed0c28b6a2 dig into actor url to verify id 2019-06-03 03:20:03 -04:00
Ted Unangst 170d3ee858 don't need to print this 2019-06-03 00:52:25 -04:00
Ted Unangst f29f31d32c less awkard use of xonkers table 2019-06-03 00:15:06 -04:00
Ted Unangst 14fd3a64cd don't need to log the whole follow accept 2019-06-02 16:08:24 -04:00
Ted Unangst 2fdd553d8e even if we don't save the file, save a donk 2019-05-28 04:23:36 -04:00
Ted Unangst 4c2d24a05c maybe works better if we set the magic directMessage flag 2019-05-28 03:54:03 -04:00
Ted Unangst 0faf2b0556 allow replying to private messages with private replies 2019-05-28 02:36:47 -04:00
Ted Unangst 233f80fa4a log excessive attachment separately 2019-05-25 14:34:46 -04:00
Ted Unangst dcc055ace1 cleanup images after 30 days if we don't need them 2019-05-25 13:34:41 -04:00
Ted Unangst 09b471b8de stop abusing rid for deletion, just use xid like normal 2019-05-21 19:32:43 -04:00
Ted Unangst fc4f13d9e0 the number of unreliable servers in the federation is too damn high! 2019-05-21 19:09:28 -04:00
Ted Unangst d8d439e596 consume activities in a goroutine other than the web handler 2019-05-21 18:51:04 -04:00
Ted Unangst d4d2483ee0 add better origin checks for all activities 2019-05-21 13:56:15 -04:00
Ted Unangst 18bb5dbd99 log reception of xonk 2019-05-20 10:53:16 -04:00
Ted Unangst 8fe575dcf3 reget bonks even when embedded 2019-05-20 10:51:15 -04:00
Ted Unangst 5e7ed058c1 user-agent for posts as well 2019-05-20 10:48:42 -04:00
Ted Unangst 24006757e0 rework honk to make local and remote about the same.
indicate the difference with a flag, not magic values in various columns.
2019-05-20 10:48:02 -04:00
Ted Unangst 90c7001e15 rework honk schema to store more information.
add original honker for bonks.
add separate precis field for summary.
add format to prepare for changing how html is saved.
2019-05-15 16:27:50 -04:00
Ted Unangst ed357653a8 some minor cleanup 2019-05-13 13:02:12 -04:00
Ted Unangst e10c9d801b support Page objects too 2019-05-13 09:36:28 -04:00
Ted Unangst 6be21e9f0b can cache fishing results in db 2019-05-10 18:18:32 -04:00
Ted Unangst f1b4c45088 try logging only unknown activities for a while 2019-05-07 20:55:11 -04:00
Ted Unangst adcc0a1339 don't leave attachment linkage in db after deletion in case id is reused 2019-05-05 13:52:46 -04:00
Ted Unangst af849f4371 switch image code to webs 2019-05-04 18:05:15 -04:00
Ted Unangst 996cd76baa the danger zone 2019-05-04 12:28:00 -04:00
Ted Unangst bf18145db8 zonking of bonking 2019-05-03 14:43:08 -04:00
Ted Unangst 90a6e0f7c3 people really want to believe that deletion can work.
i think it's dangerous to perpetuate this belief,
but i'm not interested in being the internet archive either.
2019-05-03 13:42:39 -04:00
Ted Unangst 64d9c67c35 more than 4 attachments seems execessive, leave the rest off. 2019-05-01 23:13:00 -04:00
Ted Unangst dee1eda34e pixelfed sends attachments as Image.
as most implementations probably should actually.
2019-05-01 14:25:06 -04:00
Ted Unangst 99c41825ed more context about xonks we're ignoring 2019-04-30 15:51:09 -04:00
Ted Unangst ef7880cadc rework xonk saving to avoid crawling threads we won't ever save 2019-04-29 14:06:34 -04:00
Ted Unangst 370268399d convert a few one off db queries to statements 2019-04-28 22:48:46 -04:00
Ted Unangst cd7626a515 save links to the external attachments we don't want to save 2019-04-28 22:28:59 -04:00
Ted Unangst 46cc488d19 set a user-agent 2019-04-28 17:30:32 -04:00
Ted Unangst b0b0ad21df bloaty pig posters and their images of unusual size 2019-04-26 17:01:17 -04:00
Ted Unangst 6ce45d2f23 expansive search of the federation did not reveal any signs of intelligent gifs 2019-04-26 15:46:55 -04:00
Ted Unangst 2a0c9e5082 take me off this list!!! 2019-04-26 15:31:42 -04:00
Ted Unangst 4da06786e9 clemency for the sinners. allow pardon of zonkers. 2019-04-26 15:11:24 -04:00
Ted Unangst 9e726bde40 few more improvements to blocking 2019-04-26 09:35:22 -04:00
Ted Unangst 5183a83124 if an emu doesn't have a type, make a png 2019-04-25 14:18:33 -04:00
Ted Unangst a1445cb118 crawl up reply chain looking for oneups 2019-04-25 13:23:18 -04:00
Ted Unangst bf634b8224 don't fetch bonks if we already have them 2019-04-25 01:18:39 -04:00
Ted Unangst 99d89bb62c sometimes the honk is inside the bonk! 2019-04-25 00:50:41 -04:00
Ted Unangst 23cea380b0 add empty follow collections 2019-04-25 00:35:19 -04:00
Ted Unangst d728004cad only delete honks for user that receives deletion 2019-04-24 17:34:58 -04:00
Ted Unangst e28d07968d requesting bonks with the old activity name may work better 2019-04-23 15:58:13 -04:00
Ted Unangst 4e9987abca if content doesn't start with <p>, make it so 2019-04-22 15:05:44 -04:00
Ted Unangst 30e1657d7a start saving boxes in the db 2019-04-20 11:38:16 -04:00
Ted Unangst 770e57797e @me page just for me 2019-04-20 11:17:00 -04:00
Ted Unangst e8c5a307ce sigh. need to defer mentionize to avoid collecting our own html 2019-04-19 23:23:22 -04:00
Ted Unangst d75cbe1c3d prefer the activitypub context name for conversation 2019-04-19 12:48:44 -04:00
Ted Unangst 7219332e0a a convoy is a whole fleet of honks, coming at ya 2019-04-19 11:50:35 -04:00
Ted Unangst b5249fd53d schema updates for future changes. xonkers, zonkers, and convoys, oh my. 2019-04-19 11:08:22 -04:00
Ted Unangst 1417812419 201 is an ok status too 2019-04-18 16:09:10 -04:00
Ted Unangst d542796944 i think we're ready to try delivery in parallel 2019-04-16 20:22:16 -04:00
Ted Unangst 3dfe29724a don't try looking up boxes concurrently 2019-04-16 20:20:42 -04:00
Ted Unangst 3d0cb6c737 refine delivery some more 2019-04-16 20:14:24 -04:00
Ted Unangst 28a39e7f23 the delete object may also be just the id string 2019-04-16 15:09:57 -04:00
Ted Unangst ca85e502d2 oops, sharedInbox is hiding under endpoints 2019-04-16 14:47:08 -04:00
Ted Unangst 6ec4352d69 use shared inbox for delivery 2019-04-16 14:40:23 -04:00
Ted Unangst 3a03baf1de allow zonking of anything, but be clear that disavow is not delete 2019-04-15 16:18:38 -04:00
Ted Unangst 1fb1523f54 change finger accept type to yet another mime 2019-04-15 10:27:36 -04:00
Ted Unangst 7b12715d1e allow plaintext attachments 2019-04-15 10:04:41 -04:00
Ted Unangst efbd541381 small logging fix 2019-04-14 22:53:26 -04:00
Ted Unangst 7152549c99 add a null summary to please plemora 2019-04-14 21:38:47 -04:00
Ted Unangst b24f484a84 further prep for retries 2019-04-14 15:57:14 -04:00
Ted Unangst 8bb2a31118 we always need to be eradicated xonks 2019-04-14 13:38:05 -04:00
Ted Unangst 2436a76b7e don't cache box lookup failure. don't hold lock for too long. 2019-04-14 13:23:27 -04:00
Ted Unangst 1acb85d047 we can ignore incoming xonks that originated as self 2019-04-14 10:15:47 -04:00
Ted Unangst 68c465c4ad reduce duplicate bonks received slightly 2019-04-14 10:10:08 -04:00
Ted Unangst 5d340cd1ab rework deliveration to prepare for retries 2019-04-14 10:06:26 -04:00
Ted Unangst a21eccc71c oops, want summary, not context x2 2019-04-13 19:36:50 -04:00
Ted Unangst 7f7f8390ff remove unused function 2019-04-13 16:00:21 -04:00
Ted Unangst d52111ca8e looks like we can just treat article as a long note 2019-04-13 15:57:25 -04:00
Ted Unangst c163c74499 aesthetic shuffling of the deck chairs 2019-04-13 13:58:42 -04:00
Ted Unangst df1f73f45e if the summary isn't blank, add it to the content 2019-04-13 13:21:32 -04:00
Ted Unangst 02da8c739a better herding of emus 2019-04-13 12:32:24 -04:00
Ted Unangst f472979b2d custom emus 2019-04-12 15:02:56 -04:00
Ted Unangst 9a0b9a90bf can improve efficiency of dedupe slightly without much complication 2019-04-11 11:11:30 -04:00
Ted Unangst 8d966a1d50 try to get original audience for remote replies 2019-04-11 10:44:50 -04:00
Ted Unangst 21024fcd56 sign the content-type instead of content-length 2019-04-10 19:54:46 -04:00
Ted Unangst 7420c88f84 maybe 0.1 2019-04-09 07:59:33 -04:00