Ghost/ghost
Simon Backx f4fdb4fa6c
Added new email event processor (#15879)
fixes https://github.com/TryGhost/Team/issues/2310

This moves the processing of the events from the event-processor to a
new email-event-processor in the email-service package.

- The `EmailEventProcessor` only translates events from
providerId/emailId to their known emailId, memberId and recipientId, and
dispatches the corresponding events.
- Since `EmailEventProcessor` runs in a separate worker thread, we can't
listen for the dispatched events on the main thread. To accomplish this
communication, the events dispatched from the `EmailEventProcessor`
class are 'posted' via the postMessage method and redispatched on the
main thread.
- A new `EmailEventStorage` class reacts to the email events and stores
it in the database. This code mostly corresponds to the (now deleted)
subclass of the old `EmailEventProcessor`
- Updating a members last_seen_at timestamp has moved to the
lastSeenAtUpdater.
- Email events no longer store `ObjectID` because these are not
encodable across threads via postMessage
- Includes new E2E tests that test the storage of all supported Mailgun
events. Note that in these tests we run the processing on the main
thread instead of on a separate thread (couldn't do this because
stubbing is not possible across threads)

There are some missing pieces that will get added in later PRs (this PR
focuses on porting the existing functionality):
- Handling temporary failures/bounces
- Capturing the error messages of bounce events
2022-11-29 11:15:19 +01:00
..
adapter-manager
admin Merged v5.24.2 into main 2022-11-28 17:36:37 +00:00
api-framework
api-version-compatibility-service
audience-feedback Update dependency bson-objectid to v2.0.4 2022-11-24 11:24:07 +07:00
bootstrap-socket
constants
core Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
custom-theme-settings-service
data-generator
domain-events Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
email-analytics-provider-mailgun
email-analytics-service Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
email-content-generator
email-events Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
email-service Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
email-suppression-list
express-dynamic-redirects
extract-api-key
html-to-plaintext
job-manager Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
link-redirects Update dependency bson-objectid to v2.0.4 2022-11-24 11:24:07 +07:00
link-replacer
link-tracking Update dependency bson-objectid to v2.0.4 2022-11-24 11:24:07 +07:00
magic-link
mailgun-client
member-attribution
member-events
members-api Added events to Post Analytics page (#15886) 2022-11-28 17:43:35 +04:00
members-csv
members-events-service Added new email event processor (#15879) 2022-11-29 11:15:19 +01:00
members-importer Fixed verification trigger not working for large imports (#15887) 2022-11-28 18:22:10 +01:00
members-ssr
minifier Update dependency terser to v5.16.0 2022-11-24 19:01:01 +00:00
mw-api-version-mismatch
mw-cache-control
mw-error-handler Renamed mw-error-handler test file to match lib 2022-11-23 21:49:40 +00:00
mw-session-from-token
mw-update-user-last-seen
mw-vhost
oembed-service Update metascraper to v5.32.1 2022-11-21 15:31:26 +00:00
offers Update dependency bson-objectid to v2.0.4 2022-11-24 11:24:07 +07:00
package-json
payments
portal Add suppression modal to Portal 2022-11-24 13:58:27 +04:00
referrers
security
session-service
settings-path-manager
staff-service Added note on package/class naming 2022-11-22 11:25:11 +07:00
stats-service
stripe
tiers Update dependency bson-objectid to v2.0.4 2022-11-24 11:24:07 +07:00
update-check-service
verification-trigger
version-notifications-data-service