d34a3263e8
requires https://github.com/TryGhost/Ghost/pull/12192 - added initial `EmailBatch` and `EmailRecipient` model definitions with defaults and relationships - added missing `post` relationship function to email model - fetch member list without bookshelf - bookshelf can add around 3x overhead when fetching the members list for an email - we don't need full members at this point, only having the data is fine - if we need full models later on we can push the model hydration into background jobs where recipient batches are fetched ready for an email to be sent - bookshelf model instantiation of many models blocks the event loop, using knex directly keeps concurrent requests fast - adds `getFilteredCollectionQuery` method to base model to facilitate getting a knex query based on our normal model filters along with transaction/forUpdate applied - store recipient list before sending email - chunk already-fetched members list into batches and insert records into the `email_recipients` table via knex - chunked into batches of 1000 to match the number of emails that Mailgun accepts in a single API request but this may not be the absolute fastest batch size for recipient insertion: | Batch size | Batch time | Total time | | ---------- | ---------- | ---------- | | 500 | 20ms | 4142ms | | 1000 | 50ms | 4651ms | | 5000 | 170ms | 3540ms | | 10000 | 370ms | 3684ms | - create an email_batch record before inserting recipient rows so we can effeciently fetch recipients by batch and store the overall batch status |
||
|---|---|---|
| .. | ||
| base | ||
| plugins | ||
| relations | ||
| action.js | ||
| api-key.js | ||
| author.js | ||
| email-batch.js | ||
| email-recipient.js | ||
| email.js | ||
| index.js | ||
| integration.js | ||
| invite.js | ||
| label.js | ||
| member-stripe-customer.js | ||
| member.js | ||
| mobiledoc-revision.js | ||
| permission.js | ||
| post.js | ||
| posts-meta.js | ||
| role.js | ||
| session.js | ||
| settings.js | ||
| single-use-token.js | ||
| stripe-customer-subscription.js | ||
| tag-public.js | ||
| tag.js | ||
| user.js | ||
| webhook.js | ||