Skip to content

Release/worker - #1160

Merged
josephjclark merged 4 commits into
mainfrom
release/worker
Dec 11, 2025
Merged

josephjclark merged 4 commits into
mainfrom
release/worker

Conversation

@josephjclark

@josephjclark josephjclark commented Dec 8, 2025 •

Copy link
Copy Markdown
Collaborator

@github-project-automation github-project-automation Bot moved this to New Issues in Core Dec 8, 2025
josephjclark and others added 2 commits December 10, 2025 11:53
* engine: support payload limits per event

* add log limit tests

* tests

* type

* changeset

* formatting

* update changeset

* remove rubbish
* scaffolding: make ensure-payload-size async and add slots for two algorithms

* first swing at async traversal

This actually increases memory overhead

* new traversal algorithm with queue, rather than recuion

* add benchmarking util

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* tidying

* optimisations

Still doesn't get close

* add streaming algo

* update benchmark

* remove traversal algorithm

* tidy

* tidy up

* tidy docs

* remove ignore

* remove old traverse stats

* typing

* restore await

* add a synchronous publish option

important  for process exit events

* revert debug code

---------

Co-authored-by: Claude <noreply@anthropic.com>
josephjclark and others added 2 commits December 10, 2025 15:06
* worker: re-write core event handler to allow more control of sequencing

* tidy tests and finish

* types

* add basic tests

* more testing

* Add batching and tests

* more tests

* options and more tests

* types

* copy new log stuff from other branch

* updates for live testing against lightning

Works great against new and legacy app, with or without batching

* options for interval and limit

* fix test

* copy across old test

* fix type

* add batch log test

* upate default batch size

* changeset

* run integration tests in batch mode

* update tests

* remove logging

* docs
@josephjclark josephjclark moved this from New Issues to In review in Core Dec 10, 2025
@josephjclark

Copy link
Copy Markdown
Collaborator Author

Tested this on staging

  • Log limit is enforced
  • logging works absolutely fine (no batching)

@josephjclark
josephjclark merged commit 44a4a59 into main Dec 11, 2025
8 checks passed
@github-project-automation github-project-automation Bot moved this from In review to Done in Core Dec 11, 2025
@josephjclark
josephjclark deleted the release/worker branch December 11, 2025 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant