login · lucasvanbriemen

dependabot[bot] commented about 2 months ago

Bumps solid_queue from 1.4.0 to 1.7.0.

Release notes

v1.7.0 - batches

This is a big one! Solid Queue finally supports job batches thanks to @jpcamara. Check the README for more details about how to use these. This took ages despite being a very requested feature 😅 Big thanks to @jpcamara for his patience, refinements and production-app tests!

What's Changed

Clarify that concurrency + bulk enqueuing is a perf caveat, not unsafe by @Gnirt in rails/solid_queue#785

Wait for polling queries in logging tests instead of sleeping by @wintan1418 in rails/solid_queue#775

Keep semaphore slots held while blocked jobs are enqueued in concurrency test by @wintan1418 in rails/solid_queue#776

Give in-flight jobs enough pause to survive slow shutdowns in tests by @wintan1418 in rails/solid_queue#782

Include the error in fail_many_claimed events and document recovery by @wintan1418 in rails/solid_queue#779

Replace terminated forks even if releasing their claimed jobs fails by @wintan1418 in rails/solid_queue#781

Honour TERM received during supervisor boot before forking workers by @rafael-pissardo in rails/solid_queue#770

Batch Support by @jpcamara in rails/solid_queue#142

New Contributors

@Gnirt made their first contribution in rails/solid_queue#785

Full Changelog: https://github.com/rails/solid_queue/compare/v1.6.0...v1.7.0

v1.6.0 - fiber execution mode (with Async)

A long-awaited feature thanks to @crmne on this release: instead of using a thread pool to run jobs in multiple threads per works, you can now use fibers on a single fiber reactor thread. To use this, you just need to specify the number of fibers instead of the number of threads in your worker configuration, like this:
workers:
  - queues: "api*"
    fibers: 100
    polling_interval: 0.05
It uses Async under the hood, so you need to have that as a dependency for it to work. Also, you need to be using fiber isolation in Rails (config.active_support.isolation_level`` = :fiber).

This can be very useful for I/O-bound workloads, such as those involving LLM calls.

What's Changed

Add fiber worker execution mode by @crmne in rails/solid_queue#728

Roll back transactions leaked by killed job threads in tests by @rosa in rails/solid_queue#773

Document how to update dynamic recurring tasks by @wintan1418 in rails/solid_queue#777

New Contributors

@crmne made their first contribution in rails/solid_queue#728

@wintan1418 made their first contribution in rails/solid_queue#777

Full Changelog: https://github.com/rails/solid_queue/compare/v1.5.1...v1.6.0

v1.5.1

What's Changed

Fix flaky tests caused by leaked job threads and signal timing by @rosa in rails/solid_queue#766

Add an update generator to copy new migrations by @rosa in rails/solid_queue#765

Wait for the continuable job to start before interrupting it by @rosa in rails/solid_queue#767

Add --only-recurring to run just the recurring scheduler by @rafael-pissardo in rails/solid_queue#757

Use with_connection in DistinctValues by @trevorturk in rails/solid_queue#769

Replace forked processes that fail to boot by @sapandiwakar in rails/solid_queue#760

... (truncated)

Commits

e2b5384 Bump solid_queue to 1.7.0
5352228 Reset pooled connections when flipping the batches schema in tests
112bb1c Refine batch support after a full review
1bcac83 Add batch support
fcb5f7a Name the supervisor's stop checkpoint and simplify its lifecycle
124176a Honour TERM received during supervisor boot before forking workers
174cb07 Protect the shutdown reap from release failures too
0526401 Replace terminated forks even if releasing their claimed jobs fails
6816e52 Include the error in fail_many_claimed events and document recovery
fc5fb59 Wait longer for the supervisor to fail the killed worker's job
Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Edit description

Bumps [solid_queue](https://github.com/rails/solid_queue) from 1.4.0 to 1.7.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/rails/solid_queue/releases">solid_queue's releases</a>.</em></p>
<blockquote>
<h2>v1.7.0 - batches</h2>
<p>This is a big one! Solid Queue finally supports <a href="https://github.com/rails/solid_queue#batch-jobs">job batches</a> thanks to <a href="https://github.com/jpcamara"><code>@jpcamara</code></a>.   Check the README for more details about how to use these. This took ages despite being a very requested feature 😅 Big thanks to <a href="https://github.com/jpcamara"><code>@jpcamara</code></a> for his patience, refinements and production-app tests!</p>
<h2>What's Changed</h2>
<ul>
<li>Clarify that concurrency + bulk enqueuing is a perf caveat, not unsafe by <a href="https://github.com/Gnirt"><code>@Gnirt</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/785">rails/solid_queue#785</a></li>
<li>Wait for polling queries in logging tests instead of sleeping by <a href="https://github.com/wintan1418"><code>@wintan1418</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/775">rails/solid_queue#775</a></li>
<li>Keep semaphore slots held while blocked jobs are enqueued in concurrency test by <a href="https://github.com/wintan1418"><code>@wintan1418</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/776">rails/solid_queue#776</a></li>
<li>Give in-flight jobs enough pause to survive slow shutdowns in tests by <a href="https://github.com/wintan1418"><code>@wintan1418</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/782">rails/solid_queue#782</a></li>
<li>Include the error in fail_many_claimed events and document recovery by <a href="https://github.com/wintan1418"><code>@wintan1418</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/779">rails/solid_queue#779</a></li>
<li>Replace terminated forks even if releasing their claimed jobs fails by <a href="https://github.com/wintan1418"><code>@wintan1418</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/781">rails/solid_queue#781</a></li>
<li>Honour TERM received during supervisor boot before forking workers by <a href="https://github.com/rafael-pissardo"><code>@rafael-pissardo</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/770">rails/solid_queue#770</a></li>
<li>Batch Support by <a href="https://github.com/jpcamara"><code>@jpcamara</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/142">rails/solid_queue#142</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/Gnirt"><code>@Gnirt</code></a> made their first contribution in <a href="https://redirect.github.com/rails/solid_queue/pull/785">rails/solid_queue#785</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a href="https://github.com/rails/solid_queue/compare/v1.6.0...v1.7.0">https://github.com/rails/solid_queue/compare/v1.6.0...v1.7.0</a></p>
<h2>v1.6.0 - fiber execution mode (with Async)</h2>
<p>A long-awaited feature thanks to <a href="https://github.com/crmne"><code>@crmne</code></a> on this release: instead of using a thread pool to run jobs in multiple threads per works, you can now use <a href="https://docs.ruby-lang.org/en/master/Fiber.html">fibers</a> on a single fiber reactor thread. To use this, you just need to specify the number of fibers instead of the number of threads in your worker configuration, like this:</p>
<pre lang="yaml"><code>workers:
  - queues: &quot;api*&quot;
    fibers: 100
    polling_interval: 0.05
</code></pre>
<p>It uses <a href="https://github.com/socketry/async">Async</a> under the hood, so you need to have that as a dependency for it to work. Also, you need to be using fiber isolation in Rails (<code>config.active_support.isolation_level`` = :fiber</code>).</p>
<p>This can be very useful for I/O-bound workloads, such as those involving LLM calls.</p>
<h2>What's Changed</h2>
<ul>
<li>Add fiber worker execution mode by <a href="https://github.com/crmne"><code>@crmne</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/728">rails/solid_queue#728</a></li>
<li>Roll back transactions leaked by killed job threads in tests by <a href="https://github.com/rosa"><code>@rosa</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/773">rails/solid_queue#773</a></li>
<li>Document how to update dynamic recurring tasks by <a href="https://github.com/wintan1418"><code>@wintan1418</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/777">rails/solid_queue#777</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/crmne"><code>@crmne</code></a> made their first contribution in <a href="https://redirect.github.com/rails/solid_queue/pull/728">rails/solid_queue#728</a></li>
<li><a href="https://github.com/wintan1418"><code>@wintan1418</code></a> made their first contribution in <a href="https://redirect.github.com/rails/solid_queue/pull/777">rails/solid_queue#777</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a href="https://github.com/rails/solid_queue/compare/v1.5.1...v1.6.0">https://github.com/rails/solid_queue/compare/v1.5.1...v1.6.0</a></p>
<h2>v1.5.1</h2>
<h2>What's Changed</h2>
<ul>
<li>Fix flaky tests caused by leaked job threads and signal timing by <a href="https://github.com/rosa"><code>@rosa</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/766">rails/solid_queue#766</a></li>
<li>Add an update generator to copy new migrations by <a href="https://github.com/rosa"><code>@rosa</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/765">rails/solid_queue#765</a></li>
<li>Wait for the continuable job to start before interrupting it by <a href="https://github.com/rosa"><code>@rosa</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/767">rails/solid_queue#767</a></li>
<li>Add --only-recurring to run just the recurring scheduler by <a href="https://github.com/rafael-pissardo"><code>@rafael-pissardo</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/757">rails/solid_queue#757</a></li>
<li>Use with_connection in DistinctValues by <a href="https://github.com/trevorturk"><code>@trevorturk</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/769">rails/solid_queue#769</a></li>
<li>Replace forked processes that fail to boot by <a href="https://github.com/sapandiwakar"><code>@sapandiwakar</code></a> in <a href="https://redirect.github.com/rails/solid_queue/pull/760">rails/solid_queue#760</a></li>
</ul>

</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/rails/solid_queue/commit/e2b53849c715b29fa2d97a939097bd1beaea4bc9"><code>e2b5384</code></a> Bump solid_queue to 1.7.0</li>
<li><a href="https://github.com/rails/solid_queue/commit/5352228d24eae58200ee7142f53ad36c942b7de2"><code>5352228</code></a> Reset pooled connections when flipping the batches schema in tests</li>
<li><a href="https://github.com/rails/solid_queue/commit/112bb1cb66c399d16de3b48afcf7c7ace71ae553"><code>112bb1c</code></a> Refine batch support after a full review</li>
<li><a href="https://github.com/rails/solid_queue/commit/1bcac835608712dcb24a988e70e0b7aca5e31221"><code>1bcac83</code></a> Add batch support</li>
<li><a href="https://github.com/rails/solid_queue/commit/fcb5f7acf26b4f91df2ba699d8990f5dbb645580"><code>fcb5f7a</code></a> Name the supervisor's stop checkpoint and simplify its lifecycle</li>
<li><a href="https://github.com/rails/solid_queue/commit/124176afb0dd6637238a86274390dc961a7312f2"><code>124176a</code></a> Honour TERM received during supervisor boot before forking workers</li>
<li><a href="https://github.com/rails/solid_queue/commit/174cb071f4edfadc878eea89b18e4fdf5f2aa733"><code>174cb07</code></a> Protect the shutdown reap from release failures too</li>
<li><a href="https://github.com/rails/solid_queue/commit/0526401f0dcf8cd984f26a564f81eb876d1b7f0b"><code>0526401</code></a> Replace terminated forks even if releasing their claimed jobs fails</li>
<li><a href="https://github.com/rails/solid_queue/commit/6816e52bb5a3f31e01af4796f11fb115fb1cf722"><code>6816e52</code></a> Include the error in fail_many_claimed events and document recovery</li>
<li><a href="https://github.com/rails/solid_queue/commit/fc5fb599930f5bb677d91cf2729a611b651ee6b3"><code>fc5fb59</code></a> Wait longer for the supervisor to fail the killed worker's job</li>
<li>Additional commits viewable in <a href="https://github.com/rails/solid_queue/compare/v1.4.0...v1.7.0">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=solid_queue&package-manager=bundler&previous-version=1.4.0&new-version=1.7.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Milestone

Labels

Assignees

Reviewers

Linked items

Projects

Bump solid_queue from 1.4.0 to 1.7.0

v1.7.0 - batches

What's Changed

New Contributors

v1.6.0 - fiber execution mode (with Async)

What's Changed

New Contributors

v1.5.1

What's Changed