Skip to content

feat: add utils/async/parallel #1896

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 31 commits into from
Jun 27, 2024
Merged
Show file tree
Hide file tree
Changes from 12 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
58e2340
docs: add README
nightknighto Mar 12, 2024
5ee7ef4
feat: add package.json
nightknighto Mar 12, 2024
e8b7b2b
feat: add parallel lib
nightknighto Mar 14, 2024
4d400a8
feat: add tests
nightknighto Mar 14, 2024
fc81b50
feat: add docs
nightknighto Mar 15, 2024
e7ffd4c
feat: add benchmarks
nightknighto Mar 15, 2024
338a8b9
fix: fix a readme example
nightknighto Mar 15, 2024
7ce63de
fix: fix thisArg error
nightknighto Mar 15, 2024
40424d9
fix: fix a test mistake
nightknighto Mar 15, 2024
3a69552
chore: update copyright years
stdlib-bot Mar 17, 2024
cf255a1
docs: add parallel to root readme
nightknighto Mar 19, 2024
963e87b
Revert "docs: add parallel to root readme"
nightknighto Mar 19, 2024
78efedf
Apply suggestions from code review
kgryte Jun 21, 2024
38dbcf1
Move functions to parent scope
kgryte Jun 21, 2024
6ecf555
Apply suggestions from code review
kgryte Jun 21, 2024
1da828c
Apply suggestions from code review
Planeshifter Jun 21, 2024
9401d30
Apply suggestions from code review
kgryte Jun 21, 2024
efebec4
Apply suggestions from code review
kgryte Jun 21, 2024
76629c6
Apply suggestions from code review
kgryte Jun 21, 2024
ec2e90d
Apply suggestions from code review
kgryte Jun 21, 2024
5dec275
Move functions to parent scope
kgryte Jun 21, 2024
0f4bcb9
Apply suggestions from code review
kgryte Jun 21, 2024
61a4cbf
fix: add missing comma in package.json
Planeshifter Jun 22, 2024
0ebdab6
chore: pply suggestions
nightknighto Jun 24, 2024
2b2e718
chore: apply suggestion
nightknighto Jun 24, 2024
e7557f7
bench: reduce code duplication
kgryte Jun 27, 2024
3bfb88b
refactor: allow providing separate `done` callbacks
kgryte Jun 27, 2024
b732d9b
test: update tests and style conventions
kgryte Jun 27, 2024
a433939
Merge branch 'develop' of https://github.com/stdlib-js/stdlib into pr…
kgryte Jun 27, 2024
51b8e48
bench: fix invocation
kgryte Jun 27, 2024
d027342
docs: fix example
kgryte Jun 27, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
297 changes: 297 additions & 0 deletions lib/node_modules/@stdlib/utils/async/parallel/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,297 @@
<!--

@license Apache-2.0

Copyright (c) 2024 The Stdlib Authors.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

-->

# Parallel

> Execute functions in parallel, passing the results of all functions to a final callback.

<!-- Section to include introductory text. Make sure to keep an empty line after the intro `section` element and another before the `/section` close. -->

<section class="intro">

</section>

<!-- /.intro -->

<!-- Package usage documentation. -->

<section class="usage">

## Usage

```javascript
var parallel = require( '@stdlib/utils/async/parallel' );
```

#### parallel( functionArray, \[options,] done )

Executes functions inside `functionArray` in parallel, passing the results of all functions to a final callback.

The first argument to each function is a `resolve` callback. The `resolve` callback should be invoked upon function completion. The first argument is reserved as an `error` argument (which can be `null` or void). If there is a result, it should be provided as the second argument to the `resolve` callback. Failure to invoke the `resolve` callback will prevent the `done` callback from being invoked.

```javascript
function a( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 2 );
}
}

function b( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( out );
// => [ 2, 4 ]
}

var fcns = [ a, b ];

parallel( fcns, done );
```

The `resolve` callback accepts two arguments: `error` and `value`. The second argument to the `resolve` callback is the output of the function. If a function function calls the `resolve` callback with a truthy error argument, the function stops executing any queued functions in case of a limit being present and calls the `done` callback for error processing.

```javascript
function a( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( new Error( 'beep' ) );
}
}

function b( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
console.error( error.message );
}
// => 'beep'
}

var fcns = [ a, b ];

parallel( fcns, done );
```

The function accepts the following `options`:

- **limit**: maximum number of functions to execute concurrently. Default: `infinity`.
- **thisArg**: execution context for each function.

To limit the maximum number of functions executing in parallel, set the `limit` option.

```javascript
function a( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 2 );
}
}

function b( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( out );
// => [ 2, 4 ]
}

var fcns = [ a, b ];

var opts = {
'limit': 1
};

parallel( fcns, opts, done );
```

To set the `this` context for **all** `functions` in the provided function array, set the `thisArg` option.

```javascript
function a( resolve ) {
this.idx += 1;
resolve( null, 2 );
}

function b( resolve ) {
this.idx += 1;
resolve( null, 4 );
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( this.idx );
// => 2
}

var fcns = [ a, b ];
var ctx = {
'idx': 0
};
var opts = {
'thisArg': ctx
};

parallel( fcns, opts, done );
```

#### parallel.factory( functionArray, \[options,] done )

Returns a reusable parallel `function`.

```javascript
function a( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 2 );
}
}

function b( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( out );
// => [ 2, 4 ]
}

var fcns = [ a, b ];

var run = parallel.factory( fcns, done );

run();
run();
run();
```

</section>

<!-- /.usage -->

<!-- Package usage notes. Make sure to keep an empty line after the `section` element and another before the `/section` close. -->

<section class="notes">

## Notes

- The `functionArray` argument should be an array of functions to be executed in parallel.
- The `done` callback is invoked upon completion of all functions or upon encountering an error.
- The order of the results provided to the `done` callback corresponds to the order of the provided functions.
- The first argument applied to each function is a callback. The callback should be invoked upon function completion. The first argument is reserved as an `error` argument (which can be `null` or void). If there is a result, it should be provided as the second argument to the callback. Failure to invoke the callback will prevent the `done` callback from being invoked.
- This implementation does **not** guarantee that execution is asynchronous. If provided functions are synchronous, they will be executed synchronously.

</section>

<!-- /.notes -->

<!-- Package usage examples. -->

<section class="examples">

## Examples

<!-- eslint no-undef: "error" -->

```javascript
var parallel = require( '@stdlib/utils/async/parallel' );

function foo( resolve ) {
setTimeout( onTimeout, 300 );
function onTimeout() {
resolve( null, 'one' );
}
}

function bar( resolve ) {
setTimeout( onTimeout, 100 );
function onTimeout() {
resolve( null, 'two' );
}
}

function done( error, results ) {
if ( error ) {
throw error;
}
console.log( results );
// => [ 'one', 'two' ]
}

var fcns = [ foo, bar ];

parallel( fcns, done );
```

</section>

<!-- /.examples -->

<!-- Section to include cited references. If references are included, add a horizontal rule *before* the section. Make sure to keep an empty line after the `section` element and another before the `/section` close. -->

<section class="references">

</section>

<!-- /.references -->

<!-- Section for related `stdlib` packages. Do not manually edit this section, as it is automatically populated. -->

<section class="related">

</section>

<!-- /.related -->

<!-- Section for all links. Make sure to keep an empty line after the `section` element and another before the `/section` close. -->

<section class="links">

</section>

<!-- /.links -->
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
/**
* @license Apache-2.0
*
* Copyright (c) 2024 The Stdlib Authors.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/

'use strict';

// MODULES //

var bench = require( '@stdlib/bench' );
var pkg = require( './../package.json' ).name;
var factory = require( './../lib/factory.js' );


// MAIN //

bench( pkg+':factory', function benchmark( b ) {
var parallel;
var arr;
var i;

function one( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 'one' );
}
}

function two( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 'two' );
}
}

function three( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 'three' );
}
}

function four( resolve ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
resolve( null, 'four' );
}
}

arr = [ one, two, three, four ];

parallel = factory( arr, next );

i = 0;
b.tic();

return next();

function next( error ) {
i += 1;
if ( error ) {
b.fail( 'should not return an error' );
}
if ( i <= b.iterations ) {
return parallel();
}
b.toc();
b.pass( 'benchmark finished' );
b.end();
}
});
Loading
Loading