Skip to content

feat: add utils/async/parallel #1896

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 31 commits into from
Jun 27, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
58e2340
docs: add README
nightknighto Mar 12, 2024
5ee7ef4
feat: add package.json
nightknighto Mar 12, 2024
e8b7b2b
feat: add parallel lib
nightknighto Mar 14, 2024
4d400a8
feat: add tests
nightknighto Mar 14, 2024
fc81b50
feat: add docs
nightknighto Mar 15, 2024
e7ffd4c
feat: add benchmarks
nightknighto Mar 15, 2024
338a8b9
fix: fix a readme example
nightknighto Mar 15, 2024
7ce63de
fix: fix thisArg error
nightknighto Mar 15, 2024
40424d9
fix: fix a test mistake
nightknighto Mar 15, 2024
3a69552
chore: update copyright years
stdlib-bot Mar 17, 2024
cf255a1
docs: add parallel to root readme
nightknighto Mar 19, 2024
963e87b
Revert "docs: add parallel to root readme"
nightknighto Mar 19, 2024
78efedf
Apply suggestions from code review
kgryte Jun 21, 2024
38dbcf1
Move functions to parent scope
kgryte Jun 21, 2024
6ecf555
Apply suggestions from code review
kgryte Jun 21, 2024
1da828c
Apply suggestions from code review
Planeshifter Jun 21, 2024
9401d30
Apply suggestions from code review
kgryte Jun 21, 2024
efebec4
Apply suggestions from code review
kgryte Jun 21, 2024
76629c6
Apply suggestions from code review
kgryte Jun 21, 2024
ec2e90d
Apply suggestions from code review
kgryte Jun 21, 2024
5dec275
Move functions to parent scope
kgryte Jun 21, 2024
0f4bcb9
Apply suggestions from code review
kgryte Jun 21, 2024
61a4cbf
fix: add missing comma in package.json
Planeshifter Jun 22, 2024
0ebdab6
chore: pply suggestions
nightknighto Jun 24, 2024
2b2e718
chore: apply suggestion
nightknighto Jun 24, 2024
e7557f7
bench: reduce code duplication
kgryte Jun 27, 2024
3bfb88b
refactor: allow providing separate `done` callbacks
kgryte Jun 27, 2024
b732d9b
test: update tests and style conventions
kgryte Jun 27, 2024
a433939
Merge branch 'develop' of https://github.com/stdlib-js/stdlib into pr…
kgryte Jun 27, 2024
51b8e48
bench: fix invocation
kgryte Jun 27, 2024
d027342
docs: fix example
kgryte Jun 27, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
266 changes: 266 additions & 0 deletions lib/node_modules/@stdlib/utils/async/parallel/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,266 @@
<!--

@license Apache-2.0

Copyright (c) 2024 The Stdlib Authors.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

-->

# parallel

> Execute functions in parallel and pass the results of all functions to a provided callback.

<!-- Section to include introductory text. Make sure to keep an empty line after the intro `section` element and another before the `/section` close. -->

<section class="intro">

</section>

<!-- /.intro -->

<!-- Package usage documentation. -->

<section class="usage">

## Usage

```javascript
var parallel = require( '@stdlib/utils/async/parallel' );
```

#### parallel( fcns, \[options,] done )

Executes a set of functions in parallel and passes the results of all functions to a provided callback.

```javascript
function a( clbk ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
clbk( null, 2 );
}
}

function b( clbk ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
clbk( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( out );
// => [ 2, 4 ]
}

var fcns = [ a, b ];

parallel( fcns, done );
```

The function accepts the following `options`:

- **limit**: maximum number of functions to execute concurrently. Default: `infinity`.
- **thisArg**: execution context for each function.

To limit the maximum number of functions executing in parallel, set the `limit` option.

```javascript
function a( clbk ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
clbk( null, 2 );
}
}

function b( clbk ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
clbk( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( out );
// => [ 2, 4 ]
}

var fcns = [ a, b ];

var opts = {
'limit': 1
};

parallel( fcns, opts, done );
```

To set the `this` context for **all** `functions` in the provided function array, set the `thisArg` option.

```javascript
function a( clbk ) {
this.idx += 1;
clbk( null, 2 );
}

function b( clbk ) {
this.idx += 1;
clbk( null, 4 );
}

var fcns = [ a, b ];
var ctx = {
'idx': 0
};
var opts = {
'thisArg': ctx
};

parallel( fcns, opts, done );

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( ctx.idx );
// => 2
}
```

#### parallel.factory( fcns, \[options] )

Returns a reusable function which executes a set of functions in parallel.

```javascript
function a( clbk ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
clbk( null, 2 );
}
}

function b( clbk ) {
setTimeout( onTimeout, 0 );
function onTimeout() {
clbk( null, 4 );
}
}

function done( error, out ) {
if ( error ) {
throw error;
}
console.log( out );
// => [ 2, 4 ]
}

var fcns = [ a, b ];

var run = parallel.factory( fcns );

run( done );
run( done );
run( done );
```

</section>

<!-- /.usage -->

<!-- Package usage notes. Make sure to keep an empty line after the `section` element and another before the `/section` close. -->

<section class="notes">

## Notes

- The order of the results provided to the `done` callback corresponds to the order of the provided functions.
- When executed, each provided function is invoked with a single callback argument. The callback should be invoked upon function completion. The first argument is reserved as an `error` argument (which can be `null`). The second argument is reserved for any results which should be passed to the `done` callback upon completion of all provided functions.
- If any function fails to invoke the callback argument, the `done` callback will never be invoked.
- This implementation is intended to start asynchronous tasks so that execution of each task runs concurrently. If provided a function which does not perform asynchronous tasks, the function will execute synchronously. Hence, this implementation does **not** guarantee that execution is asynchronous. To do so, wrap the `done` callback in a `function` which either executes at the end of the current stack (e.g., `nextTick`) or during a subsequent turn of the event loop (e.g., `setImmediate`, `setTimeout`).
- The function executes provided functions in the same thread. Accordingly, the function does **not** spawn new threads.

</section>

<!-- /.notes -->

<!-- Package usage examples. -->

<section class="examples">

## Examples

<!-- eslint no-undef: "error" -->

```javascript
var parallel = require( '@stdlib/utils/async/parallel' );

function foo( clbk ) {
setTimeout( onTimeout, 300 );
function onTimeout() {
clbk( null, 'one' );
}
}

function bar( clbk ) {
setTimeout( onTimeout, 100 );
function onTimeout() {
clbk( null, 'two' );
}
}

function done( error, results ) {
if ( error ) {
throw error;
}
console.log( results );
// => [ 'one', 'two' ]
}

var fcns = [ foo, bar ];

parallel( fcns, done );
```

</section>

<!-- /.examples -->

<!-- Section to include cited references. If references are included, add a horizontal rule *before* the section. Make sure to keep an empty line after the `section` element and another before the `/section` close. -->

<section class="references">

</section>

<!-- /.references -->

<!-- Section for related `stdlib` packages. Do not manually edit this section, as it is automatically populated. -->

<section class="related">

</section>

<!-- /.related -->

<!-- Section for all links. Make sure to keep an empty line after the `section` element and another before the `/section` close. -->

<section class="links">

</section>

<!-- /.links -->
Original file line number Diff line number Diff line change
@@ -0,0 +1,83 @@
/**
* @license Apache-2.0
*
* Copyright (c) 2024 The Stdlib Authors.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/

'use strict';

// MODULES //

var bench = require( '@stdlib/bench' );
var pkg = require( './../package.json' ).name;
var factory = require( './../lib/factory.js' );


// FUNCTIONS //

/**
* Returns a function which runs asynchronously.
*
* @private
* @param {*} value - return value
* @returns {Function} function which runs asynchronously
*/
function fcn( value ) {
return f;

function f( clbk ) {
setTimeout( onTimeout, 0 );

function onTimeout() {
clbk( null, value );
}
}
}


// MAIN //

bench( pkg+':factory', function benchmark( b ) {
var parallel;
var arr;
var i;

arr = [
fcn( 'one' ),
fcn( 'two' ),
fcn( 'three' ),
fcn( 'four' )
];

parallel = factory( arr );

i = 0;
b.tic();

return next();

function next( error ) {
i += 1;
if ( error ) {
b.fail( 'should not return an error' );
}
if ( i <= b.iterations ) {
return parallel( next );
}
b.toc();
b.pass( 'benchmark finished' );
b.end();
}
});
Loading
Loading