Comments on: Worker pool – a design pattern for parallel task execution in LabVIEW

By: Tomi Maila

Tomi Maila — Wed, 07 Jul 2010 22:34:08 +0000

Ahoenselaar, thanks for the insight. In general I would not like to run more than 10000 concurrently executing tasks on any single computer system, irregardless if there is a hardware limitation or not. That thing said, it would be easy to work around the recursion limitation. If you execute m > 1 parallel commands on each recursion level instead of one, you will have order of m^n concurrent tasks at recursion level n, when n >> 0. So practically you reach more concurrent tasks already at recursion level of order 100 than any present computer can handle.

By: ahoenselaar

ahoenselaar — Thu, 01 Jul 2010 06:18:55 +0000

It seems like the final recursion depth is identical to the number of commands to be executed. The recursion depth in LabView is limited to 15,000 / 35,000 (32 bit / 64 bit versions), which will also limit the maximum number of jobs that can be processed.
Obviously, there are many trivial workarounds, but the generality of this design pattern strikes me as limited.

Still an interesting approach!

By: Tomi Maila

Tomi Maila — Sat, 19 Jun 2010 00:59:12 +0000

The downloads should now work, sorry for the delay.

By: eiskalterengel

eiskalterengel — Mon, 07 Jun 2010 07:38:14 +0000

Hi all,

I already signed-up to ExpressionFlow to download this project, but I didn’t find any possibilty to download this project.

Could anybody help me out?

Thanks very much
Bets regards

By: Todd

Todd — Sat, 19 Dec 2009 21:19:15 +0000

This is great stuff! Do you mind posting it on the NI Community (ni.com/community)? I want to link to it from the news feed on the LabVIEW splash screen. Send me an email when it’s up and I’ll push it live.

By: Tomi Maila

Tomi Maila — Tue, 10 Nov 2009 18:24:15 +0000

I am pleased to make you happy I added an additional example implementation to the example code that reuses non-busy workers.

By: – Unlimited parallelism & concurrency with recursive dataflowExpressionFlow

Tue, 10 Nov 2009 16:09:18 +0000

[...] Worker pool – a design pattern for parallel task execution in LabVIEW [...]

By: 2mzu

2mzu — Mon, 09 Nov 2009 16:50:04 +0000

Very elegant, unlike the (obvious) VI server solution (wrapping up Run VI invoke node in OO) it runs with runtime, even with mobile module with 0 modification. Thanks.

By: Jeffrey Habets

Jeffrey Habets — Fri, 06 Nov 2009 16:33:38 +0000

Hi Tomi,

This is a very interesting implementation of an execution engine for the command design pattern. Thanks!

Jeffrey