Using ProcessPoolExecutor instead of ContextVarExecutor/ThreadPoolExecutor

[varshith15]

Your question

hi @doctorpangloss, I just needed some clarity regarding using a ProcessPoolExecutor instead of ContextVarExecutor here

ComfyUI/comfy/client/embedded_comfy_client.py

Line 159 in 0cfde0a

self._executor = executor or ContextVarExecutor(max_workers=max_workers)

for more context, im using EmbeddedComfyClient to run a couple of prompts in parallel and the workflows are CPU intensive and so using threads is restricting the perf.

I see that there is an internal implementation on ProcessPoolExecutor here, but it doesn't work when i swap it out

ComfyUI/comfy/distributed/process_pool_executor.py

Line 18 in 0cfde0a

class ProcessPoolExecutor(ProcessPool, Executor):

Also tried using the ProcessPoolExecutor of concurrent.futures instead but the same result.

I think this could be a useful feature to add, i'd be happy to contribute if you provide me some clarity.

Thanks!

Logs

Other

No response