parallelMerge() does not propagate return() back to the merged iterables #46
Comments
|
A few more notes:
|
|
Sounds like something we should fix. I haven't had time to look into it but I'm happy to merge it in. |
|
So I did some research and this is part of the generator spec not the iterator spec. Iterator results only have a |
|
Yeah. The entire topic of AsyncIterators (and especially AsyncGenerators) is extremely complicated. I spent several days so far trying to match all the corner cases in my own implementation of merge(), where return() is properly propagated to all merging iterables (and unfreezes at the proper moment), and I still don't have any luck. The idea is to guarantee that For instance, here is one corner case for that (see inline comments): async function standardThrow(wrap: <T>(inner: T) => T = (inner) => inner) {
const log: any[] = [];
async function* gen() {
try {
for (let i = 0; i < 3; i++) {
await sleep(500);
yield i;
}
} catch (e) {
log.push(["gen caught", e]);
throw e;
}
}
const iterator = wrap(gen())[Symbol.asyncIterator]();
iterator
.next()
.then((v) => {
log.push(["next 1", v]);
iterator
.next()
.then((v) => log.push(["next 2", v]))
.catch(() => {});
})
.catch((e) => log.push(["next 1 e", e]));
const promise = sleep(100)
.then(async () => {
log.push("calling throw()");
return iterator.throw("test");
})
.catch((e) => log.push(["throw e", e]));
log.push("start");
await promise;
log.push("finish");
// Calling iterator.throw() in a random moment of time does not cause next()
// to throw or return done=true. Instead, next() successfully yields the value
// and returns it, and only the following call to next() returns done=true.
// Also, iterator.throw() itself unfreezes only after next() returns done=true
// and not earlier.
expect(log).toEqual([
"start",
"calling throw()",
["gen caught", "test"],
["next 1", { done: false, value: 0 }],
["next 2", { done: true, value: undefined }],
["throw e", "test"],
"finish",
]);
}I have 6 test cases in total like that, and this all seems to be covered in https: 5D77 //tc39.es/proposal-async-iteration/ spec (this spec is unusable in practice BTW):
|
Example code:
In this example I do a "dummy" merging of 1 iterable for simplicity (but we can merge multiple, the effect persists). The output is:
Notice that
finally {}block initerable()function was never executed. But it should: replace the call to parallelMerge() withyield* iterable("A", 900);to see the correct output (with "Exited A"):How it works: both for-await and yield* instructions call the source iterator's
return()method once the loop is over, and they propagate that signal further up the stack. I think parallelMerge() just doesn't do this.The text was updated successfully, but these errors were encountered: