[QUESTION] Is aiokafka consumer thread safe? #959
Replies: 1 comment 2 replies
-
|
In python, all the "aio/async" libraries run over an event loop. An event loop is always run by a single thread, managing multiple concurrent queries. So the first sentence of the documentation
should be enough to indicate about the threading model |
Beta Was this translation helpful? Give feedback.
-
|
Not really. A piece of code designed for asyncio does not by design either support or not being run across multiple threads. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks. I checked some docs, maybe we can say that:
https://docs.python.org/3/library/asyncio-dev.html#concurrency-and-multithreading https://docs.python.org/3/library/asyncio-sync.html However, back to original question: is aiokafka consumer thread-safe? I have no idea if aiokafka uses asyncio (or some other things) unsafely. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
confluent-kafka-python says "Producer, Consumer and AdminClient are all thread safe."
kafka-python says "while it is possible to use the KafkaConsumer in a thread-local manner, multiprocessing is recommended."
However, I cannot find any description about thread safety in the document of aiokafka, so I worry about if AIOKafkaConsumer is thread safe? Whether it is or not, maybe it should be mentioned in the document.
Beta Was this translation helpful? Give feedback.
All reactions