News Score: Score the News, Sort the News, Rewrite the Headlines

"Streaming vs. Batch" Is a Wrong Dichotomy, and I Think It's Confusing

Often times, "Stream vs. Batch" is discussed as if it’s one or the other, but to me this does not make that much sense really. Many streaming systems will apply batching too, i.e. processing or transferring multiple records (a "batch") at once, thus offsetting connection overhead, amortizing the cost of fanning out work to multiple threads, opening the door for highly efficient SIMD processing, etc., all to ensure high performance. The prevailing trend towards storage/compute separation in data ...

Read more at morling.dev

© News Score  score the news, sort the news, rewrite the headlines