Question: a ) Consider a stream processing system design, where the maximum throughput among the producers in the system is 5 M B s e c

a) Consider a stream processing system design, where the maximum throughput among the
producers in the system is 5MBsec. Given that it can support 14 consumers and the
expected throughput for the system is 42GB/minute. Estimate the number of producers
that can be associated with the system.
[3+4+3=10 Marks ]
b) Consider the aspects of long-term storage and message writing mechanism. If the average
message size is 64kB, discuss suitable message writing strategies for each of the
following scenarios where the data ingestion rate (Ri) and data processing rate (Rp) are
given below:
(i)Ri=240MBhr,Rp=20MBmin
(ii)Ri=120MBmin,Rp=24MBhr
c) In a data processing system, the data ingestion rate is 16MBsec; The data processing rate
is: 240MBmin. The system is refreshed hourly with at-most once delivery semantics. If
the average message size is 20kB, estimate the storage space needed for Data flow layer
and discuss whether horizontal scaling is needed for the layer.
 a) Consider a stream processing system design, where the maximum throughput

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!