Question: Question # 2 Serverless Data Analytics ( 2 Pts . ) Try to answer the following questions the best you can: 1 . It is

Question #2Serverless Data Analytics (2 Pts.)
Try to answer the following questions the best you can:
1. It is still under scrutiny whether data analytics can be efficiently run atop a serverless architecture. However, several attempts
have been successful for embarrassingly parallel workloads and problems (e.g., PyWren). One of those problems is large-scale
matrix multiplication. Given two square matrices of N x N elements, standard matrix multiplication takes (N3) time. For N
large (e.g., matrices of 100GBs), no laptop or server can hold in memory such an amount of data, so more than a single
machine is needed.
The goal of this task is to provide a solution for such a problem by combining a FaaS offering (e.g., AWS Lambda) and an
object store (e.g., Amazon S3). Initially, both matrices are stored in Amazon S3. The result matrix must be written back to S3.
Provide a high-level description of your solution for N =40,000 double-precision elements. Hence, a matrix of N x N occupies
11.92GB of memory. For simplicity, you can assume that each function has been allocated 1GB of memory. Graphically, the
architecture of the system may be described as follows:

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!