Question: As a cloud architect and engineer, design a secure cloud computing architecture that will support a big data lake platform that collects data through APIs
As a cloud architect and engineer, design a secure cloud computing architecture that will support a big data lake platform that collects data through APIs (millions of events per minute), scripted database queries (thousands of records per second), and file transfers (hundreds of gigabyte files per minute); processes the collected data in collective zones; and makes the data available to business intelligence users, data scientists, and site reliability engineers within a minute after it reaches the platform. The cloud environment cannot be maintained by vendors so the purchasing of proprietary services like AWS and Google Cloud platform is not an option. You need to consider data access based on the previously mentioned roles, the tools that the users will use to access the data, the platform's ability to send data to other systems, and cloud systems. What will your cloud design look like? What tools will you use? How will you provision users to access data on your platform? How will you address the security issues of the cloud to ensure that it is not vulnerable to attacks by hackers.
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
