Tiger Investments (TI) is a private equity trust manager specializing in border market investments.
The Group is considered a pioneer investor in Southeast Asia's Greater Sub-region and the Caribbean.
Tiger Investments creates private equity funds targeting pre-emerging, post- conflict or post-disaster economies that are undergoing transition and are poised for rapid growth.
The funds invest commercially in basic businesses, targeting attractive economic and social returns.
Tiger Investments invests through a diversity of financial instruments including equity, and debt TI launched EMR 3.2.1 using EMRFS storage to support their real time data analytics.
IT team observed that once objects are added to EMRFS in one operation and then immediately list objects in a subsequent operation, the list and the set of objects processed is incomplete most of the times.
This is a continuous problem that TI team is facing mostly when running multi-step sequential steps in extract-transform-load(ETL) data processing pipelines.
EMRFS Consistency View is enabled.
ETL team is working with IT operations team to get notifications on Consistency Views in terms of Eventual consistency. What needs to be done to monitor and manage notifications?
Click on the arrows to vote for the correct answer
A. B. C. D.Answer : B.
Option A, C and D are incorrect.
Option B is correct.
Enable CloudWatch metrics and Amazon SQS messages in EMRFS for Amazon S3 eventual consistency issues.
https://docs.aws.amazon.com/emr/latest/ManagementGuide/emrfs-configure-sqs-cw.htmlThe problem that the TI IT team is facing is related to eventual consistency issues in EMRFS storage when performing multi-step sequential operations. The EMRFS Consistency View is enabled, which means that the objects in the S3 bucket may not immediately reflect changes made to the objects due to eventual consistency.
To monitor and manage notifications related to eventual consistency issues, the ETL team needs to work with the IT operations team to set up a system that alerts them when inconsistencies occur.
CloudTrail is a service that provides audit logs of actions taken within an AWS account. CloudWatch is a monitoring service that provides metrics and alarms based on resource utilization and application performance. Amazon SNS (Simple Notification Service) is a service that provides push notifications via email, SMS, and other messaging services. Amazon SQS (Simple Queue Service) is a message queuing service that enables decoupling and scaling of microservices and distributed systems.
Option A, Enable CloudTrail metrics and Amazon SNS messages in EMRFS for Amazon S3 eventual consistency issues, suggests using CloudTrail to monitor S3 bucket activities and SNS to send notifications. This option is not suitable because CloudTrail does not provide real-time monitoring of S3 eventual consistency issues, and SNS may not be the best choice for handling messages related to eventual consistency issues.
Option B, Enable CloudWatch metrics and Amazon SQS messages in EMRFS for Amazon S3 eventual consistency issues, suggests using CloudWatch to monitor metrics related to S3 eventual consistency issues and SQS to send messages. This option is not optimal because SQS does not guarantee immediate delivery of messages, and the messages related to eventual consistency issues require real-time handling.
Option C, Enable CloudWatch metrics and Amazon SNS messages in EMRFS for Amazon S3 eventual consistency issues, suggests using CloudWatch to monitor metrics related to S3 eventual consistency issues and SNS to send notifications. This option is the best choice because CloudWatch provides real-time monitoring of metrics related to eventual consistency issues, and SNS can immediately send notifications to subscribers about the issues.
Option D, Enable CloudTrail metrics and Amazon SQS messages in EMRFS for Amazon S3 eventual consistency issues, suggests using CloudTrail to monitor S3 bucket activities and SQS to send messages. This option is not suitable because CloudTrail does not provide real-time monitoring of S3 eventual consistency issues, and SQS may not be the best choice for handling messages related to eventual consistency issues.
Therefore, the correct answer is C, Enable CloudWatch metrics and Amazon SNS messages in EMRFS for Amazon S3 eventual consistency issues.