A data engineer needs to provide a team of data scientists with the appropriate dataset to run machine learning training jobs. The data will be stored in Amazon S3. The data engineer is obtaining the data from an Amazon Redshift database and is using join queries to extract a single tabular dataset. A portion of the schema is as follows:
TransactionTimestamp (Timestamp)
CardName (Varchar)
CardNo (Varchar)
The data engineer must provide the data so that any row with a CardNo value of NULL is removed. Also, the TransactionTimestamp column must be separated into a TransactionDate column and a TransactionTime column. Finally, the CardName column must be renamed to NameOnCard.
The data will be extracted on a monthly basis and will be loaded into an S3 bucket. The solution must minimize the effort that is needed to set up infrastructure for the ingestion and transformation. The solution also must be automated and must minimize the load on the Amazon Redshift cluster.
Which solution meets these requirements?
ystotest
Highly Voted 1 year, 7 months ago2eb8df0
Most Recent 3 months, 3 weeks agoakgarg00
7 months, 1 week agoteka112233
9 months, 3 weeks agoloict
9 months, 3 weeks agoMickey321
10 months, 1 week agoMickey321
10 months, 1 week agokaike_reis
10 months, 3 weeks agoJerry84
1 year, 5 months ago