From the course: Data Engineering on AWS: Data Cataloging, Processing, Analytics, and Visualization

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Solution: AWS Glue

Solution: AWS Glue - Amazon Web Services (AWS) Tutorial

From the course: Data Engineering on AWS: Data Cataloging, Processing, Analytics, and Visualization

Start my 1-month free trial Buy for my team

Solution: AWS Glue

“

(upbeat music) - [Instructor] So let's have a look at our Glue challenge solution. So here, I'm on the Glue console. Let's go to jobs and create a new job for our solution. I will use this visual with a blank canvas. And for source, I will use Glue data catalog where I'm choosing my existing database inputdb and table as department_csv. For actions, this time, I need to use SQL Query. So as you see here, by default, it gives the query, select star from myDataSource. But in our case, we don't want to return all the attributes. We just want to return few specific attributes from this data source. So if we check the output schema, we can see this table contains these many attributes. Let's say we just want to return department_id and department_name, so we need to tweak this SQL Query a bit. Instead of saying star, we will say select department_id, comma, department name from this, myDataSource. And what do we…

Contents