From the course: End-to-End Real-World Data Engineering Project with Databricks

Unlock this course with a free trial

Join today to access over 24,700 courses taught by industry experts.

Create a Databricks notebook to load the Silver layer: Product delta table

Create a Databricks notebook to load the Silver layer: Product delta table

From the course: End-to-End Real-World Data Engineering Project with Databricks

Start my 1-month free trial Buy for my team

Create a Databricks notebook to load the Silver layer: Product delta table

“

- [Instructor] Now, let's load the product data for the silver layer. Create a new notebook. Let's give the name as Silverlayer_product_load. Now, the first step would be is to just track whether the table has been created for product or not. In the interest of the time, I have already written this code. And let me paste that code here. So I'm first using the globalretail_silver as a database because I want to create this table into our global retail silver database itself. I have given the full schema like create table if not exists silver_products. And I give all the column names along with their data types. But I have added one extra column, that is last_updated, to get to know when this specific record was updated. And let me select the cluster and say execute. If this table is already exist, then it won't do anything. If table not exist, this piece of logic is going to create the table. Now our table has been created. Now to identify or to fetch the records from our bronze layer,…

Contents