Open in app

Sign In

Write

Sign In

Anuj Syal
Anuj Syal

163 Followers

Home

About

Published in DataDrivenInvestor

·Jan 23

Create Your First ETL Pipeline with Python

Data Engineering Fundamentals with Python — When it comes to pursuing a career in the field of Data and specifically Data Engineering, Python comes off as a powerful tool. As you will be forging ahead in your profession, this programming language will be convenient in many ways. Without further ado, let’s dive into the fundamentals of…

Python

6 min read

Create Your First ETL Pipeline with Python
Create Your First ETL Pipeline with Python
Python

6 min read


Published in DataDrivenInvestor

·Jan 13

A Step-by-Step Roadmap To Data Engineering

Navigating the Data Engineering Landscape: A Comprehensive Guide — The specialized field of data engineering is ever-expanding and its elements of it are scattered all around. But how do we come to grips with not being confused & consumed in the process of learning? Initially, you must follow a roughly drawn map and leave the rest to the skills…

Data Engineering

6 min read

A Step-by-Step Roadmap To Data Engineering
A Step-by-Step Roadmap To Data Engineering
Data Engineering

6 min read


Published in DataDrivenInvestor

·Jan 3

12 Must-Have Skills to become a Data Engineer

The Essential Skills for a Successful Data Engineering Career — Are you passionate about using data to create innovative products and solutions? If so, a career as a data engineer may be the perfect fit for you. But what does it take to be successful in this field? …

Data Engineering

8 min read

12 Must-Have Skills to become a Data Engineer
12 Must-Have Skills to become a Data Engineer
Data Engineering

8 min read


Dec 24, 2022

Data Engineering Explained

A simple introduction to Data Engineering — When we scroll through these sites in hopes to find something we need to buy (say, a shirt), we add it to the cart, or we just let it be saved for later. …

Data

6 min read

Data Engineering Explained
Data Engineering Explained
Data

6 min read


Published in Lynx Data Engineering

·Aug 24, 2022

Introduction to Terraform

Infrastructure as Code using Terraform — Terraform is one of the most popular DevOps tools for IaC from HashiCorp. In a nutshell, it consists of managing a set of resources (computing, network, storage, etc.) using code. Terraform allows you to automate infrastructure on any of the public cloud providers, and in this tutorial we will focus…

Infrastructure As Code

4 min read

Introduction to Terraform
Introduction to Terraform
Infrastructure As Code

4 min read


Published in Lynx Data Engineering

·Jul 7, 2022

Introduction to Infrastructure as code

Laid out simply Infrastructure as Code (IaC) allows you to render infrastructure using simple configuration files. This blog post will provide a thorough introduction to Infrastructure as Code, and why it is an important tool to data engineers. Issues of the past In the past, when you wanted to deploy an application, you would…

Iac

4 min read

Introduction to Infrastructure as code
Introduction to Infrastructure as code
Iac

4 min read


Published in Lynx Data Engineering

·Jun 8, 2022

Automate Docker Deployments with Ansible

Deploying Airflow Container with Ansible — Docker solves big problems by providing continuous development and testing environments with rapid deployment cycles. It helps you package your application code with dependencies as an image to provide consistent conditions that never break. I have covered how a data engineer can leverage dockerizing custom airflow orchestrations with ease in…

Docker

5 min read

Automate Docker Deployments with Ansible
Automate Docker Deployments with Ansible
Docker

5 min read


Published in Lynx Data Engineering

·Apr 14, 2022

Deploying Airflow with Docker

Containerizing Airflow using Docker — As far as data science models are concerned, it is safe to say that they are meant to operate periodically. Airflow is a platform where one can author, monitor, and schedule processes programmatically. Airflow is instrumental in the parallel execution of jobs in addition to scheduling and monitoring. This makes…

Data Engineering

6 min read

Deploying Airflow with Docker
Deploying Airflow with Docker
Data Engineering

6 min read


Mar 24, 2022

Warehousing with Google’s Big Query

An introduction to Big Query — Data, in the modern world, is decentralized and is being generated and collected at a record pace. To ensure that this data is collected and processed in a manner that enables businesses and organizations to achieve their business goals, specialized and optimized tools are required. …

Data Analysis

7 min read

Warehousing with Google’s Big Query
Warehousing with Google’s Big Query
Data Analysis

7 min read


Published in Towards Data Science

·Jan 17, 2022

Data Lake VS Data Warehouse

Understanding the two different approaches in data storage architecture — Data Lakes and Data Warehouses are used widely to store large amounts of data. However, they are not interchangeable terms. You will be surprised to know that both of these approaches are complementary to one another. Let’s know about these two terms deeply in the segments mentioned below. Introduction to Data Lake

Big Data

5 min read

Data Lake VS Data Warehouse
Data Lake VS Data Warehouse
Big Data

5 min read

Anuj Syal

Anuj Syal

163 Followers

Data & Engineering

Following
  • Felipe Hoffa

    Felipe Hoffa

  • Qwiklabs

    Qwiklabs

  • Roman Leventov

    Roman Leventov

  • Lak Lakshmanan

    Lak Lakshmanan

  • Chenming Yong

    Chenming Yong

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech