Shawn Ng

Shawn Ng

Data Engineer

Hi, I'm Shawn Ng from Singapore πŸ‡ΈπŸ‡¬. With a background spanning all data roles – from analyst to scientist to engineer – my expertise lies in backend software engineering. Currently, I'm working as a Data Engineer in the banking sector.

My passion extends beyond my full-time role, as I dedicate my free time to building my tech company, MaverickX.

This website is where I document my data and software projects, and I sincerely hope you find something useful within.

My main image

What I do

Here is an overview of my technical skill sets

Data Engineering / Science

  • Big data (Spark, Hadoop)
  • Data pipeline (Airflow)
  • Database (SQL, NoSQL)
  • API
  • Data mining
  • Data visualization
  • Machine learning
  • Natural language processing

Cloud Engineering

  • Linux (Bash)
  • Amazon Web Service
  • Google Cloud Platform

Backend Engineering

  • Django/Flask/FastAPI
  • Express.js

Frontend Engineering

  • Bootstrap
  • JavaScript


Latest Blog Posts

What I am looking for

What I am looking for

Read more →

Migrate to Unraid from Synology

How I migrate to Unraid from Synology

Read more →

Apache Spark VS Pandas VS Koalas

Apache Spark is an open-source unified analytics engine for large-scale data processing. Pandas is a fast, powerful, flexible and easy to use open source data analysis and manipulation tool, built on top of the Python programming language. Koalas is Pandas API on Apache Spark.

Read more →