Shawn Ng

Data Engineer

Hi, I'm Shawn Ng from Singapore 🇸🇬. With a background spanning all data roles - from analyst to scientist to engineer - my expertise lies in data engineering and AI infrastructure, with 9+ years building systems across financial services startups and Tier-1 institutions.

I also build and ship my own software products: RoboTrackers.com (digital footprint search and tracking) and ExtrmSport.com (extreme sports community), under my company MaverickX.

This website is where I document my data and software projects, and I sincerely hope you find something useful within.

View Projects View Resume

Featured Projects

Obama VS Trump Twitter Analysis

In this project, I scraped and analyzed President Obama and President Trump tweets using natural language processing (NLP).

Published: 2018-04-01

View Case Study

Y Combinator Startups Analysis

In this project, I scraped and analysed 1317 Y Combinator Startups and share my insights.

Published: 2017-10-24

View Case Study

View Projects

Latest Blog Posts

What I am looking for

Published: 2021-12-10

Migrate to Unraid from Synology

How I migrate to Unraid from Synology

Published: 2021-12-03

Apache Spark VS Pandas VS Koalas

Apache Spark is an open-source unified analytics engine for large-scale data processing. Pandas is a fast, powerful, flexible and easy to use open source data analysis and manipulation tool, built on top of the Python programming language. Koalas is Pandas API on Apache Spark.

Published: 2021-06-13

View Blogs