Jun 1

A Practical Guide to Quasi-Experimental Methods (PSM and DID)

A quasi-experiment is an empirical interventional study used to estimate the causal impact of an intervention on target population without random assignment. — Wikipedia In this tutorial, we use simple datasets to illustrate two quasi-experimental methods: Propensity Score Matching (PSM) and Difference-in-differences (DID). We focus on the practical side of applying the methods and provide code in both Python and R via Kaggle (see links below).

Data Science

1 min read

A Practical Guide to Quasi-Experimental Methods (PSM and DID)

Data Science

1 min read

A Practical Guide to Quasi-Experimental Methods (PSM and DID)

A quasi-experiment is an empirical interventional study used to estimate the causal impact of an intervention on target population without random assignment. — Wikipedia

In this tutorial, we use simple datasets to illustrate two quasi-experimental methods: Propensity Score Matching (PSM) and Difference-in-differences (DID). We focus on the practical side of applying the methods and provide code in both Python and R via Kaggle (see links below).

This is joint work with my friend Dr. Gang Wang.

Read the full tutorial at https://harrywang.me/psm-did

Originally published at https://harrywang.me on June 1, 2022.

Feb 24

Get Test Ethers using Selenium

I need some test ethers for Rinkeby and found out that the faucet is not working (I also don’t like that you have to tweet to get the ethers): Then, I found https://www.rinkebyfaucet.com/, which gives 0.1 testing ether for each address per day:

Selenium

1 min read

Selenium

1 min read

Get Test Ethers using Selenium

I need some test ethers for Rinkeby and found out that the faucet is not working (I also don’t like that you have to tweet to get the ethers):

Then, I found https://www.rinkebyfaucet.com/, which gives 0.1 testing ether for each address per day:

Jan 12

Developing Tailpages: A Jekyll Template based on Tailwind CSS

Tailpages Developer Tutorial Tailpages (Tailwind + Github Pages) is a Jekyll website template based on TailwindCSS, which can be hosted by Github for free. You can visit the demo site at https://harrywang.me/tailpages/. Key features are: Minimalist design inspired by the indigo template Elegant typography via TailwindCSS Typography plugin and Inter…

Tutorial

4 min read

Developing Tailpages: A Jekyll Template based on Tailwind CSS

Tutorial

4 min read

Jan 11

Introducing Tailpages (Tailwind + Github Pages)

Setup free-hosted beautiful website without coding My team started to use Tailwind CSS a few months ago and I want to learn a little bit more about it so that I don’t feel like a complete idiot in some technical discussions :). …

Tutorial

6 min read

Introducing Tailpages (Tailwind + Github Pages)

Tutorial

6 min read

Jul 23, 2020

The Triangle of Knowledge

Human-Machine Knowledge Transfer — OpenAI debuted its largest language model GPT3 with 175 billion parameters back in May and started to open the API to selected people last week — you can check out the MIT Technology Review article and a blog post by Arram Sabeti to see many interesting generated texts (lyrics, stories…

Artificial Intelligence

4 min read

Artificial Intelligence

4 min read

Apr 13, 2020

A Minimalist End-to-End Scrapy Tutorial (Part V)

Systematic Web Scraping for Beginners — Part I, Part II, Part III, Part IV, Part V In this last part of this tutorial series, I am going to briefly cover a very important topic: dynamic scraping. The example code can be found in the following repo: harrywang/scrapy-selenium-demo This repo contains the code for Part V of my tutorial: A Minimalist End-to-End Scrapy Tutorial (…github.com In real web scraping projects, you often cannot directly crawl…

Data Science

4 min read

A Minimalist End-to-End Scrapy Tutorial (Part V)

Data Science

4 min read

Feb 5, 2020

How to Organize a Self-contained Python Project

I often use and study open-source code from the Internet and run into the following situation: I found a nice code repo on Github, clone it to my local computer, and then have to spend a lot of time just trying to get the code up and running because I…

Data Science

5 min read

How to organize a self-contained Python project

Data Science

5 min read

Nov 18, 2019

How to Host Static Markdown/Web pages using Github Pages

Github Pages allow you to host static markdown/web pages (HTML and JS) for free. You only need a few steps to have a website up and running. I will show you how to build such a website using a course website as an example: https://harrywang.github.io/misy331/. Step 1. Create an empty…

Github Pages

4 min read

Github Pages

4 min read

Published in Towards Data Science

·Sep 12, 2019

A Minimalist End-to-End Scrapy Tutorial (Part IV)

Systematic Web Scraping for Beginners — Part I, Part II, Part III, Part IV, Part V In the previous three parts, you have developed a spider that extracts quote information from http://quotes.toscrape.com and stores the data into a local SQLite database. In this part, I will show you how to deploy the spider to the cloud. …

Heroku

8 min read

A Minimalist End-to-End Scrapy Tutorial (Part IV)

Heroku

8 min read

Published in Towards Data Science

·Sep 12, 2019

A Minimalist End-to-End Scrapy Tutorial (Part III)

Systematic Web Scraping for Beginners — Part I, Part II, Part III, Part IV, Part V In Part II, you have extracted all the required data from the website and stored them in Items. In Part III, I will introduce Item Pipelines to save the extracted data into a database using ORM (SQLAlchemy) and handle the…

Python

6 min read