Byte-pair encoding
Published:
In this post, I’ll go over the basics of byte-pair encoding (BPE), outline its advantages as a tokenization algorithm in natural language processing, and show you some code.
Blog posts
2020
How to scrape reddit to create your own dataset
Published:
A lot of subreddits have specific submission/comment formats which can make for interesting NLP datasets. In this post, I’ll show you how to create your own dataset from reddit.com/r/AmITheAsshole.