Code to create pre-training data for a span selection pre-training task inspired by reading comprehension and an effort to avoid encoding general knowledge in the transformer network itself.
Contributions:4 commits, 4 pushes, 1 comment in 1 year 7 months
training-data
A dataset for knowledge base population research using Common Crawl and DBpedia.
Contributions:26 commits, 3 PRs, 20 pushes in 2 years 9 months
commoncrawldbpediaknowledge-base-populationcommon-crawlibm-research-ai