Select * the internet: DuckDB queries 100B rows in 30s

 (motherduck.com)

2 points | by dmkii 3 hours ago

1 comments

  • dmkii 3 hours ago
    You can basically SELECT * the internet by querying the public Common Crawl dataset on S3 with DuckDB. It's a great way to explore how the AI-pilled web (Vercel, Lovable, Replit, Bolt, Cloudflare, GitHub) compare to the traditional Wordpress-Blogspot hegemony.