Category Archives: craigslist

Slides from my MongoSF 2011 Talk

Due to a surprisingly long conversion delay, the slides from my talk at MongoSF 2011 are now available: I’m sure video will be available at some point too, which will make the slides quite a bit more useful. But if … Continue reading

Posted in craigslist, mongodb | 5 Comments

Speaking at MongoSF on May 24th

I’m a little late to be posting this the night before. In any case, tomorrow afternoon I’ll be presenting at MongoSF 2011. My talk title is Lessons Learned from Migrating 2+ Billion Documents at Craigslist and it picks up where my … Continue reading

Posted in craigslist, mongodb, nosql | 2 Comments

MongoDB Pre-Splitting for Faster Data Loading and Importing

Once nice thing about playing with Webdis is that I can watch the import rate of my multi-billion document MongoDB import in nearly real-time. The downside of that is that I quickly found that once I got a few hundred … Continue reading

Posted in craigslist, mongodb, programming, tech | 24 Comments

Redis Sharding at Craigslist

After reading Salvatore’s Redis Presharding, I thought I’d write up the sharding technique we use at Craigslist to take advantage of multiple cores, multiple hosts, and allow for painless growth (up to a point). Nodes The primary building block of … Continue reading

Posted in craigslist, nosql, programming, redis | 39 Comments

Webdis is Full of Awesome

I’ve long wanted a lightweight system for gathering and graphing simple performance metrics without a lot of centralized processing. I could use something like StatsD from the Etsy folks but got inspired by reading about Redis at Disqus the other … Continue reading

Posted in craigslist, programming, redis, tech | 3 Comments

Slides for: Fusion-io and MySQL 5.5 at Craigslist

The slides from the talk I gave at Percona Live San Francisco yesterday are now available on slideshare (hopefully the embed works here too): View more presentations from Jeremy Zawodny. Overall, I enjoyed the conference–not just meeting up folks I … Continue reading

Posted in craigslist, mysql, programming, tech | 6 Comments

When an example falls in your lap

As I recently noted, I’m giving a short talk at Percona Live about our experience with Fusion-io for MySQL at Craigslist. As is often the case, I agreed to give the talk before giving too much thought about exactly what … Continue reading

Posted in craigslist, mysql, tech | 8 Comments

Speaking at Percona Live in San Francisco

On Wednesday, February 16th, I’ll be attending Percona Live in San Francisco to hear about what’s new in the MySQL ecosystem and talk about our adoption of Fusion-io storage for some of our systems at Craigslist. Not only do we … Continue reading

Posted in craigslist, mysql, tech | 1 Comment

Suggestions for analysis of all craigslist postings?

I’m sure this will end up attracting far more (both in number and complexity) suggestions than I can reasonably implement, but I figured I’d ask anyway… I’m working on a project (discussed at the recent MongoSV conference) that will migrate … Continue reading

Posted in craigslist, tech | 47 Comments

Always Test with Real Data

As I previously noted, I’m in the midst of converting some data (roughly 2 billion records) into documents that will live in a MongoDB cluster. And any time you move data into a new data store, you have to be … Continue reading

Posted in craigslist, mongodb, mysql, programming, tech | 7 Comments