Jepsen testing of FoundationDB

I’ve been wondering if there are any plans to get Kyle Kingsbury to perform Jepsen testing of FoundationDB?

I do realize that Kyle anectodally said that he would not test FoundationDB because it was developed using more thorough tests than the Jepsen suite, but as Jepsen is becoming a common ground for distributed databases, it would be great to be able to point to a test report.

I am in fact now writing a note about possible choices for a distributed database and using Jepsen analyses to eliminate many unreliable options. I then have to explain that the lack of test results for FoundationDB is not necessarily disqualifying.

2 Likes

Seems like Jennifer Rullmann did some work towards that. Not sure what happened after.

She also did some work towards another test suite targeting the isolation levels. FoundationDB did pretty good with default configuration.

Yeah it will be nice to have an official post from Jepsen.

I think it would be great but someone would have to fund it. Hard when the top users of it already know that it is reliable and it isn’t necessary to prove it to them.

There was at least one blog post, perhaps two, detailing the test results, which showed FoundationDB passing all Jepsen tests with flying colors. One could hunt around in the Internet Archive for them.

I found Call Me Maybe: FoundationDB vs Jepsen and Running the New Jepsen Test.

I hadn’t ever actually gone and looked at the old blog before. There’s a number of good posts on there.

2 Likes

These blog posts are great! I somehow completely missed them, and they contain a lot of useful information. Perhaps if there is no way to sponsor Jepsen testing, these posts could be resurrected and made more visible?