I spoke too soon. It started failing because mysql wasn’t installed, however, trying to gem install mysql2 was throwing errors. The fix was to use Homebrew again and do:

brew install mysql

And then, after that, the gem install would work. (Did I mention this is arcane?)

#rubyquest