1f49035aca
Co-authored-by: Alyssa Ross <hi@alyssa.is>
365 lines
12 KiB
Markdown
365 lines
12 KiB
Markdown
---
|
|
title: Ruby
|
|
author: Michael Fellinger
|
|
date: 2019-05-23
|
|
---
|
|
|
|
# Ruby
|
|
|
|
## User Guide
|
|
|
|
### Using Ruby
|
|
|
|
#### Overview
|
|
|
|
Several versions of Ruby interpreters are available on Nix, as well as over 250 gems and many applications written in Ruby.
|
|
The attribute `ruby` refers to the default Ruby interpreter, which is currently
|
|
MRI 2.5. It's also possible to refer to specific versions, e.g. `ruby_2_6`, `jruby`, or `mruby`.
|
|
|
|
In the nixpkgs tree, Ruby packages can be found throughout, depending on what
|
|
they do, and are called from the main package set. Ruby gems, however are
|
|
separate sets, and there's one default set for each interpreter (currently MRI
|
|
only).
|
|
|
|
There are two main approaches for using Ruby with gems.
|
|
One is to use a specifically locked `Gemfile` for an application that has very strict dependencies.
|
|
The other is to depend on the common gems, which we'll explain further down, and
|
|
rely on them being updated regularly.
|
|
|
|
The interpreters have common attributes, namely `gems`, and `withPackages`. So
|
|
you can refer to `ruby.gems.nokogiri`, or `ruby_2_5.gems.nokogiri` to get the
|
|
Nokogiri gem already compiled and ready to use.
|
|
|
|
Since not all gems have executables like `nokogiri`, it's usually more
|
|
convenient to use the `withPackages` function like this:
|
|
`ruby.withPackages (p: with p; [ nokogiri ])`. This will also make sure that the
|
|
Ruby in your environment will be able to find the gem and it can be used in your
|
|
Ruby code (for example via `ruby` or `irb` executables) via `require "nokogiri"`
|
|
as usual.
|
|
|
|
#### Temporary Ruby environment with `nix-shell`
|
|
|
|
Rather than having a single Ruby environment shared by all Ruby
|
|
development projects on a system, Nix allows you to create separate
|
|
environments per project. `nix-shell` gives you the possibility to
|
|
temporarily load another environment akin to a combined `chruby` or
|
|
`rvm` and `bundle exec`.
|
|
|
|
There are two methods for loading a shell with Ruby packages. The first and
|
|
recommended method is to create an environment with `ruby.withPackages` and load
|
|
that.
|
|
|
|
```shell
|
|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])"
|
|
```
|
|
|
|
The other method, which is not recommended, is to create an environment and list
|
|
all the packages directly.
|
|
|
|
```shell
|
|
nix-shell -p ruby.gems.nokogiri ruby.gems.pry
|
|
```
|
|
|
|
Again, it's possible to launch the interpreter from the shell. The Ruby
|
|
interpreter has the attribute `gems` which contains all Ruby gems for that
|
|
specific interpreter.
|
|
|
|
##### Load environment from `.nix` expression
|
|
|
|
As explained in the Nix manual, `nix-shell` can also load an expression from a
|
|
`.nix` file. Say we want to have Ruby 2.5, `nokogori`, and `pry`. Consider a
|
|
`shell.nix` file with:
|
|
|
|
```nix
|
|
with import <nixpkgs> {};
|
|
ruby.withPackages (ps: with ps; [ nokogiri pry ])
|
|
```
|
|
|
|
What's happening here?
|
|
|
|
1. We begin with importing the Nix Packages collections. `import <nixpkgs>`
|
|
imports the `<nixpkgs>` function, `{}` calls it and the `with` statement
|
|
brings all attributes of `nixpkgs` in the local scope. These attributes form
|
|
the main package set.
|
|
2. Then we create a Ruby environment with the `withPackages` function.
|
|
3. The `withPackages` function expects us to provide a function as an argument
|
|
that takes the set of all ruby gems and returns a list of packages to include
|
|
in the environment. Here, we select the packages `nokogiri` and `pry` from
|
|
the package set.
|
|
|
|
##### Execute command with `--run`
|
|
|
|
A convenient flag for `nix-shell` is `--run`. It executes a command in the
|
|
`nix-shell`. We can e.g. directly open a `pry` REPL:
|
|
|
|
```shell
|
|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])" --run "pry"
|
|
```
|
|
|
|
Or immediately require `nokogiri` in pry:
|
|
|
|
```shell
|
|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])" --run "pry -rnokogiri"
|
|
```
|
|
|
|
Or run a script using this environment:
|
|
|
|
```shell
|
|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])" --run "ruby example.rb"
|
|
```
|
|
|
|
##### Using `nix-shell` as shebang
|
|
|
|
In fact, for the last case, there is a more convenient method. You can add a
|
|
[shebang](https://en.wikipedia.org/wiki/Shebang_(Unix)) to your script
|
|
specifying which dependencies `nix-shell` needs. With the following shebang, you
|
|
can just execute `./example.rb`, and it will run with all dependencies.
|
|
|
|
```ruby
|
|
#! /usr/bin/env nix-shell
|
|
#! nix-shell -i ruby -p "ruby.withPackages (ps: with ps; [ nokogiri rest-client ])"
|
|
|
|
require 'nokogiri'
|
|
require 'rest-client'
|
|
|
|
body = RestClient.get('http://example.com').body
|
|
puts Nokogiri::HTML(body).at('h1').text
|
|
```
|
|
|
|
### Developing with Ruby
|
|
|
|
#### Using an existing Gemfile
|
|
|
|
In most cases, you'll already have a `Gemfile.lock` listing all your dependencies.
|
|
This can be used to generate a `gemset.nix` which is used to fetch the gems and
|
|
combine them into a single environment.
|
|
The reason why you need to have a separate file for this, is that Nix requires
|
|
you to have a checksum for each input to your build.
|
|
Since the `Gemfile.lock` that `bundler` generates doesn't provide us with
|
|
checksums, we have to first download each gem, calculate its SHA256, and store
|
|
it in this separate file.
|
|
|
|
So the steps from having just a `Gemfile` to a `gemset.nix` are:
|
|
|
|
```shell
|
|
bundle lock
|
|
bundix
|
|
```
|
|
|
|
If you already have a `Gemfile.lock`, you can simply run `bundix` and it will
|
|
work the same.
|
|
|
|
To update the gems in your `Gemfile.lock`, you may use the `bundix -l` flag,
|
|
which will create a new `Gemfile.lock` in case the `Gemfile` has a more recent
|
|
time of modification.
|
|
|
|
Once the `gemset.nix` is generated, it can be used in a
|
|
`bundlerEnv` derivation. Here is an example you could use for your `shell.nix`:
|
|
|
|
```nix
|
|
# ...
|
|
let
|
|
gems = bundlerEnv {
|
|
name = "gems-for-some-project";
|
|
gemdir = ./.;
|
|
};
|
|
in mkShell { buildInputs = [ gems gems.wrappedRuby ]; }
|
|
```
|
|
|
|
With this file in your directory, you can run `nix-shell` to build and use the gems.
|
|
The important parts here are `bundlerEnv` and `wrappedRuby`.
|
|
|
|
The `bundlerEnv` is a wrapper over all the gems in your gemset. This means that
|
|
all the `/lib` and `/bin` directories will be available, and the executables of
|
|
all gems (even of indirect dependencies) will end up in your `$PATH`.
|
|
The `wrappedRuby` provides you with all executables that come with Ruby itself,
|
|
but wrapped so they can easily find the gems in your gemset.
|
|
|
|
One common issue that you might have is that you have Ruby 2.6, but also
|
|
`bundler` in your gemset. That leads to a conflict for `/bin/bundle` and
|
|
`/bin/bundler`. You can resolve this by wrapping either your Ruby or your gems
|
|
in a `lowPrio` call. So in order to give the `bundler` from your gemset
|
|
priority, it would be used like this:
|
|
|
|
```nix
|
|
# ...
|
|
mkShell { buildInputs = [ gems (lowPrio gems.wrappedRuby) ]; }
|
|
```
|
|
|
|
|
|
#### Gem-specific configurations and workarounds
|
|
|
|
In some cases, especially if the gem has native extensions, you might need to
|
|
modify the way the gem is built.
|
|
|
|
This is done via a common configuration file that includes all of the
|
|
workarounds for each gem.
|
|
|
|
This file lives at `/pkgs/development/ruby-modules/gem-config/default.nix`,
|
|
since it already contains a lot of entries, it should be pretty easy to add the
|
|
modifications you need for your needs.
|
|
|
|
In the meanwhile, or if the modification is for a private gem, you can also add
|
|
the configuration to only your own environment.
|
|
|
|
Two places that allow this modification are the `ruby` derivation, or `bundlerEnv`.
|
|
|
|
Here's the `ruby` one:
|
|
|
|
```nix
|
|
{ pg_version ? "10", pkgs ? import <nixpkgs> { } }:
|
|
let
|
|
myRuby = pkgs.ruby.override {
|
|
defaultGemConfig = pkgs.defaultGemConfig // {
|
|
pg = attrs: {
|
|
buildFlags =
|
|
[ "--with-pg-config=${pkgs."postgresql_${pg_version}"}/bin/pg_config" ];
|
|
};
|
|
};
|
|
};
|
|
in myRuby.withPackages (ps: with ps; [ pg ])
|
|
```
|
|
|
|
And an example with `bundlerEnv`:
|
|
|
|
```nix
|
|
{ pg_version ? "10", pkgs ? import <nixpkgs> { } }:
|
|
let
|
|
gems = pkgs.bundlerEnv {
|
|
name = "gems-for-some-project";
|
|
gemdir = ./.;
|
|
gemConfig = pkgs.defaultGemConfig // {
|
|
pg = attrs: {
|
|
buildFlags =
|
|
[ "--with-pg-config=${pkgs."postgresql_${pg_version}"}/bin/pg_config" ];
|
|
};
|
|
};
|
|
};
|
|
in mkShell { buildInputs = [ gems gems.wrappedRuby ]; }
|
|
```
|
|
|
|
And finally via overlays:
|
|
|
|
```nix
|
|
{ pg_version ? "10" }:
|
|
let
|
|
pkgs = import <nixpkgs> {
|
|
overlays = [
|
|
(self: super: {
|
|
defaultGemConfig = super.defaultGemConfig // {
|
|
pg = attrs: {
|
|
buildFlags = [
|
|
"--with-pg-config=${
|
|
pkgs."postgresql_${pg_version}"
|
|
}/bin/pg_config"
|
|
];
|
|
};
|
|
};
|
|
})
|
|
];
|
|
};
|
|
in pkgs.ruby.withPackages (ps: with ps; [ pg ])
|
|
```
|
|
|
|
Then we can get whichever postgresql version we desire and the `pg` gem will
|
|
always reference it correctly:
|
|
|
|
```shell
|
|
$ nix-shell --argstr pg_version 9_4 --run 'ruby -rpg -e "puts PG.library_version"'
|
|
90421
|
|
|
|
$ nix-shell --run 'ruby -rpg -e "puts PG.library_version"'
|
|
100007
|
|
```
|
|
|
|
Of course for this use-case one could also use overlays since the configuration
|
|
for `pg` depends on the `postgresql` alias, but for demonstration purposes this
|
|
has to suffice.
|
|
|
|
#### Adding a gem to the default gemset
|
|
|
|
Now that you know how to get a working Ruby environment with Nix, it's time to
|
|
go forward and start actually developing with Ruby.
|
|
We will first have a look at how Ruby gems are packaged on Nix. Then, we will
|
|
look at how you can use development mode with your code.
|
|
|
|
All gems in the standard set are automatically generated from a single
|
|
`Gemfile`. The dependency resolution is done with `bundler` and makes it more
|
|
likely that all gems are compatible to each other.
|
|
|
|
In order to add a new gem to nixpkgs, you can put it into the
|
|
`/pkgs/development/ruby-modules/with-packages/Gemfile` and run
|
|
`./maintainers/scripts/update-ruby-packages`.
|
|
|
|
To test that it works, you can then try using the gem with:
|
|
|
|
```shell
|
|
NIX_PATH=nixpkgs=$PWD nix-shell -p "ruby.withPackages (ps: with ps; [ name-of-your-gem ])"
|
|
```
|
|
|
|
#### Packaging applications
|
|
|
|
A common task is to add a ruby executable to nixpkgs, popular examples would be
|
|
`chef`, `jekyll`, or `sass`. A good way to do that is to use the `bundlerApp`
|
|
function, that allows you to make a package that only exposes the listed
|
|
executables, otherwise the package may cause conflicts through common paths like
|
|
`bin/rake` or `bin/bundler` that aren't meant to be used.
|
|
|
|
The absolute easiest way to do that is to write a
|
|
`Gemfile` along these lines:
|
|
|
|
```ruby
|
|
source 'https://rubygems.org' do
|
|
gem 'mdl'
|
|
end
|
|
```
|
|
|
|
If you want to package a specific version, you can use the standard Gemfile
|
|
syntax for that, e.g. `gem 'mdl', '0.5.0'`, but if you want the latest stable
|
|
version anyway, it's easier to update by simply running the `bundle lock` and
|
|
`bundix` steps again.
|
|
|
|
Now you can also also make a `default.nix` that looks like this:
|
|
|
|
```nix
|
|
{ lib, bundlerApp }:
|
|
|
|
bundlerApp {
|
|
pname = "mdl";
|
|
gemdir = ./.;
|
|
exes = [ "mdl" ];
|
|
}
|
|
```
|
|
|
|
All that's left to do is to generate the corresponding `Gemfile.lock` and
|
|
`gemset.nix` as described above in the `Using an existing Gemfile` section.
|
|
|
|
##### Packaging executables that require wrapping
|
|
|
|
Sometimes your app will depend on other executables at runtime, and tries to
|
|
find it through the `PATH` environment variable.
|
|
|
|
In this case, you can provide a `postBuild` hook to `bundlerApp` that wraps the
|
|
gem in another script that prefixes the `PATH`.
|
|
|
|
Of course you could also make a custom `gemConfig` if you know exactly how to
|
|
patch it, but it's usually much easier to maintain with a simple wrapper so the
|
|
patch doesn't have to be adjusted for each version.
|
|
|
|
Here's another example:
|
|
|
|
```nix
|
|
{ lib, bundlerApp, makeWrapper, git, gnutar, gzip }:
|
|
|
|
bundlerApp {
|
|
pname = "r10k";
|
|
gemdir = ./.;
|
|
exes = [ "r10k" ];
|
|
|
|
buildInputs = [ makeWrapper ];
|
|
|
|
postBuild = ''
|
|
wrapProgram $out/bin/r10k --prefix PATH : ${lib.makeBinPath [ git gnutar gzip ]}
|
|
'';
|
|
}
|
|
```
|