Require Issue with Gems Built for Rails 7

[mslinn]

I wrote up my attempt at working with Solidus for the first time, using Rails 7 and building the solidus gems from master. I hit this issue:

$ bin/rails generate solidus:install
/home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:15:in `require': cannot load such file -- solidus_core (LoadError)
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:15:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/solidus-3.2.0.alpha/lib/solidus.rb:3:in `<main>'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bundler-2.3.18/lib/bundler/runtime.rb:60:in `block (2 levels) in require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bundler-2.3.18/lib/bundler/runtime.rb:55:in `each'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bundler-2.3.18/lib/bundler/runtime.rb:55:in `block in require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bundler-2.3.18/lib/bundler/runtime.rb:44:in `each'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bundler-2.3.18/lib/bundler/runtime.rb:44:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bundler-2.3.18/lib/bundler.rb:187:in `require'
        from /var/work/rails/solidus_poc/config/application.rb:7:in `<main>'        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/railties-7.0.3.1/lib/rails/command/actions.rb:22:in `require_application!'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/railties-7.0.3.1/lib/rails/command/actions.rb:14:in `require_application_and_environment!'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/railties-7.0.3.1/lib/rails/commands/generate/generate_command.rb:21:in `perform'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/thor-1.2.1/lib/thor/command.rb:27:in `run'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/thor-1.2.1/lib/thor/invocation.rb:127:in `invoke_command'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/thor-1.2.1/lib/thor.rb:392:in `dispatch'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/railties-7.0.3.1/lib/rails/command/base.rb:87:in `perform'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/railties-7.0.3.1/lib/rails/command.rb:48:in `invoke'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/railties-7.0.3.1/lib/rails/commands.rb:18:in `<main>'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'
        from /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30:in `require'

You can jump straight to the above issue in my writeup.

[jarednorman]

Something must be wrong with your load path. solidus_core is a dependency of solidus, so if it is installed and available, the system should be able to require it. Not immediately sure how to debug that though.

[mslinn]

$ gem info solidus_core

*** LOCAL GEMS ***

solidus_core (3.2.0.alpha, 3.1.7)
    Author: Solidus Team
    Homepage: http://solidus.io
    License: BSD-3-Clause
    Installed at (3.2.0.alpha): /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0
                 (3.1.7): /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0

    Essential models, mailers, and classes for the Solidus e-commerce
    project.

[jarednorman]

What about bundle info solidus_core?

[mslinn]

$ bundle info solidus
  * solidus (3.2.0.alpha)
        Summary: Full-stack e-commerce framework for Ruby on Rails.
        Homepage: http://solidus.io
        Path: /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/solidus-3.2.0.alpha

[mslinn]

I just ran through the process again on another computer, and the same problem manifested. The writeup mentioned on the first post above has been updated.

[jarednorman]

I've never seen anyone manually build gems for developing an app and don't understand why you'd do that.

Can you change your Gemfile to reference the gems directly from GitHub and see if that works any better?

[mslinn]

Good call! I added the solidus gem to Gemfile:

gem 'solidus', git: 'https://github.com/solidusio/solidus'

Then I ran bundle install, and it worked!

$ bundle install
Fetching https://github.com/solidusio/solidus
Fetching gem metadata from https://rubygems.org/.........
Resolving dependencies....
Using rake 13.0.6
Using minitest 5.16.2
Using rack 2.2.4
Using erubi 1.10.0
Using racc 1.6.0
Using digest 3.1.0
Using nio4r 2.5.8
Using concurrent-ruby 1.1.10
Using builder 3.2.4
Using websocket-extensions 0.1.5
Using marcel 1.0.2
Using mini_mime 1.1.2
Using bundler 2.3.18
Using timeout 0.3.0
Using strscan 3.0.3
Using public_suffix 4.0.7
Using execjs 2.8.1
Using bindex 0.8.1
Using msgpack 1.5.3
Using crass 1.0.6
Using cancancan 3.4.0
Using method_source 1.0.0
Using io-console 0.5.11
Using zeitwerk 2.6.0
Using matrix 0.4.2
Using regexp_parser 2.5.0
Using childprocess 4.1.0
Using climate_control 0.2.0
Using thor 1.2.1
Using ffi 1.15.5
Using tilt 2.0.11
Using mini_magick 4.11.0
Using kaminari-core 1.2.2
Using mime-types-data 3.2022.0105
Using omnes 0.2.2
Using pg 1.4.1
Using stringio 3.0.2
Using rexml 3.2.5
Using rubyzip 2.3.2
Using websocket 1.2.9
Using state_machines 0.5.0
Using truncate_html 0.9.3
Using rack-test 2.0.2
Using nokogiri 1.13.7 (x86_64-linux)
Using puma 5.6.4
Using i18n 1.12.0
Using tzinfo 2.0.4
Using sprockets 4.1.1
Using websocket-driver 0.7.5
Using mail 2.7.1
Using net-protocol 0.1.3
Using addressable 2.8.0
Using autoprefixer-rails 10.4.7.0
Using bootsnap 1.12.0
Using reline 0.3.1
Using terrapin 0.6.0
Using ruby-vips 2.1.4
Using sassc 2.4.0
Using mime-types 3.4.1
Using psych 4.0.4
Using selenium-webdriver 4.3.0
Using loofah 2.18.0
Using irb 1.4.1
Using money 6.16.0
Using activesupport 7.0.3.1
Using handlebars_assets 0.23.9
Using net-imap 0.2.3
Using net-pop 0.1.1
Using net-smtp 0.3.1
Using xpath 3.2.0
Using image_processing 1.12.2
Using webdrivers 5.0.0
Using rails-html-sanitizer 1.4.3
Using debug 1.6.1
Using monetize 1.12.0
Using rails-dom-testing 2.0.3
Using globalid 1.0.0
Using activemodel 7.0.3.1
Using activemerchant 1.126.0
Using activerecord 7.0.3.1
Using state_machines-activemodel 0.8.0
Using acts_as_list 1.0.4
Using awesome_nested_set 3.5.0
Using kt-paperclip 7.1.1
Using kaminari-activerecord 1.2.2
Using ransack 2.6.0
Using discard 1.2.1
Using actionview 7.0.3.1
Using activejob 7.0.3.1
Using actionpack 7.0.3.1
Using carmen 1.1.3
Using capybara 3.37.1
Using state_machines-activerecord 0.8.0
Using jbuilder 2.11.5
Using friendly_id 5.4.2
Using kaminari-actionview 1.2.2
Using actioncable 7.0.3.1
Using activestorage 7.0.3.1
Using actionmailer 7.0.3.1
Using railties 7.0.3.1
Using sprockets-rails 3.4.2
Using cssbundling-rails 1.1.1
Using jsbundling-rails 1.0.3
Using actiontext 7.0.3.1
Using font-awesome-rails 4.7.0.8
Using jquery-rails 4.5.0
Using responders 3.0.1
Using kaminari 1.2.2
Using actionmailbox 7.0.3.1
Using stimulus-rails 1.1.0
Using turbo-rails 1.1.1
Using web-console 4.2.0
Using sassc-rails 2.1.2
Using solidus_core 3.2.0.alpha from https://github.com/solidusio/solidus (at master@a227230)
Using rails 7.0.3.1
Using canonical-rails 0.2.14
Using solidus_api 3.2.0.alpha from https://github.com/solidusio/solidus (at master@a227230)
Using solidus_sample 3.2.0.alpha from https://github.com/solidusio/solidus (at master@a227230)
Using solidus_backend 3.2.0.alpha from https://github.com/solidusio/solidus (at master@a227230)
Using solidus_frontend 3.2.0.alpha from https://github.com/solidusio/solidus (at master@a227230)
Using solidus 3.2.0.alpha from https://github.com/solidusio/solidus (at master@a227230)
Bundle complete! 17 Gemfile dependencies, 121 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Post-install message from solidus_core:
-------------------------------------------------------------
                Thank you for using Solidus
-------------------------------------------------------------
If this is a fresh install, don't forget to run the Solidus
installer with the following command:

$ bin/rails g solidus:install

If you are updating Solidus from an older version, please run
the following commands to complete the update:

$ bin/rails g solidus:update

Please, don't forget to look at the CHANGELOG to see what has changed and
whether you need to perform other tasks.

https://github.com/solidusio/solidus/blob/master/CHANGELOG.md

Please report any issues at:
- https://github.com/solidusio/solidus/issues
- http://slack.solidus.io/
-------------------------------------------------------------
Post-install message from solidus_frontend:
----------------------------------------------------------------------------
DEPRECATION WARNING: SolidusFrontend is deprecated. It will be removed from
the solidus meta-package gem in a Solidus v4. Furthermore, its code will be
extracted from https://github.com/solidusio/solidus to a new repo. Once
extracted, you'll need to explicitly add `solidus_frontend` to your Gemfile
in order to continue using it.

For fresh Solidus applications, we recommend you use SolidusStarterFrontend
instead.
----------------------------------------------------------------------------

Then to make sure:

$ bundle info solidus
  * solidus (3.2.0.alpha a227230)
        Summary: Full-stack e-commerce framework for Ruby on Rails.
        Homepage: http://solidus.io
        Path: /home/mslinn/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/bundler/gems/solidus-a22723079f88

Thank you!

[jarednorman]

Awesome!

[mslinn]

After I ran bundle install I tried installing solidus according to the solidus_core post-install message, which was:

Post-install message from solidus_core:
-------------------------------------------------------------
                Thank you for using Solidus
-------------------------------------------------------------
If this is a fresh install, don't forget to run the Solidus
installer with the following command:

$ bin/rails g solidus:install

If you are updating Solidus from an older version, please run
the following commands to complete the update:

$ bin/rails g solidus:update

Please, don't forget to look at the CHANGELOG to see what has changed and
whether you need to perform other tasks.

https://github.com/solidusio/solidus/blob/master/CHANGELOG.md

Please report any issues at:
- https://github.com/solidusio/solidus/issues
- http://slack.solidus.io/
-------------------------------------------------------------
Post-install message from solidus_frontend:
----------------------------------------------------------------------------
DEPRECATION WARNING: SolidusFrontend is deprecated. It will be removed from
the solidus meta-package gem in a Solidus v4. Furthermore, its code will be
extracted from https://github.com/solidusio/solidus to a new repo. Once
extracted, you'll need to explicitly add `solidus_frontend` to your Gemfile
in order to continue using it.

For fresh Solidus applications, we recommend you use SolidusStarterFrontend
instead.
----------------------------------------------------------------------------

Here is what happened:

$ bin/rails generate solidus:install
Could not find generator 'solidus:install'.
Run `bin/rails generate --help` for more options.

Does that generator still exist?

I updated my blog post.

[waiting-for-dev]

You should definitely use bundler for all of your gems, otherwise, you can expect weird things. Probably Rails is looking for the generator outside of the bundler context.

[mslinn]

What do you suggest I try? BTW, I just refactored the blog post, it should read better now.

[waiting-for-dev]

Run first the rails new command. Later, add all your dependencies to the Gemfile. You don't need to gem install before. All of them will be installed and included in your application context when you do bundle. The generated application has a line require "bundler/setup" in the config/boot.rb file which will setup all of your dependencies.

[mslinn]

@waiting-for-dev Sounds like you might have read the blog post. I think you actually mean that instead of typing:

$ nohup time nice \
  gem install bundler pg rails rake solidus &

Readers should type:

nohup time nice \
  gem install bundler rake 

I will start again from that point :)

[waiting-for-dev]

bundler is already part of ruby, so you shouldn't need to explicitly install it. As for rake, you don't need it either. You only need to gem install rails. Rails' official guide should give you all the instructions you need.