Unscope the search_import scope in-case I'm indexing some attrs,

[wahabmangat]

First
Done
Is your feature request related to a problem? Please describe.
I have a search_import scope like

  scope :search_import, -> { includes(:apps) }

I don't want to eager_load the apps when I'm only indexing let's say the domain name (FYI: domain has_many apps). How to unscope it

here's my search_data method

def search_data
  {
   apps_name: apps.map(&:name)
  }.merge(only_name)
end
def only_name
  {
    name: name
  }
end

Describe the solution you'd like

Domain.unscope(:search_import).reindex(:only_name)

[jaypandya73]

I faced similar situation and in my case, I am performing partial reindex on prices columns and for that It eager loads all the association which is defined in search_import scope and it fires unnecessary queries.
Since we really can't avoid it right now I find a way to do it.

Searchkick.indexer.queue(YourDbRecords.map do |r| 
    Searchkick::RecordData.new(YourModel.searchkick_index, r).update_data(partial_data_method_name)
  end
)

Reference: https://github.com/ankane/searchkick/blob/master/lib/searchkick/index.rb#L167
Note: This code will skip ActiveSupport::Notifications publish event.

@ankane - We can easily implement this by introducing new flag on configuration level or we can also introduce new method for this. And I am happy to raise PR for this.

This is valid case because I am performing partial data reindexing on lots of data and that too frequently and I can't use Searchkick bulk callback option since I am not updating records individually(it's happening in batches and happens on direct DB level).

[osjjames]

If you're reindexing an ActiveRecord::Relation, the reindex method supports a scope: parameter.

I've used this technique to avoid unnecessary queries when partially reindexing a model. Here's a basic example.

Model

class Post < ApplicationRecord
  has_many :comments
  has_many :reactions
  
  scope :comments_search_import, -> { includes(:comments) }
  scope :reactions_search_import, -> { includes(:reactions) }
  
  # Combine the partial scopes to create the full scope
  scope :search_import, -> { comments_search_import.reactions_search_import }
  
  private
  
  def comments_data
    { commenter_ids: comments.map(&:user_id).uniq }
  end

  def reactions_data
    { reactor_ids: reactions.map(&:user_id).uniq }
  end
  
  def search_data
    comments_data.merge(reactions_data)
  end
end

Usage

Given an ActiveRecord::Relation on Post, you can pass the relevant scope like so.

Post.reindex(:comments_data, scope: :comments_search_import)

or

Post.reindex(:reactions_data, scope: :reactions_search_import)

Reference

searchkick/lib/searchkick/relation_indexer.rb

Lines 9 to 15 in dd63a30

	def reindex(relation, mode:, method_name: nil, full: false, resume: false, scope: nil)
	# apply scopes
	if scope
	relation = relation.send(scope)
	elsif relation.respond_to?(:search_import)
	relation = relation.search_import
	end