IndexingSetup "Indexing a file system directory"

From dataspects::Wiki
C0949405323
Jump to navigation Jump to search


Workflow

Carried out by Role "Search Engineer":

  1. Download dataspects-indexer
  2. Configure indexer-config.json
  3. Create my_fsd_indexer.rb
  4. Run dataspects-indexer

HasResourceSelectionCode

dataspects-indexer is a dataspects Go application that runs on any modern Linux, Windows or Mac.

someUser@someFileServer:~$ tree
.
├── dataspects-indexer
└── indexer-config.json

indexer-config.json

{
  "FilenameRegex": ".pdf",
  "RootFolder": "/home/someUser/documents_to_index/",
  "IndexerClassName": "MyFileSystemDirectoryIndexer"
  ...
}

HasResourceEnitizationCode

MyIndexerClasses is a code repository.

indexer@indexingServer:~$ tree
.
└── dataspects-indexing-service
    └── lib
        └── MyIndexerClasses
            └── my_fsd_indexer.rb

my_fsd_indexer.rb

class MyFileSystemDirectoryIndexer < Dataspects::Indexer
  ...
  def store_to_index(resource)

  end
end

HasIndexingExecutionCode

ShellCommand

someUser@someFileServer:~$ \
  ./dataspects-indexer \
    --config indexer-config.json \
    --indexer YourIndexerLabel