Indexing

Entities keyworded Indexing

---

Indexing Terms	Mentioned In

---

Indexing Domains:

---

Indexing involves 2 steps:

1. Feeding resources from a ResourceSilo into a Datastore
2. Applying an Indexer to resources in a Datastore

Feeding resources from a ResourceSilo into a Datastore

See SystemComponent "datastores"

AAAA-Ingestion "From E-Mail account to Datastore by"

Data fed?
Configuration
Subsequent pipeline
Tools

AAAA-Ingestion "From File system to Datastore by https://github.com/dataspects/dsdocument-cli"

Data fed?
Configuration	Configure the datastore: <Datastore ID> automatic (e.g. 12) <Datastore Label> Shown in information sources list on https://ui.dataspects.com/search <Datastore API Key> automatic (e.g. c8b89bc3-0139-11wa-8ef3-8c164563716b) <Datastore Doc Regex> Only file names matching this regex will be fed to the datastore (Regex Tester - Golang) Configure and run the feeder to index matching files in and below the current folder: user@workstation:/yourfolder$ ./dsdocument-cli \ --id <Datastore ID> # From https://ui.dataspects.com/datastores/files \ --url https://datastore.dataspects.com \ --key <Datastore API Key> # From https://ui.dataspects.com/datastores/files
Subsequent pipeline
Tools

AAAA-Ingestion "From MediaWiki to Datastore by https://github.com/dataspects/DataspectsMediaWikiFeeder"

Data fed?	https://github.com/dataspects/datastore/blob/master/internal/models/mediawikis.go
Configuration	https://github.com/dataspects/DataspectsMediaWikiFeeder/blob/master/maintenance/feedAll.php
Subsequent pipeline
Tools

AAAA-Ingestion "From MediaWiki to Datastore by https://github.com/dataspects/mediawiki-workbench"

Data fed?
Configuration
Subsequent pipeline
Tools

AAAA-Ingestion "From Repository to dataspectsd by"

Data fed?	https://github.com/dataspects/dataspectsd/blob/master/internal/datastore/code.go
Configuration	Configure the datastore Configure the feeder
Subsequent pipeline
Tools