AAAA-Ingestion

Overview

EntityType

[edit]

Development

1. Reset complete KG MATCH (n) DETACH DELETE n
2. Initialize domain agnostic facets: (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_CALL_apoc_load_jsonParams.py
3. INGEST

   When these functions handle a Text object, they apply a DSNLP subclass which annotates Text.__add_cypher_statements_list().

   • (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_INGEST_ESCAM_pipeline.py

   Check message replies and spacy_user_data: (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_explain_ESCAM.py

   • (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_INGEST_code_file.py currently failing with "IndexEntryConflictException", see https://stackoverflow.com/questions/67507411/facing-indexentryconflictexception-while-merging
   • (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_INGEST_invoice_pdf.py
4. CHECK (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_KnowledgeGraph.py
5. ENRICH
   • (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_enrich_KG_by_WikiData_and_search_engines.py
6. CHECK (knowledge-graph-tools) lex@lexYoga:~/knowledge-graph-tools$ clear; python3 -m unittest test_KnowledgeGraph.py
7. CHECK https://search.dataspects.com/app/ > Explain Facet

Aspects

• Feature "NLP"
• Feature "TextEntitizer"
• Feature "EnrichKGByExternalSources"
• Feature "Element Secure Collaboration and Messaging ESCAM"
• Concept "dataspects Knowledge Graph"

[edit]

Add new

• Template
• Form
• Category

HasEntityType::AAAA-Ingestion

Page	Properties
AAAA-Ingestion "From E-Mail account to Datastore by"	HasIngestionSource::E-Mail account HasIngestionTarget::Datastore HasIngestionType::Feeder
AAAA-Ingestion "From End user to File by Editor UI"	HasIngestionFeeder::Editor UI HasIngestionSource::End user HasIngestionTarget::File HasIngestionType::UI
AAAA-Ingestion "From End user to MediaWiki by E-Mail"	HasIngestionFeeder::E-Mail HasIngestionSource::End user HasIngestionTarget::MediaWiki HasIngestionType::UI
AAAA-Ingestion "From End user to MediaWiki by MediaWiki Web UI"	HasIngestionFeeder::MediaWiki Web UI HasIngestionSource::End user HasIngestionTarget::MediaWiki HasIngestionType::UI
AAAA-Ingestion "From File system to Datastore by https://github.com/dataspects/dsdocument-cli"	HasIngestionFeeder::https://github.com/dataspects/dsdocument-cli HasIngestionSource::File system HasIngestionTarget::Datastore HasIngestionType::Feeder
AAAA-Ingestion "From MediaWiki to Datastore by https://github.com/dataspects/DataspectsMediaWikiFeeder"	HasIngestionFeeder::https://github.com/dataspects/DataspectsMediaWikiFeeder HasIngestionSource::MediaWiki HasIngestionTarget::Datastore HasIngestionType::Feeder
AAAA-Ingestion "From MediaWiki to Datastore by https://github.com/dataspects/mediawiki-workbench"	HasIngestionFeeder::https://github.com/dataspects/mediawiki-workbench HasIngestionSource::MediaWiki HasIngestionTarget::Datastore HasIngestionType::Feeder
AAAA-Ingestion "From Repository to dataspectsd by"	HasIngestionSource::Repository HasIngestionTarget::dataspectsd HasIngestionType::Feeder