Untyped "dataspects Software Architecture"

About In this context… What links here? CONTENT [edit] EntityType "Untyped" Keywords/Contexts Annotations CanBeDeveloped::Yes [edit] [edit] Main Page ‎ (← links) [edit] See below…

DataspectsMediaWikiFeeder

DataspectsMediaWikiFeeder sends to mediawiki-datastore/<mediawiki-id>/pages an entityDoc JSON containing:

wikiPage.string fields
a wikiPage.content hash
  wikiPage.content.string fields
a wikiPage.categories.array of strings
a wikiPage.annotations.hash
  annotation.string fields
  annotation.object.hash
    annotation.object.string fields

mediawiki-datastore

mediawiki-datastore/<mediawiki-id>/pages receives an entityDoc JSON and stores to MongoDB:WikiPage:

wikiPage.string fields
wikiPage.categories array

MongoDB

and stores to MongoDB:WikiPageAnnotation the wikiPage.annotations.hash:

annotation.string fields
annotation.object hash
  object.string fields

and stores to MongoDB:WikiPageAnnotation the wikiPage.categories.array: This could be refactored back into the feeder! See here

annotation.string fields
annotation.object hash
  object.string fields

and synthesizes and stores to MongoDB:WikiPageAnnotation standardTemplateAnnotations and resultFormatTemplateAnnotations annotations.

nats.publish('mediawiki.indexer.indexPage')

{
  wikiPage: wikiPage,
  annotations: annotations
}

mediawiki-workbench

mediawiki-workbench sends to mediawiki-datastore/<mediawiki-id>/pages an entityDoc JSON containing:

type MWResponse struct {
  Source string `json:"source"`
  User string `json:"user"`
  Query string `json:"query"`
  Vol int `json:"vol"`
  Results []Result `json:"results"`
}
type Result struct {
  Meta string `json:"meta"`
  ResourceSiloType string `json:"resourceSiloType"`
  ResourceSiloLabel string `json:"resourceSiloLabel"`
  ResourceSiloID string `json:"resourceSiloID"`
  ResourceType string `json:"resourceType"`
  Pagename string `json:"pagename"`
  RawURL string `json:"rawUrl"`
  ShortURL string `json:"shortUrl"`
  Namespace int64 `json:"namespace"`
  Full Content `json:"full"`
  Annotations []Annotation `json:"annotations"`
}
type Content struct {
  Wikitext string `json:"wikitext"`
  Text string `json:"text"`
  HTML string `json:"html"`
}
type Annotation struct {
  Subject string `json:"subject"`
  Predicate string `json:"predicate"`
  Object Object `json:"object"`
  SMWPropertyType int64 `json:"smwpropertytype"`
}
type Object struct {
  Source string `json:"source"`
  HTML string `json:"html"`
  Text string `json:"text"`
}