Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New experiments metadata #117

Open
rinkesj opened this issue Feb 26, 2015 · 5 comments
Open

New experiments metadata #117

rinkesj opened this issue Feb 26, 2015 · 5 comments
Assignees
@stebjan
Labels
enhancement

Comments

@rinkesj
Copy link

rinkesj commented Feb 26, 2015

Store metadata of experiments in NOSQL DB with using format ODML specification.

  • create template for generate forms with odml format
  • create dynamic forms with odml format
  • allow user create template and fill forms
  • store new metadata in NOSQL db.

Implemented:

  • create/edit custom template (custom section, property structure + full editable)
  • preview of form while template is created
  • metadata form via wicket wizard
  • save template in db via template facade
  • template editation
  • delete template from db
  • required property definition in template and wizard
  • predefined values in template
  • copy template to another user
  • save data from form in nosql db
  • edit data in db
  • create property with list of values
  • odml section path in project.properties
  • view metadata on experiment detail page
  • save existing metadata from wizard like new template
  • migration legacy data from db - new admin page.

NiceToHave:

  • in template property type dropdownchoice with supported type instead textfield
  • editable textfield for section type.

Missing:

Problems:

TODO:
remove required parameter from subject in new experiment wizard.

SQL update script:
ALTER TABLE experiment ALTER COLUMN subject_person_id DROP NOT NULL;
ALTER TABLE experiment ALTER COLUMN weather_id DROP NOT NULL;
ALTER TABLE experiment ALTER COLUMN artefact_id DROP NOT NULL;
ALTER TABLE experiment ALTER COLUMN digitization_id DROP NOT NULL;
ALTER TABLE experiment ALTER COLUMN electrode_conf_id DROP NOT NULL;
@rinkesj rinkesj self-assigned this Feb 26, 2015
rinkesj pushed a commit that referenced this issue Feb 26, 2015
#117 merged metadata prototype project with eegdatabase project.
e2da68e
rinkesj pushed a commit that referenced this issue Feb 26, 2015
#117 added missing metadata form page from prototype project.
e023302
rinkesj pushed a commit that referenced this issue Feb 26, 2015
#117 added odml section files and testtemplate.xml
1f06f18
rinkesj pushed a commit that referenced this issue Feb 26, 2015
#117 merged NewMetadata corrupted branch - just usable classes.
096d846
rinkesj pushed a commit that referenced this issue Feb 26, 2015
#117 added spring configuration for template dao, service, facade.
f561316
rinkesj pushed a commit that referenced this issue Feb 26, 2015
#117 added template and dynamic form custom css
e84d4b7
rinkesj pushed a commit that referenced this issue Mar 3, 2015
#117 implemented metadata prototype into portal. Added metadata proto…
6909b05 
…type properties values, fixed services package in spring context.
rinkesj pushed a commit that referenced this issue Mar 4, 2015
#117 metadata template implementation:
f8ce2b3 
- added odml sections into resource dir
- improve template form page - add/edit action
- store templates in db via Template entity
- loading existing odml section moved into template facade
- added link for testing created templates in wizard
rinkesj pushed a commit that referenced this issue Mar 5, 2015
#117 templates improved:
9238175 
- added template delete action on template list page
- user can fill template with predefined values
rinkesj pushed a commit that referenced this issue Mar 5, 2015
#117 implemented required property definition in template
7a258a1
rinkesj pushed a commit that referenced this issue Mar 24, 2015
#117 metadata implementation improved:
e35b56b 
- Added missing titles on TemplateFormPage.
- Added new feature for sharing template between persons.
- Added required fields in wizard, used gui helper from odml.
@rinkesj
Copy link
Author

rinkesj commented Apr 19, 2015

new ES mapping json:

{
  "eegdatabase": {
    "mappings": {
      "experiment": {
        "properties": {
          "experimentId": {
            "type": "string"
          },
          "groupId": {
            "type": "integer"
          },
          "userId": {
            "type": "integer"
          },
          "metadata": {
            "properties": {
              "definition": {
                "type": "string"
              },
              "empty": {
                "type": "boolean"
              },
              "level": {
                "type": "long"
              },
              "linked": {
                "type": "boolean"
              },
              "map": {
                "properties": {
                  "definition": {
                    "type": "string"
                  },
                  "name": {
                    "type": "string"
                  },
                  "property": {
                    "properties": {
                      "definition": {
                        "type": "string"
                      },
                      "dependency": {
                        "type": "string"
                      },
                      "dependencyValue": {
                        "type": "string"
                      },
                      "name": {
                        "type": "string"
                      },
                      "value": {
                        "properties": {
                          "definition": {
                            "type": "string"
                          },
                          "type": {
                            "type": "string"
                          },
                          "unit": {
                            "type": "string"
                          }
                        }
                      }
                    }
                  },
                  "type": {
                    "type": "string"
                  }
                }
              },
              "name": {
                "type": "string"
              },
              "path": {
                "type": "string"
              },
              "properties": {
                "properties": {
                  "definition": {
                    "type": "string"
                  },
                  "dependency": {
                    "type": "string"
                  },
                  "dependencyValue": {
                    "type": "string"
                  },
                  "empty": {
                    "type": "boolean"
                  },
                  "guiHelper": {
                    "properties": {
                      "editable": {
                        "type": "boolean"
                      },
                      "empty": {
                        "type": "boolean"
                      },
                      "listActive": {
                        "type": "boolean"
                      },
                      "listUnitsActive": {
                        "type": "boolean"
                      },
                      "order": {
                        "type": "long"
                      },
                      "required": {
                        "type": "boolean"
                      }
                    }
                  },
                  "map": {
                    "properties": {
                      "definition": {
                        "type": "string"
                      },
                      "dependency": {
                        "type": "string"
                      },
                      "dependencyValue": {
                        "type": "string"
                      },
                      "name": {
                        "type": "string"
                      },
                      "value": {
                        "properties": {
                          "definition": {
                            "type": "string"
                          },
                          "type": {
                            "type": "string"
                          },
                          "unit": {
                            "type": "string"
                          }
                        }
                      }
                    }
                  },
                  "name": {
                    "type": "string"
                  },
                  "nullProperty": {
                    "type": "boolean"
                  },
                  "number": {
                    "type": "string"
                  },
                  "propertyAsVector": {
                    "type": "string"
                  },
                  "text": {
                    "type": "string"
                  },
                  "type": {
                    "type": "string"
                  },
                  "unit": {
                    "type": "string"
                  },
                  "value": {
                    "type": "string"
                  },
                  "valueDefinitions": {
                    "type": "string"
                  },
                  "values": {
                    "type": "string"
                  },
                  "wholeValue": {
                    "properties": {
                      "empty": {
                        "type": "boolean"
                      },
                      "map": {
                        "properties": {
                          "definition": {
                            "type": "string"
                          },
                          "type": {
                            "type": "string"
                          },
                          "unit": {
                            "type": "string"
                          }
                        }
                      }
                    }
                  }
                }
              },
              "propertyNames": {
                "type": "string"
              },
              "root": {
                "type": "boolean"
              },
              "terminology": {
                "type": "boolean"
              },
              "type": {
                "type": "string"
              }
            }
          },
          "params": {
            "type": "nested",
            "properties": {
              "attributes": {
                "type": "nested",
                "properties": {
                  "name": {
                    "type": "string"
                  },
                  "value": {
                    "type": "string"
                  }
                }
              },
              "name": {
                "type": "string"
              },
              "valueInteger": {
                "type": "double"
              },
              "valueString": {
                "type": "string"
              }
            }
          }
        }
      }
    }
  }
}

It will be necessary drop ES and reconfigure and then sync all experiment. Great shit.

rinkesj pushed a commit that referenced this issue May 29, 2015
#117 Implemented mapping ODML objects into ElasticSearch. Finally.
2610a80
@rinkesj
Copy link
Author

rinkesj commented May 29, 2015

Finally working mapping ODML into ES.
Used mapping chain ODML > XML > JSON > ElasticSearch > JSON > XML > ODML.
Working now with little hack about ODML version.

rinkesj pushed a commit that referenced this issue Jun 21, 2015
#117 added property with list of values - enhancemented template form.
dc928b9
rinkesj pushed a commit that referenced this issue Jun 21, 2015
#117 implemented mapper for migration legacy data from sql to nosql. …
7fad9d4 
…Migration isn't implemented right now.
rinkesj pushed a commit that referenced this issue Jun 24, 2015
#117 added empty section in template section list.
14d540c
rinkesj pushed a commit that referenced this issue Jun 24, 2015
#117 fixed problem with odml xml templates, added section template lo…
33ab578 
…cation into properties.
rinkesj pushed a commit that referenced this issue Jun 24, 2015
#117 created metadata view in experiment detail page, added template …
076fea6 
…selection for metadata wizard page, implemented add/edit metadata process.
rinkesj pushed a commit that referenced this issue Jun 25, 2015
#117 added save as new template action, save as system template actio…
1f49be2 
…n, improved template form style, removed unused imports.
rinkesj pushed a commit that referenced this issue Jun 26, 2015
#117 fixed not working update metadata, fixed not correct working sel…
59d3491 
…ect in multi value property, little clean up.
rinkesj pushed a commit that referenced this issue Jul 1, 2015
#117 migration done, bugfixes, improved UI behavior, clean up, format…
b8b3e7d 
… code.
rinkesj pushed a commit that referenced this issue Jul 1, 2015
#117 removed UI for metadata stored in SQL DB, removed experiments wi…
2582ddb 
…zard step for metadata stored in SQL DB.
rinkesj pushed a commit that referenced this issue Jul 1, 2015
#117 improved system template for ODML and EEG groups and sort them.
51708cf
@rinkesj
Copy link
Author

rinkesj commented Jul 1, 2015

test and merge into master branche now. No more new feature in rinkesj branch.

rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 merged metadata prototype project with eegdatabase project.
7764dad
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added missing metadata form page from prototype project.
6c2ff0f
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added odml section files and testtemplate.xml
67762a2
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 merged NewMetadata corrupted branch - just usable classes.
077eb8e
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added spring configuration for template dao, service, facade.
9a24cfb
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added template and dynamic form custom css
92553a2
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 implemented metadata prototype into portal. Added metadata proto…
5809b6f 
…type properties values, fixed services package in spring context.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 metadata template implementation:
ff805e2 
- added odml sections into resource dir
- improve template form page - add/edit action
- store templates in db via Template entity
- loading existing odml section moved into template facade
- added link for testing created templates in wizard
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 templates improved:
3e36d6e 
- added template delete action on template list page
- user can fill template with predefined values
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 implemented required property definition in template
18a2ad8
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 metadata implementation improved:
b898269 
- Added missing titles on TemplateFormPage.
- Added new feature for sharing template between persons.
- Added required fields in wizard, used gui helper from odml.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 Implemented mapping ODML objects into ElasticSearch. Finally.
e0d65f0
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added property with list of values - enhancemented template form.
0e7a1f9
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 implemented mapper for migration legacy data from sql to nosql. …
d102a8d 
…Migration isn't implemented right now.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added empty section in template section list.
64a6696
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 fixed problem with odml xml templates, added section template lo…
7b82fb5 
…cation into properties.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 created metadata view in experiment detail page, added template …
c187987 
…selection for metadata wizard page, implemented add/edit metadata process.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 added save as new template action, save as system template actio…
fa7125d 
…n, improved template form style, removed unused imports.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 fixed not working update metadata, fixed not correct working sel…
8d9ae0b 
…ect in multi value property, little clean up.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 migration done, bugfixes, improved UI behavior, clean up, format…
efc65f2 
… code.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 removed UI for metadata stored in SQL DB, removed experiments wi…
ab5ca95 
…zard step for metadata stored in SQL DB.
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 improved system template for ODML and EEG groups and sort them.
d1f8106
rinkesj pushed a commit that referenced this issue Jul 2, 2015
#117 ODML metadata implementation - merged from rinkesj branche.
055750d
@rinkesj
Copy link
Author

rinkesj commented Jul 2, 2015

Merged into master branch - ready for testing.

rinkesj pushed a commit that referenced this issue Jul 3, 2015
#117 fixed forgotten git conflict, fixed not working order creation f…
e81004e 
…or public experiments.
rinkesj pushed a commit that referenced this issue Jul 6, 2015
#117 system templates are now stored in SQL DB like normal template w…
2fb3d8b 
…ith null person, added administration page for system template.
rinkesj pushed a commit that referenced this issue Jul 7, 2015
#117 subject in experiment is not required any more.
a72d020
@jezekp jezekp assigned stebjan and unassigned rinkesj Jan 15, 2016
@jezekp
Copy link

jezekp commented Jan 15, 2016

Please test if it is done. Eventually close it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@stebjan stebjan

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@stebjan @jezekp @rinkesj