Link to the 3D simulation of the sea using OBSEA data.
The underwater observatory collects data in real-time. It has been collecting data since around 2000. Currently their dashboard only shows data from the last 48h. The objective is to visualize and download historical data. The old database was not indexed and some of the streams had samples every 15 seconds. When asking data for a long period of time, the query took too long and the data had too much resolution.
In this section we will describe the data collected and some of the properties. Temporal relevance: instantaneous (interesting information is in the moment) or climatological (interesting information is in relationship to the mean)
| Observation | Unit | Temporal relevance | Visualization | Interactions | Stakeholders |
|---|---|---|---|---|---|
| Air temperature | Celsius | Climatological | Graph with mean prev year | ||
| Air pressure | hPa | ? | ? | ||
| Relative humidity | % | Climatological | ? | ||
| Thickness of rainfall | mm | Instantaneous | Bar graph daily | ||
| . | |||||
| Sea water temperature | Celsius | Climatological / Instantaneous | Graph with mean prev year | ||
| Salinity | ‰ | Climatological / Instantaneous | Graph with mean prev year | ||
| Sea water pressure | dbar | ? | Shows depth and storm events (std of water press) | ||
| Sea water electrical conductivity | S/m | ? | To calculate salinity | ||
| Speed of sound (sea water) | m/s | ? | To calculate salinity | ||
| Sea water pH | pH | Climatological | Graph with mean prev year | ||
| . | |||||
| Current | m/s | Climatological / Instantaneous | ? | ||
| Current direction | deg | Climatological / Instantaneous | Circular bar graph month/year | ||
| Current 3D | m/s | Instantaneous | 3D graph arrows at each meter depth | ||
| Wave significant height | m | Instantaneous | Bar graph hourly | ||
| Wave peak height (1/3 or 1/10) | m | Instantaneous | Bar graph hourly | ||
| Wave direction | deg | Climatological | Circular bar graph month/year | ||
| Wave period | s | Instantaneous | Bar graph hourly | ||
| Wind | m/s | Instantaneous | Bar graph hourly | ||
| Wind direction | deg | Climatological / Instantaneous | Circular bar graph month/year | ||
| Sound pressure level (hydrophone) | dB | ? |
Show a graph with the data available for specific dates. The main problem with observatories is that data is not continuous. Devices may fail and would be replaced in a few days / months, thus not collecting data for some time.
Compare current data to the monthly mean / monthly year. These averages could be done offline.
Show the direction and the intensity with a circular graph. Intensity and direction are divided in bins (e.g., every 0.5m for waves, every 20deg for direction). Each intensity bin has a frequency of occurance (%) for a specific direction bin. Yearly and monthly could be done offline.
Mark some events, like storms or heavy rainfall. Should show weekly data.
Current data of the station showing the last week.
Enoc has been testing different tecnologies to speed up and organize the database and backend. The data can be served and visualized now from SensorThings API, PostgreSQL, ERDDAP, CKAN and Grafana. He wrote scripts that resample the datastreams with a lower temporal resolution (e.g., a sample every 15min) in order to reduce the size, transmission and handling of the data files.
SensorThings API in Grafana has a bug when plotting lines (end of line is connected to beginning of line, creating strange horizontal lines on the plot).
How to publish visualizations with Grafana
Three different levels of access: Editor, Admin, Viewer. Viewer: a user with Viewer role can still issue any possible query to a data source, not just those queries that exist on dashboards he/she has access to. ref
You can give access to anyone as viewer, but they will be able to query to a data source, i.e. PostgreSQL. ref :
- Anyone with the URL can access the dashboard.
- Anyone can make view calls to the API and list all folders, dashboards, and data sources.
- Anyone can make arbitrary queries to any data source that the Grafana instance is configured with. ref
When you share a panel or dashboard as a snapshot, a snapshot (of the panel or the dashboard at that moment in time) is publicly available on the web. Anyone with a link to it can access it. Since snapshots do not need any authorization to view, Grafana strips information related to the account it came from, as well as any sensitive data from the snapshot. ref
You can embed a panel using an iframe on another web site. Unless anonymous access permission is enabled, the viewer must be signed into Grafana to view the graph. ref
- Front-end design
- Login required?
- API security, performance and access
- Graphana or Highcharts for front-end
- Additional visualizations to datastreams, such as average and std of measurement per day/week
- Visualization of historical data, e.g. annual with the new backend (SensorThings API)
- Visualize per instrument (buoy) or unit (temperature)
- Download data from ERDDAP, SensorThings, CKAN, Graphan or Highcharts?
- Download and print charts?
- Visualize metadata?
-
Marine Institute: http://smartbay.marine.ie/
-
Canada ocean networks: https://oceannetworks.ca/science https://data.oceannetworks.ca/home?TREETYPE=1&LOCATION=1052&DEVICECATEGORY=20&SENSORCODE=380&TIMECONFIG=3
https://data.emso.eu/home https://data.emso.eu/general_dashboard