-
Notifications
You must be signed in to change notification settings - Fork 6
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #8 from TauferLab/jack_develop
Merging jack_develop branch
- Loading branch information
Showing
174 changed files
with
1,658 additions
and
532 deletions.
There are no files selected for viewing
4 changes: 2 additions & 2 deletions
4
.devcontainer/devcontainer.json → .devcontainer/session II/devcontainer.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,25 @@ | ||
{ | ||
"name": "NSDF Tutorial - Session III", | ||
"image": "globalcomputinglab/nsdf_tutorial:sessionIII", | ||
"containerEnv": { | ||
"PROJ_LIB": "/opt/conda/envs/NSDF-Tutorial/share/proj" | ||
}, | ||
"customizations": { | ||
"vscode": { | ||
"extensions": [ | ||
"ms-python.python", | ||
"ms-toolsai.jupyter", | ||
"ms-vscode.cpptools", | ||
"h5web.vscode-h5web", | ||
"davidanson.vscode-markdownlint" | ||
], | ||
"settings": { | ||
"C_Cpp.default.cppStandard": "c++17", | ||
"C_Cpp.default.cStandard": "c99", | ||
"python.defaultInterpreterPath": "/opt/conda/envs/NSDF-Tutorial/bin/python", | ||
"python.languageServer": "Default", | ||
"terminal.integrated.shell.linux": "/bin/bash" | ||
} | ||
} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
.DS_store | ||
hands-on/session\ II/Materials/files/tif_files/ | ||
hands-on/session\ II/Materials/files/log.log | ||
hands-on/session\ II/Materials/idx_data/Tennessee_terrain_parameters/ | ||
hands-on/session\ II/Materials/GEOtiled/geotiled/src/__pycache__ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,18 +1,18 @@ | ||
# NSDF Tutorial: Using NSDF for End-to-End Analysis of Scientific Data. | ||
|
||
## ACM Summer School Lecture, Barcelona, Spain, 2024. | ||
# Enabling Scientific Discovery: Harnessing the Power of the National Science Data Fabric for Large-Scale Data Analysis | ||
|
||
## Abstract | ||
|
||
TBD | ||
In this interactive half-day tutorial, participants explore the advanced applications of the National Science Data Fabric [(NSDF) services](https://nationalsciencedatafabric.org/) and comprehensive strategies for end-to-end scientific data analysis. The tutorial targets a broad audience, from researchers and students to developers and scientists, each finding valuable insights into managing and analyzing large datasets, with a particular focus on datasets exceeding 100TB. | ||
Attendees gain hands-on experience constructing modular workflows, leveraging public and private data storage and streaming solutions, and deploying sophisticated visualization and analysis dashboards for scientific | ||
discovery. | ||
The tutorial highlights NSDF's role in supporting the VIS conference's themes by providing scalable solutions for advances in visualization and visual analytics. It covers various topics, from an overview of NSDF's capabilities to addressing common pain points in data analysis to intermediate hands-on exercises using NSDF services for Earth science data and advanced applications, including handling and visualizing massive datasets in domains requiring high-resolution data management. | ||
Participants leave a deeper understanding of how NSDF services integrate into their research workflows to enhance data accessibility, sharing, and collaborative scientific discovery. This tutorial advances the knowledge of data-intensive computing and empowers attendees to harness the full potential of NSDF in their fields. | ||
|
||
## Agenda | ||
|
||
TBD | ||
|
||
<!-- | Time | Session | Presenter | | ||
| --- | --- | --- | | ||
| 14:00 – 15:25 | [Part 1 : eFlows4HPC Lectures](slides/eFlows4HPC_ACM_2023.pdf) | Rosa M Badia (BSC) | | ||
| 15:25 - 15:40 | Coffee break | | | ||
| 15:40 - 16:55 | [Part 2: Hands-on session: How to build and run HPC Ready containers](hands-on/instructions.md) | Jorge Ejarque (BSC) | | ||
| 16:55 - 17:00 | Tutorial conclusions | all presenters | --> | ||
| **Session** | **Duration** | **Objective** | | ||
| :---------: | :----------: | :----------------------------------------------------------------------------------------------------------------------------------------: | | ||
| [I](./hands-on/session%20II/README.md) | 30 mins | This session begins with an overview of the NSDF and addresses users' challenges identified through interviews. | | ||
| [II](./hands-on/session%20II/README.md) | 1 hour | This session offers a hands-on experience with NSDF services, focusing on visualization and dashboard creation for Earth science datasets. | | ||
| [III](./hands-on/session%20III/README.md) | 1 hour | This session delves deeper into NSDF services tailored for the management and analysis of datasets exceeding 100TB. | | ||
| [IV](./hands-on/session%20III/README.md) | 30 mins | This session concludes with an interactive Q&A, allowing attendees to discuss applications of NSDF in various research fields. | |
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
Binary file not shown.
Oops, something went wrong.