conda to pixi switch

.gitattributes

@@ -0,0 +1,2 @@
+# GitHub syntax highlighting
+pixi.lock linguist-language=YAML linguist-generated=true

.github/workflows/CI.yml

@@ -1,47 +1,27 @@
-# This workflow will install Python dependencies, run tests and lint with a variety of Python versions
-# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions
+# Moving from conda to pixi way of env management
+# Read more: https://pixi.sh/dev/basic_usage/
 
 name: CI
 
-# Controls when the workflow will run
 on:
-  # Triggers the workflow on push or pull request events but only for the main branch
   push:
     branches: [ main ]
   pull_request:
     branches: [ main ]
 
-# A workflow run is made up of one or more jobs that can run sequentially or in parallel
+  workflow_dispatch:
+
 jobs:
   Env_check:
     runs-on: ubuntu-latest
-    defaults:
-      run:
-        shell: bash -l {0}
     steps:
       - name: Checkout repository
-        uses: actions/checkout@v2
+        uses: actions/checkout@v3
 
-      - name: Set up env
-        uses: conda-incubator/setup-miniconda@master
+      - name: Set up env with pixi goodness
+        uses: prefix-dev/setup-[email protected]
         with:
-          miniforge-variant: Miniforge3
-          miniforge-version: latest
-          activate-environment: journey
-          environment-file: environment.yml
-          python-version: ${{ matrix.python-version }}
-          auto-activate-base: false
-          channels: conda-forge
-          channel-priority: strict
-
-      - name: Install package
-        run: |
-          pip install -e .
-#       - name: Test with pytest
-#         run: |
-#           pytest tests/package.py 
-      - name: Conda info
-        run: conda info
-      - name: Conda list
-        run: conda list
-
+          pixi-version: v0.34.0
+          cache: true
+      - run: pixi run DJ_package
+      - run: pixi run DJ_pre_commit

.gitignore

@@ -134,3 +134,7 @@ dmypy.json
 
 #FastHTML files
 .sesskey
+
+# pixi environments
+.pixi
+*.egg-info

README.md

@@ -18,21 +18,21 @@
 ### 🚌 What's DataJourney?
 DataJourney demonstrates how organizations can effectively manage and utilize data by harnessing the power of open-source technologies. It's designed to help navigate the complex landscape of data tools, offering a structured approach to building **scalable**, and **reproducible** data workflows.
 
 Built on open-source principles, the framework guides users through essential steps—from **identifying** goals and **selecting tools** to **testing** and **customising** workflows. With its flexible, modular design, DataJourney can be tailored to individual needs, making it an invaluable toolkit for data professionals.
 
 ### 🛠 Current workflows covered
 {✨= Experimental,
 ✅ = Implemented}
 
 ✅ `Python Packaging framework` design principles\
-✅ `Conda` environment added\
 ✅ `GitHub actions` configured\
 ✅ `Vale.sh` configured at PR level\
 ✅ `Pre-commit hooks` configured for code linting/formatting\
+✅ Environment management via [pixi](https://prefix.dev/)\
 ✅ Reading data from online sources using [intake](https://github.com/intake/intake)\
 ✅ Sample pipeline built using [Dagster](https://github.com/dagster-io/dagster)\
 ✅ Building Dashboard using [holoviews](https://holoviews.org/gallery/index.html) + [panel](https://panel.holoviz.org/reference/index.html)\
 ✅ Exploratory data analysis (EDA) using [mito](https://www.trymito.io/)\
 ✅ Analysing source code complexity using [Wily](https://wily.readthedocs.io/en/latest/index.html)\
 ✅ Web UI build on [Flask](https://flask.palletsprojects.com/en/3.0.x/) \
 ✅ Web UI re-done and expanded with [FastHTML](https://docs.fastht.ml/)\
@@ -53,45 +53,38 @@
 This dataset is licensed under Creative Commons Attribution 4.0 (https://creativecommons.org/licenses/by/4.0/)
 ```
 
 #### Codespaces configured
 *Currently new pre-build images are disabled due to limited storage*
 
 ![Screenshot 2022-08-29 at 3 41 12 PM (2)](https://user-images.githubusercontent.com/17350312/187180872-881322ed-dfc7-478b-bd07-5fefc1642cb5.png)
 
-### Environment setup using conda:
+### Environment setup using pixi:
 
-#### Installing miniconda
-- Visit : https://docs.conda.io/en/latest/miniconda.html
-
-#### Create a conda environment
-```shell
-conda env create -f environment.yml
-```
-```shell
-conda activate journey
-```
+#### Installing pixi & getting started
+- Download pixi : [prefix.dev](https://prefix.dev/)
+- Command to activate env: `pixi shell`
 
 #### Install the package locally
 ```shell
-pip install -e .
+pixi run DJ_package
 ```
 
 #### 🔌 About pre-commit-hooks and activating
 Just like the name suggests, pre-commit-hooks are designed to format the code based on PEP standards before committing. [More details 🗒](https://pre-commit.com/)
 
 ```shell
-pre-commit install
+pixi run DJ_pre_commit
 ```
 ### How to run the applications?
 
 #### Dagster UI
 ```shell
 cd analytics_framework/pipeline
 ```
 ```shell
 dagit -f process.py
 ```
 ![Dagit UI output](./output/dagit_ui.png)
 
 #### Panel app
 ```shell
@@ -101,20 +94,20 @@
 python simple_app.py
 ```
 *NOTE:*
 The dashboard generated is exported into HTML format and saved as `stock_price_dashboard.html`
 
 ![Panel app output](./output/panel_app_stock.png)
 
 #### Mito
 
 Before running the jupyter notebook `doc/mito_exp.ipynb`, run the below command
 in your terminal to enable the installer. Might take some time to run.
 
 To explore further visit [trymito.io](https://docs.trymito.io/)
 ```shell
 python -m mitoinstaller install
 ```
 ![mito output](./output/mito_graph.png "Graph generated via mitosheet") ![mito output operation](./output/mito_operations.png "Operations performed via mitosheet")
 
 
 #### Display all data sources present via web UI