FEAT Add the AggJoiner and AggTarget transformers

.github/workflows/testing.yml

@@ -52,6 +52,8 @@ jobs:
               - dependencies-version: "dev"
               - dependencies-version: "dev, pyarrow"
                 python-version: "3.11"
+              - dependencies-version: "dev, polars"
+                python-version: "3.11"
               - dependencies-version: "dev, min-py310"
                 python-version: "3.10"
                 dependencies-version-type: "minimal"

CHANGES.rst

@@ -15,6 +15,11 @@ development and backward compatibility is not ensured.
 Major changes
 -------------
 
+* :func:`dataframe.pd_join`, :func:`dataframe.pd_aggregate`,
+  :func:`dataframe.pl_join` and :func:`dataframe.pl_aggregate`
+  are now available in the dataframe submodule.
+  :pr:`733` by :user:`Vincent Maladiere <Vincent-Maladiere>`
+
 * :class:`FeatureAugmenter` is renamed to :class:`Joiner`.
   :pr:`674` by :user:`Jovan Stojanovic <jovan-stojanovic>`
 
@@ -32,6 +37,14 @@ Major changes
 * Parallelized the :class:`GapEncoder` column-wise. Parameters `n_jobs` and `verbose`
   added to the signature. :pr:`582` by :user:`Lilian Boulard <LilianBoulard>`
 
+* New experimental feature :class:`AggJoiner`, a transformer performing
+  aggregation on auxiliary tables followed by left-joining on a base table.
+  :pr:`600` by :user:`Vincent Maladiere <Vincent-Maladiere>`.
+
+* New experimental feature :class:`AggTarget`, a transformer performing
+  aggregation on the target y, followed by left-joining on a base table.
+  :pr:`600` by :user:`Vincent Maladiere <Vincent-Maladiere>`.
+
 * Parallelized the :func:`deduplicate` function. Parameter `n_jobs`
   added to the signature. :pr:`618` by :user:`Jovan Stojanovic <jovan-stojanovic>`
   and :user:`Lilian Boulard <LilianBoulard>`
@@ -187,7 +200,7 @@ Major changes
   :pr:`291` by :user:`Jovan Stojanovic <jovan-stojanovic>` and :user:`Leo Grinsztajn <LeoGrin>`
 
 * New experimental feature: :class:`FeatureAugmenter`, a transformer
-  that augments with :func:`fuzzy_join` the number of features in a main table by using information from auxilliary tables.
+  that augments with :func:`fuzzy_join` the number of features in a main table by using information from auxiliary tables.
   :pr:`409` by :user:`Jovan Stojanovic <jovan-stojanovic>`
 
 * Unnecessary API has been made private: everything (files, functions, classes)

build_tools/github/install.sh

@@ -13,7 +13,7 @@ fi
 
 pip install --progress-bar off --only-binary :all: --no-binary liac-arff --upgrade ".[$DEPS_VERSION]"
 
-if [[ "$DEPS_VERSION" != *"pyarrow"* ]]; then
+if [[ "$DEPS_VERSION" != *"pyarrow"* && "$DEPS_VERSION" != *"polars"* ]]; then
     # Since pyarrow is a dependency of pandas, we need to uninstall it explicitly
     pip uninstall -y pyarrow
 fi

doc/api.rst

@@ -32,6 +32,9 @@ This page lists all available functions and classes of `skrub`.
    :nosignatures:
 
    Joiner
+   AggJoiner
+   AggTarget
+
 
 .. raw:: html
 
@@ -84,6 +87,46 @@ This page lists all available functions and classes of `skrub`.
 
    deduplicate
 
+.. raw:: html   
+
+   <h2>Dataframes operations</h2>
+
+.. autosummary::
+   :toctree: generated/
+   :template: function.rst
+   :nosignatures:
+   :caption: DataFrames operations
+
+   dataframe.get_df_namespace
+
+.. raw:: html
+
+   <h3>Pandas</h3>
+
+.. autosummary::
+   :toctree: generated/
+   :template: function.rst
+   :nosignatures:
+   :caption: Pandas operations
+
+   dataframe.is_pandas
+   dataframe.pd_aggregate
+   dataframe.pd_join
+
+.. raw:: html
+
+   <h3>Polars</h3>
+
+.. autosummary::
+   :toctree: generated/
+   :template: function.rst
+   :nosignatures:
+   :caption: Polars operations
+
+   dataframe.is_polars
+   dataframe.pl_aggregate
+   dataframe.pl_join
+
 .. raw:: html
 
    <h2>Data download and generation</h2>
@@ -102,6 +145,7 @@ This page lists all available functions and classes of `skrub`.
    datasets.fetch_traffic_violations
    datasets.fetch_drug_directory
    datasets.fetch_world_bank_indicator
+   datasets.fetch_movielens
    datasets.fetch_ken_table_aliases
    datasets.fetch_ken_types
    datasets.fetch_ken_embeddings