-
Notifications
You must be signed in to change notification settings - Fork 4
/
Copy pathdata-explorer.qmd
65 lines (37 loc) · 4.45 KB
/
data-explorer.qmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
---
title: "Data Explorer"
---
The Data Explorer is designed to complement code-first exploration of data, allowing you to display data in a spreadsheet-like grid, temporarily filter and sort data, and provide useful summary statistics directly inside of Positron. The goal of the Data Explorer isn't to replace code-based workflows, but rather supplement with ephemeral views of the data or summary statistics as you further explore or modify the data via code.
The Data Explorer has three primary components, discussed in greater detail in the sections below:
* **Data grid:** Spreadsheet-like display of the individual cells and columns, as well as sorting
* **Summary panel:** Column name, type and missing data percentage for each column
* **Filter bar:** Ephemeral filters for specific columns
## Open a dataframe in the Data Explorer
Each instance of the Data Explorer tool is powered by a language runtime and can display dataframes in Python (`pandas`) or R (`data.frame`, `tibble`, `data.table`). We also have experimental support for `polars`, and additional Python dataframe libraries will be added in the future.
Each instance of the data explorer will be refreshed with changes made to the underlying data. This allows combined workflows between the UI-centric Data Explorer and a code-first approach.
To open a new instance of the Data Explorer on a specific data frame, use one of the following methods:
* Use the language runtime directly:
* Via Python: `%view dataframe label`
* Via R: `View(dataframe, "label")`
* Navigate to the Variables Pane and click on the Data Explorer icon for a specific dataframe object
{width=700}
## Data grid
The data grid is the primary display, with a spreadsheet-like cell-by-cell view. It's intended to scale efficiently to relatively large in-memory datasets, up to millions of rows or columns. Each column header has the column name above the data type, as used in the language runtime. At the top right of each column, there is a context menu to control sorting or to add a filter for the selected column. Resize columns by clicking and dragging the column's borders.
{width=300}
Row labels default to the observed row index, with a zero-based index in Python and a one-based index in R. Alternatively, `pandas` and R users may also have rows with modified indices or string-based labels.
## Summary panel
The summary panel displays a vertical scrolling list of all of the column names and an icon representing their respective type. It displays a sparkline histogram of that column's data, and also displays the amount of missing data as both an inline bar graph and an increasing percentage.
{width=350}
Double clicking on a column name will also bring the column into focus in the data grid, allowing for quickly navigating wider data.
1. The summary panel quickly collapsed by dragging it to the edge or clicking on the collapse button after hovering over the grid and summary panel divider.
2. The summary panel can also be placed on the left or right side of the Data Explorer via the Layout control.
{width=700}
## Filter bar
The filter bar has controls to:
1. Add, Show/Hide existing filters, or Clear Filters
2. A <kbd>+</kbd> button to quickly add a new filter
3. The status bar at the bottom of the Data Explorer also displays the percentage and number of remaining rows relative to the original total after applying a filter
{width=700}
When creating a new filter, you will first need to select a column either by scrolling the full list or searching across columns for a specific string. Once a column is selected, the available filters for that column type will be displayed. Alternatively, the context menu in each column label of the data grid also allows for creating filters with the column name pre-populated.
Available filters vary according to the column type. For example, string columns have filter affordances for: contains, starts or ends with, is empty, or exact matches. Alternatively, numeric columns have logical operations such as: is less than or greater than, is equal to, or is inclusively between two values.