-
Notifications
You must be signed in to change notification settings - Fork 319
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
docs: refactor project name to featinsight (#3710)
* Add faq and use cases for feature platform * Refine faq and use case docs * Remove deprecated file * Rename feature-platform to FeatInsight * Fix index * Fix index
- Loading branch information
1 parent
dfea73f
commit dfd860e
Showing
102 changed files
with
344 additions
and
73 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,38 @@ | ||
# 常见问题 | ||
|
||
## FeatInsight 和主流 Feature Store 有什么区别? | ||
|
||
主流 Feature Store 包括 Feast、Tecton、Feathr 等提供了特征管理和计算能力,在线存储主要使用 Redis 等预聚合 Key-value 存储。FeatInsight 提供的是实时计算特征的能力,特征抽取方案无论怎样修改都可以直接一键上线而不需要重新上线和同步在线数据。主要的功能对比如下。 | ||
|
||
| 特征存储系统 | Feast | Tecton | Feathr | FeatInsight | | ||
| ----------------- | ------------------ | ----------------- | ----------------- | ----------------- | | ||
| 数据源支持 | 多种数据源 | 多种数据源 | 多种数据源 | 多种数据源 | | ||
| 可扩展性 | 高 | 高 | 中到高 | 高 | | ||
| 实时特征服务 | 支持 | 支持 | 支持 | 支持 | | ||
| 批处理特征服务 | 支持 | 支持 | 支持 | 支持 | | ||
| 特征转换 | 支持基本转换 | 支持复杂转换和 SQL | 支持复杂转换 | 支持复杂转换和 SQL | | ||
| 数据存储 | 支持多种存储选项 | 主要支持云存储 | 支持多种存储选项 | 内置高性能时序数据库,支持多种存储选项 | | ||
| 社区和支持 | 开源社区 | 商业支持 | 开源社区 | 开源社区 | | ||
| 实时特征计算 | 不支持 | 不支持 | 不支持 | 支持 | | ||
|
||
## 部署 FeatInsight 是否需要 OpenMLDB ? | ||
|
||
需要,因为 FeatInsight 的元数据存储以及特征计算依赖 OpenMLDB 集群,因此部署 FeatInsight 需要提前部署 OpenMLDB 集群,也可以使用整合两者的 [Docker 镜像](./install/docker.md)一键部署。 | ||
|
||
使用 FeatInsight 后用户可以不依赖 OpenMLDB CLI 或 SDK 来实现特征的开发和上线,通过 Web 界面就可以完成特征工程的所有上线需求。 | ||
|
||
## 如何基于 FeatInsight 实现 MLOps 工作流? | ||
|
||
使用 FeatInsight 可以在 Web 前端完成数据库、数据表的创建,然后提交在线数据和离线数据的导入工作。使用 OpenMLDB SQL 语法进行数据的探索以及特征的创建,然后就可以离线特征的导出以及在线特征的一键上线,从 MLOps 对离线到在线流程不需要任何额外的开发工作,具体流程可参考[快速入门](./quickstart.md)。 | ||
|
||
## FeatInsight 的生态集成支持如何? | ||
|
||
FeatInsight 依托于 OpenMLDB 生态,支持与 OpenMLDB 生态中的其他组件进行集成。 | ||
|
||
例如与 OpenMLDB 生态中的数据集成组件进行集成,支持 [Kafka](../../integration/online_datasources/kafka_connector_demo.md)、[Pulsar](../../integration/online_datasources/pulsar_connector_demo.md)、[RocketMQ](../../integration/online_datasources/rocketmq_connector.md)、[Hive](../../integration/offline_data_sources/hive.md)、[Amazon S3](../../integration/offline_data_sources/s3.md),调度系统支持 [Airflow](../../integration/deploy_integration/airflow_provider_demo.md)、[DolphinScheduler](../../integration/deploy_integration/dolphinscheduler_task_demo.md)、[Byzer](../../integration/deploy_integration/OpenMLDB_Byzer_taxi.md) 等,对于 Spark Connector 支持的 HDFS、Iceberg 等和云计算相关的 Kubernetes、阿里云 MaxCompute 等也有一定程度的支持。 | ||
|
||
## FeatInsight 有什么业务价值和技术含量? | ||
|
||
相比于使用 HDFS 存储离线数据、Redis 存储在线数据的简易版 Feature Store,FeatInsight 的价值在于使用了 OpenMLDB SQL 这种在线离线一致性的特征抽取语言。对于特征开发的科学家,只需要编写 SQL 逻辑就可以完成特征定义,在离线场景下这个 SQL 会被翻译成分布式 Spark 应用来执行,在在线场景下同样的 SQL 会被翻译成在线时序数据库的查询语句来执行,实现特征的在线和离线一致性。 | ||
|
||
目前 SQL 编译器、在线存储引擎、离线计算引擎都是基于 C++ 和 Scala 等编程语言实现的,对于非技术背景的科学家来说,使用 SQL 语言来定义特征开发流程,可以降低学习成本,提高开发效率。所有代码都是开源可用,OpenMLDB 项目地址 https://github.com/4paradigm/openmldb ,FeatInsight 项目地址 https://github.com/4paradigm/FeatInsight 。 |
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -3,7 +3,7 @@ | |
|
||
## 介绍 | ||
|
||
OpenMLDB 特征平台在前端支持数据导入相关功能,功能如下: | ||
FeatInsight 在前端支持数据导入相关功能,功能如下: | ||
|
||
* 数据库管理 | ||
* 创建数据库 | ||
|
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
4 changes: 2 additions & 2 deletions
4
...m/feature_platform/install/config_file.md → ...ystem/feat_insight/install/config_file.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,46 @@ | ||
# Docker | ||
|
||
## 介绍 | ||
|
||
使用官方构建好的 Docker 镜像, 可以快速部署 OpenMLDB 特征服务. | ||
|
||
## 内置 OpenMLDB 镜像 | ||
|
||
使用内置 OpenMLDB 的镜像,可以一键启动 OpenMLDB 集群和 OpenMLDB 特征服务,无需额外部署即可使用特征服务。 | ||
|
||
``` | ||
docker run -d -p 8888:8888 registry.cn-shenzhen.aliyuncs.com/tobe43/portable-openmldb | ||
``` | ||
|
||
启动 OpenMLDB 和 FeatInsight 需要约一分钟,可通过 `docker logs` 查看日志,启动成功后在本地浏览器打开 `http://127.0.0.1:8888` 即可访问 FeatInsight 服务。 | ||
|
||
|
||
## 不包含 OpenMLDB 镜像 | ||
|
||
使用不包含 OpenMLDB 的镜像,需要提前部署 OpenMLDB 集群,然后启动 OpenMLDB 特征服务容器,部署步骤较繁琐但灵活性高。 | ||
|
||
首先参考 [OpenMLDB 部署文档](../../../deploy/index.rst) 提前部署 OpenMLDB 集群。 | ||
|
||
然后参考 [FeatInsight 配置文件](./config_file.md),创建 `application.yml` 配置文件。 | ||
|
||
``` | ||
server: | ||
port: 8888 | ||
openmldb: | ||
zk_cluster: 127.0.0.1:2181 | ||
zk_path: /openmldb | ||
apiserver: 127.0.0.1:9080 | ||
``` | ||
|
||
对于 Linux 操作系统可以使用下面命令启动 FeatInsight 容器. | ||
|
||
``` | ||
docker run -d -p 8888:8888 --net=host -v `pwd`/application.yml:/app/application.yml registry.cn-shenzhen.aliyuncs.com/tobe43/featinsight | ||
``` | ||
|
||
由于 MacOS 通过虚拟机启动 Docker 容器,使用 `--net=host` 参数无法正常工作,需要提前修改配置文件指向正确的 OpenMLDB 服务。 | ||
|
||
``` | ||
docker run -d -p 8888:8888 -v `pwd`/application.yml:/app/application.yml registry.cn-shenzhen.aliyuncs.com/tobe43/featinsight | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -5,8 +5,8 @@ | |
.. toctree:: | ||
:maxdepth: 1 | ||
|
||
package | ||
docker | ||
package | ||
source | ||
config_file | ||
upgrade | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Binary file added
BIN
+464 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/recommend_create_feature.png
Oops, something went wrong.
Binary file added
BIN
+251 KB
...pp_ecosystem/feat_insight/use_cases/images/recommend_create_feature_service.png
Oops, something went wrong.
Binary file added
BIN
+290 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/recommend_create_tables.png
Oops, something went wrong.
Binary file added
BIN
+247 KB
...h/app_ecosystem/feat_insight/use_cases/images/recommend_feature_view_detail.png
Oops, something went wrong.
Binary file added
BIN
+196 KB
...p_ecosystem/feat_insight/use_cases/images/recommend_request_feature_service.png
Oops, something went wrong.
Binary file added
BIN
+431 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/taxi_create_feature.png
Oops, something went wrong.
Binary file added
BIN
+228 KB
.../zh/app_ecosystem/feat_insight/use_cases/images/taxi_create_feature_service.png
Oops, something went wrong.
Binary file added
BIN
+219 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/taxi_create_table.png
Oops, something went wrong.
Binary file added
BIN
+219 KB
.../zh/app_ecosystem/feat_insight/use_cases/images/taxi_export_offline_samples.png
Oops, something went wrong.
Binary file added
BIN
+518 KB
.../zh/app_ecosystem/feat_insight/use_cases/images/taxi_feature_service_detail.png
Oops, something went wrong.
Oops, something went wrong.
Binary file added
BIN
+201 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/taxi_import_offline_data.png
Oops, something went wrong.
Binary file added
BIN
+201 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/taxi_import_online_data.png
Oops, something went wrong.
Binary file added
BIN
+146 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/taxi_offline_samples_data.png
Oops, something went wrong.
Binary file added
BIN
+291 KB
docs/zh/app_ecosystem/feat_insight/use_cases/images/taxi_preview_online_table.png
Oops, something went wrong.
Binary file added
BIN
+385 KB
...zh/app_ecosystem/feat_insight/use_cases/images/taxi_request_feature_service.png
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,9 @@ | ||
============================= | ||
应用案例 | ||
============================= | ||
|
||
.. toctree:: | ||
:maxdepth: 1 | ||
|
||
taxi_tour_duration_prediction | ||
recommend_system |
Oops, something went wrong.