mirror of
https://github.com/langgenius/dify-docs.git
synced 2026-03-26 13:18:34 +07:00
9c99d0e19c
* Add knowledge pipeline page * Add page knowledge orchestration * Complete en & zh version for knowledge pipeline * renew en. version of knowledge pipeline * Complete Ch and Jp * Modify styles * Update create-knowledge-pipeline.mdx RAG related updates: Change DSL into Pipeline. * Update create-knowledge-pipeline.mdx * Update create-knowledge-pipeline.mdx --------- Co-authored-by: Hanqing Zhao <sherry9277@gmail.com>
51 lines
2.3 KiB
Plaintext
51 lines
2.3 KiB
Plaintext
---
|
||
title: Create from Knowledge Pipeline
|
||
---
|
||
|
||
A knowledge pipeline is a document processing workflow that transforms raw data into searchable knowledge bases. Think of orchestrating a workflow, now you can visually combine and configure different processing nodes and tools to optimize data processing for better accuracy and relevance.
|
||
|
||
Every knowledge pipeline normally follows a structured flow through four key steps:
|
||
|
||
**Data Sources → Data Extraction → Data Processing → Knowledge Storage**
|
||
|
||
Each step serves a specific purpose: gathering content from various sources, converting it to processable text, refining it for search, and storing it in a format that enables fast, accurate retrieval.
|
||
|
||
Dify provides built-in pipeline templates that is optimized for certain use cases, or you can also create knowledge pipelines from scratch. In this session, we will go through creating options, general process of building knowledge pipelines, and how to manage it.
|
||
|
||
<Steps>
|
||
<Step>
|
||
<Card title="Step 1: Create Knowledge Pipeline" horizontal href="./create-knowledge-pipeline">
|
||
Start from built-in templates, blank knowledge pipeline or import existing pipeline.
|
||
</Card>
|
||
</Step>
|
||
<Step>
|
||
<Card title="Step 2: Orchestrate Knowledge Pipeline" horizontal href="./knowledge-pipeline-orchestration">
|
||
Get to know how the knowledge pipeline works, orchestrate different nodes and make sure it’s ready to use.
|
||
</Card>
|
||
</Step>
|
||
<Step>
|
||
<Card title="Step 3: Publish Knowledge Pipeline" horizontal href="./publish-knowledge-pipeline">
|
||
Let's make it ready for document processing.
|
||
</Card>
|
||
</Step>
|
||
<Step>
|
||
<Card title="Step 4: Upload Files" horizontal href="./upload-files">
|
||
Add documents and process them into the searchable knowledge base.
|
||
</Card>
|
||
</Step>
|
||
<Step>
|
||
<Card title="Step 5: Manage and Use Knowledge Base" horizontal href="./manage-knowledge-base">
|
||
Maintain documents, test retrieval, modify settings, and more.
|
||
</Card>
|
||
</Step>
|
||
</Steps>
|
||
|
||
{/*
|
||
Contributing Section
|
||
DO NOT edit this section!
|
||
It will be automatically generated by the script.
|
||
*/}
|
||
|
||
---
|
||
|
||
[Edit this page](https://github.com/langgenius/dify-docs/edit/main/en/guides/knowledge-base/knowledge-pipeline/create-from-knowledge-pipeline.mdx) | [Report an issue](https://github.com/langgenius/dify-docs/issues/new?template=docs.yml) |