Haystack 教程
Haystack 是一个由 deepset 开发的开源框架,用于构建适用于生产的大语言模型(LLM)应用程序、检索增强生成流水线和最先进的搜索系统,以便在大规模文档集合上智能运作。它让你可以快速尝试最新的自然语言处理(NLP)模型,同时具有灵活性且易于使用。
这是我们存放所有 Haystack 教程的存储库📓 👇这些教程也在 Haystack 网站上发布。
要为教程做贡献,请查阅我们的贡献指南。
教程
Haystack 1.x
|
Haystack 2.0
|
---|
| 代码 | Colab | 代码 | Colab |
| :-------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :--------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| [构建您的第一个问答系统](./tutorials/01_Basic_QA_Pipeline.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/01_Basic_QA_Pipeline.ipynb) | [您的第一个带有检索增强的问答管道](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/27_First_RAG_Pipeline.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/27_First_RAG_Pipeline.ipynb) |
| [在您的数据上微调模型](./tutorials/02_Finetune_a_model_on_your_data.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/02_Finetune_a_model_on_your_data.ipynb) | [使用循环自动校正生成结构化输出](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/28_Structured_Output_With_Loop.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/28_Structured_Output_With_Loop.ipynb) |
| [构建可扩展的问答系统](./tutorials/03_Scalable_QA_System.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/03_Scalable_QA_System.ipynb) | [管道序列化](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/29_Serializing_Pipelines.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/29_Serializing_Pipelines.ipynb) |
| [FAQ 样式问答](./tutorials/04_FAQ_style_QA.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/04_FAQ_style_QA.ipynb) | [预处理不同文件类型](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/30_File_Type_Preprocessing_Index_Pipeline.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/30_File_Type_Preprocessing_Index_Pipeline.ipynb) |
| [评估](./tutorials/05_Evaluation.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/05_Evaluation.ipynb) | [元数据过滤](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/31_Metadata_Filtering.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/31_Metadata_Filtering.ipynb) |
| [通过嵌入检索提高检索效果](./tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb) | [按语言分类文档和查询](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb)| [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb)|
| [[已过时] RAG生成器](./tutorials/07_RAG_Generator.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/07_RAG_Generator.ipynb) | [创建混合检索管道](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/33_Hybrid_Retrieval.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/33_Hybrid_Retrieval.ipynb) |
| [预处理](./tutorials/08_Preprocessing.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/08_Preprocessing.ipynb) | [构建一个摘录式问答管道](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/34_Extractive_QA_Pipeline.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/34_Extractive_QA_Pipeline.ipynb) |
| [DPR 训练](./tutorials/09_DPR_training.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/09_DPR_training.ipynb) | [评估 RAG 管道](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/35_Evaluating_RAG_Pipelines.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/35_Evaluating_RAG_Pipelines.ipynb)|
| [[已过时] 知识图谱](./tutorials/10_Knowledge_Graph.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/10_Knowledge_Graph.ipynb) | [通过条件路由构建管道](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/36_Building_Fallbacks_with_Conditional_Routing.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/36_Building_Fallbacks_with_Conditional_Routing.ipynb)|
| [管道](./tutorials/11_Pipelines.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/11_Pipelines.ipynb) | [[已过时] 通过多路复用器简化管道输入](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/37_Simplifying_Pipeline_Inputs_with_Multiplexer.ipynb)| [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/37_Simplifying_Pipeline_Inputs_with_Multiplexer.ipynb)|
| [[已过时] Seq2Seq生成器](./tutorials/12_LFQA.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/12_LFQA.ipynb) | [嵌入元数据以改进检索](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/39_Embedding_Metadata_for_Improved_Retrieval.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/39_Embedding_Metadata_for_Improved_Retrieval.ipynb)|
| [问题生成](./tutorials/13_Question_generation.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/13_Question_generation.ipynb) | [通过函数调用构建聊天应用程序](https://raw.githubusercontent.com/deepset-ai/haystack-tutorials/main/tutorials/40_Building_Chat_Application_with_Function_Calling.ipynb)| [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/40_Building_Chat_Application_with_Function_Calling.ipynb)|
| [查询分类器](./tutorials/14_Query_Classifier.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/14_Query_Classifier.ipynb) | | |
| [表格问答](./tutorials/15_TableQA.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/15_TableQA.ipynb) | | |
| [索引时的文档分类器](./tutorials/16_Document_Classifier_at_Index_Time.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/16_Document_Classifier_at_Index_Time.ipynb) | | |
| [让您的问答管道能说话!](./tutorials/17_Audio.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/17_Audio.ipynb) | | |
| [生成伪标签](./tutorials/18_GPL.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/18_GPL.ipynb) | | |
| [文本到图像搜索](./tutorials/19_Text_to_Image_search_pipeline_with_MultiModal_Retriever.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/19_Text_to_Image_search_pipeline_with_MultiModal_Retriever.ipynb) | | |
| [使用Haystack与REST API](./tutorials/20_Using_Haystack_with_REST_API.ipynb) | | | |
| [自定义PromptNode](./tutorials/21_Customizing_PromptNode.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/21_Customizing_PromptNode.ipynb) | | |
| [基于检索增强的生成型QA管道](./tutorials/22_Pipeline_with_PromptNode.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/22_Pipeline_with_PromptNode.ipynb) | | |
| [用Agents回答复杂问题](./tutorials/23_Answering_Multihop_Questions_with_Agents.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/23_Answering_Multihop_Questions_with_Agents.ipynb) | | |
| [构建对话式聊天应用](./tutorials/24_Building_Chat_App.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/24_Building_Chat_App.ipynb) | | |
| [自定义Agent与您的文档聊天](./tutorials/25_Customizing_Agent.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/25_Customizing_Agent.ipynb) | | |
| [创建混合检索管道](./tutorials/26_Hybrid_Retrieval.ipynb) | [![在Colab中打开](https://yellow-cdn.veclightyear.com/2b54e442/6c4139eb-1a85-4353-af58-72c1cdeddaa3.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/26_Hybrid_Retrieval.ipynb) | | |