|
| 1 | += ColBERT in RAGStack with Astra |
| 2 | + |
| 3 | +image::https://colab.research.google.com/assets/colab-badge.svg[align="left",link="https://colab.research.google.com/github/datastax/ragstack-ai/blob/main/examples/notebooks/RAGStackColBERT.ipynb"] |
| 4 | + |
| 5 | +Use ColBERT, Astra DB, and RAGStack to: |
| 6 | + |
| 7 | +. Create ColBERT embeddings |
| 8 | +. Index embeddings on Astra |
| 9 | +. Retrieve embeddings with RAGStack and Astra |
| 10 | +. Use the LangChain ColBERT retriever plugin |
| 11 | + |
| 12 | +== Prerequisites |
| 13 | + |
| 14 | +Import the ragstack-ai-colbert package: |
| 15 | +[source,python] |
| 16 | +---- |
| 17 | +pip install ragstack-ai-colbert |
| 18 | +---- |
| 19 | + |
| 20 | +== Prepare data and create embeddings |
| 21 | + |
| 22 | +. Prepare documents for chunking. |
| 23 | ++ |
| 24 | +[source,python] |
| 25 | +---- |
| 26 | +arctic_botany_dict = { |
| 27 | + "Introduction to Arctic Botany": "Arctic botany is the study of plant life in the Arctic, a region characterized by extreme cold, permafrost, and minimal sunlight for much of the year. Despite these harsh conditions, a diverse range of flora thrives here, adapted to survive with minimal water, low temperatures, and high light levels during the summer. This introduction aims to shed light on the resilience and adaptation of Arctic plants, setting the stage for a deeper dive into the unique botanical ecosystem of the Arctic.", |
| 28 | + "Arctic Plant Adaptations": "Plants in the Arctic have developed unique adaptations to endure the extreme climate. Perennial growth, antifreeze proteins, and a short growth cycle are among the evolutionary solutions. These adaptations not only allow the plants to survive but also to reproduce in short summer months. Arctic plants often have small, dark leaves to absorb maximum sunlight, and some species grow in cushion or mat forms to resist cold winds. Understanding these adaptations provides insights into the resilience of Arctic flora.", |
| 29 | + "The Tundra Biome": "The Arctic tundra is a vast, treeless biome where the subsoil is permanently frozen. Here, the vegetation is predominantly composed of dwarf shrubs, grasses, mosses, and lichens. The tundra supports a surprisingly rich biodiversity, adapted to its cold, dry, and windy conditions. The biome plays a crucial role in the Earth's climate system, acting as a carbon sink. However, it's sensitive to climate change, with thawing permafrost and shifting vegetation patterns.", |
| 30 | + "Arctic Plant Biodiversity": "Despite the challenging environment, the Arctic boasts a significant variety of plant species, each adapted to its niche. From the colorful blooms of Arctic poppies to the hardy dwarf willows, these plants form a complex ecosystem. The biodiversity of Arctic flora is vital for local wildlife, providing food and habitat. This diversity also has implications for Arctic peoples, who depend on certain plant species for food, medicine, and materials.", |
| 31 | + "Climate Change and Arctic Flora": "Climate change poses a significant threat to Arctic botany, with rising temperatures, melting permafrost, and changing precipitation patterns. These changes can lead to shifts in plant distribution, phenology, and the composition of the Arctic flora. Some species may thrive, while others could face extinction. This dynamic is critical to understanding future Arctic ecosystems and their global impact, including feedback loops that may exacerbate global warming.", |
| 32 | + "Research and Conservation in the Arctic": "Research in Arctic botany is crucial for understanding the intricate balance of this ecosystem and the impacts of climate change. Scientists conduct studies on plant physiology, genetics, and ecosystem dynamics. Conservation efforts are focused on protecting the Arctic's unique biodiversity through protected areas, sustainable management practices, and international cooperation. These efforts aim to preserve the Arctic flora for future generations and maintain its role in the global climate system.", |
| 33 | + "Traditional Knowledge and Arctic Botany": "Indigenous peoples of the Arctic have a deep connection with the land and its plant life. Traditional knowledge, passed down through generations, includes the uses of plants for nutrition, healing, and materials. This body of knowledge is invaluable for both conservation and understanding the ecological relationships in Arctic ecosystems. Integrating traditional knowledge with scientific research enriches our comprehension of Arctic botany and enhances conservation strategies.", |
| 34 | + "Future Directions in Arctic Botanical Studies": "The future of Arctic botany lies in interdisciplinary research, combining traditional knowledge with modern scientific techniques. As the Arctic undergoes rapid changes, understanding the ecological, cultural, and climatic dimensions of Arctic flora becomes increasingly important. Future research will need to address the challenges of climate change, explore the potential for Arctic plants in biotechnology, and continue to conserve this unique biome. The resilience of Arctic flora offers lessons in adaptation and survival relevant to global challenges." |
| 35 | +} |
| 36 | +arctic_botany_chunks = list(arctic_botany_dict.values()) |
| 37 | +---- |
| 38 | ++ |
| 39 | +. Start the ColBERT configuration and create embeddings. |
| 40 | ++ |
| 41 | +[source,python] |
| 42 | +---- |
| 43 | +from ragstack_colbert import ColbertEmbeddingModel, ChunkData |
| 44 | +# colbert stuff starts |
| 45 | +colbert = ColbertEmbeddingModel() |
| 46 | +
|
| 47 | +chunks = [ChunkData(text=text, metadata={}) for text in arctic_botany_chunks] |
| 48 | +
|
| 49 | +embedded_chunks = colbert.embed_chunks(chunks=chunks, doc_id="arctic botany") |
| 50 | +---- |
| 51 | ++ |
| 52 | +. Examine the embeddings. |
| 53 | ++ |
| 54 | +[source,python] |
| 55 | +---- |
| 56 | +assert len(embedded_chunks) == 8 |
| 57 | +---- |
| 58 | + |
| 59 | +== Create a vector store in Astra |
| 60 | + |
| 61 | +. Ingest embeddings and create a vector store in Astra. |
| 62 | ++ |
| 63 | +[source,python] |
| 64 | +---- |
| 65 | +from ragstack_colbert import CassandraVectorStore |
| 66 | +from getpass import getpass |
| 67 | +import cassio |
| 68 | +
|
| 69 | +keyspace="default_keyspace" |
| 70 | +database_id=getpass("Enter your Astra Database Id:") |
| 71 | +astra_token=getpass("Enter your Astra Token:") |
| 72 | +
|
| 73 | +cassio.init(token=astra_token, database_id=database_id, keyspace=keyspace) |
| 74 | +session=cassio.config.resolve_session() |
| 75 | +
|
| 76 | +db = CassandraVectorStore( |
| 77 | + keyspace = keyspace, |
| 78 | + table_name="colbert_embeddings4", |
| 79 | + session = session, |
| 80 | +) |
| 81 | +---- |
| 82 | ++ |
| 83 | +. Create an index in Astra. |
| 84 | ++ |
| 85 | +[source,python] |
| 86 | +---- |
| 87 | +db.put_chunks(chunks=embedded_chunks, delete_existing=True) |
| 88 | +---- |
| 89 | + |
| 90 | +== Retrieve embeddings from the Astra index |
| 91 | + |
| 92 | +Create a RAGStack retriever and ask questions against the indexed embeddings. |
| 93 | +The library provides: |
| 94 | + |
| 95 | +* Embed query tokens |
| 96 | +* Generate candidate documents using Astra ANN search |
| 97 | +* Max similarity scoring |
| 98 | +* Ranking |
| 99 | + |
| 100 | +[source,python] |
| 101 | +---- |
| 102 | +import logging |
| 103 | +import nest_asyncio |
| 104 | +nest_asyncio.apply() |
| 105 | +
|
| 106 | +logging.getLogger('cassandra').setLevel(logging.ERROR) # workaround to suppress logs |
| 107 | +from ragstack_colbert import ColbertRetriever |
| 108 | +retriever = ColbertRetriever( |
| 109 | + vector_store=db, embedding_model=colbert |
| 110 | +) |
| 111 | +
|
| 112 | +answers = retriever.retrieve("What's artic botany", k=2) |
| 113 | +for answer in answers: |
| 114 | + print(f"Rank: {answer.rank} Score: {answer.score} Text: {answer.data.text}\n") |
| 115 | +---- |
| 116 | + |
| 117 | +.Result |
| 118 | +[source, plain] |
| 119 | +---- |
| 120 | +Rank: 1 Score: 35.225955963134766 Text: Arctic botany is the study of plant life in the Arctic, a region characterized by extreme cold, permafrost, and minimal sunlight for much of the year. Despite these harsh conditions, a diverse range of flora thrives here, adapted to survive with minimal water, low temperatures, and high light levels during the summer. This introduction aims to shed light on the resilience and adaptation of Arctic plants, setting the stage for a deeper dive into the unique botanical ecosystem of the Arctic. |
| 121 | +
|
| 122 | +Rank: 2 Score: 29.655662536621094 Text: Research in Arctic botany is crucial for understanding the intricate balance of this ecosystem and the impacts of climate change. Scientists conduct studies on plant physiology, genetics, and ecosystem dynamics. Conservation efforts are focused on protecting the Arctic's unique biodiversity through protected areas, sustainable management practices, and international cooperation. These efforts aim to preserve the Arctic flora for future generations and maintain its role in the global climate system. |
| 123 | +---- |
| 124 | + |
| 125 | +== LangChain retriever |
| 126 | + |
| 127 | +Alternatively, use the ColBERT extra with your RAGStack package to retrieve documents. |
| 128 | + |
| 129 | +. Install the RAGStack LangChain package with the ColBERT extra. |
| 130 | ++ |
| 131 | +[source,python] |
| 132 | +---- |
| 133 | +pip install ragstack-ai-langchain[colbert] |
| 134 | +---- |
| 135 | ++ |
| 136 | +. Run the LangChain retriever against the indexed embeddings. |
| 137 | ++ |
| 138 | +[source,python] |
| 139 | +---- |
| 140 | +from ragstack_langchain.colbert import ColbertLCRetriever |
| 141 | +
|
| 142 | +lc_retriever = ColbertLCRetriever(retriever, k=2) |
| 143 | +docs = lc_retriever.get_relevant_documents("what kind fish lives shallow coral reefs atlantic, india ocean, red sea, gulf of mexico, pacific, and arctic ocean") |
| 144 | +print(f"first answer: {docs[0].page_content}") |
| 145 | +---- |
| 146 | ++ |
| 147 | +.Result |
| 148 | +[source,plain] |
| 149 | +---- |
| 150 | +.... |
| 151 | +first answer: Despite the challenging environment, the Arctic boasts a significant variety of plant species, each adapted to its niche. From the colorful blooms of Arctic poppies to the hardy dwarf willows, these plants form a complex ecosystem. The biodiversity of Arctic flora is vital for local wildlife, providing food and habitat. This diversity also has implications for Arctic peoples, who depend on certain plant species for food, medicine, and materials. |
| 152 | +.... |
| 153 | +---- |
0 commit comments