Mismatch in Length of Values and Index in generate_text_embeddings

[zz44l43]

Encountered an error when running the generate_text_embeddings function in the pipeline. The error log indicates a mismatch between the length of values (338) and the index (366) when attempting to set values in a DataFrame.

Error Details: The error traceback provided below highlights the issue occurring within the generate_text_embeddings function in generate_text_embeddings.py:
ValueError: Length of values (338) does not match length of index (366)

pipeline with the following steps:

create_base_text_units
create_base_entity_graph
create_final_entities
create_final_nodes
create_final_communities
create_final_relationships
create_final_text_units
create_final_community_reports
create_final_documents
generate_text_embeddings

The pipeline fails at the generate_text_embeddings step with the error message.

Using azure for both llm and embedding with text-embedding-ada-002