Converting from LDIF Format to Haystack Documents

[mjackstewart1]

Hello, everyone!

I'm trying to convert directory data in the LDIF (LDAP directory interchange format) format into Haystack document format dicts.

However, I don't know where to begin.

My data looks like this:

group {
  'name': 'MyGroup',
  'members': ['user1', 'user2'],
  'owners': ['user3', 'user4']
}

I can't visualize how to put it into the Haystack document format:

docs = [
    {
        'content': DOCUMENT_TEXT_HERE,
        'meta': {'name': DOCUMENT_NAME, ...}
    }, ...
]

Any help you can lend me would be greatly appreciated.

Most cordially,
Jack Stewart
[email protected]

[masci]

Hi @mjackstewart1

this is more about pre-processing your data rather than a specific Haystack problem. I would simply create a conversion script that reads the original file and creates a Document but again, it's more about Python. If you have an example file with no sensitive data to share we can give it a stab.