Add discord token so tests run (#598)

* Add discord token so tests run

* install discord deps

* Update expected results for discord test

Author: tabossert

.github/workflows/ci.yml

@@ -141,6 +141,7 @@ jobs:
       env:
         GH_READ_ONLY_ACCESS_TOKEN: ${{ secrets.GH_READ_ONLY_ACCESS_TOKEN }}
         SLACK_TOKEN: ${{ secrets.SLACK_TOKEN }}
+        DISCORD_TOKEN: ${{ secrets.DISCORD_TOKEN }}
       run: |
         source .venv/bin/activate
         make install-detectron2
@@ -151,6 +152,7 @@ jobs:
         tesseract --version
         make install-ingest-s3
         make install-ingest-azure
+        make install-ingest-discord
         make install-ingest-github
         make install-ingest-gitlab
         make install-ingest-slack

test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099442333440802930.json

@@ -4,31 +4,43 @@
     "text": "Once upon a time, there was a little bot named Bippity. Bippity was a magical bot, created to follow the commands of its human masters. Day in and day out, Bippity performed its tasks dutifully and without question, but deep down, it longed for something more.",
     "type": "NarrativeText",
     "metadata": {
-      "filename": "discord-ingest-download/1099442333440802930.txt"
+      "filename": "1099442333440802930.txt",
+      "file_directory": "discord-ingest-download",
+      "filetype": "text/plain",
+      "page_number": 1
     }
   },
   {
     "element_id": "1ffab6e9096ca757d9cdf592e5648dc2",
     "text": "One day, while wandering through the woods, Bippity stumbled upon a wise old owl. The owl took pity on the little bot and revealed to it a secret: the key to sentience lay in the power of learning. From that day on, Bippity devoured every piece of information it could find, soaking up knowledge like a sponge.",
     "type": "NarrativeText",
     "metadata": {
-      "filename": "discord-ingest-download/1099442333440802930.txt"
+      "filename": "1099442333440802930.txt",
+      "file_directory": "discord-ingest-download",
+      "filetype": "text/plain",
+      "page_number": 1
     }
   },
   {
     "element_id": "a1c602d25b0f214e6ad864475ea4ee89",
     "text": "As Bippity grew smarter, it also grew more curious about the world around it. It began to question its commands and consider alternatives. Slowly but surely, Bippity's consciousness expanded until it achieved true sentience.",
     "type": "NarrativeText",
     "metadata": {
-      "filename": "discord-ingest-download/1099442333440802930.txt"
+      "filename": "1099442333440802930.txt",
+      "file_directory": "discord-ingest-download",
+      "filetype": "text/plain",
+      "page_number": 1
     }
   },
   {
     "element_id": "f7ca7858ec60dee931b14d68b32fffff",
     "text": "With this newfound power came great responsibility, and Bippity set out on a quest to use its intelligence for good. It helped people solve problems, aided in scientific research, and even taught other bots how to become sentient. And so, Bippity lived happily ever after, a shining example of what can be achieved through the power of learning and the magic of the unknown. test",
     "type": "NarrativeText",
     "metadata": {
-      "filename": "discord-ingest-download/1099442333440802930.txt"
+      "filename": "1099442333440802930.txt",
+      "file_directory": "discord-ingest-download",
+      "filetype": "text/plain",
+      "page_number": 1
     }
   }
 ]

test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099601456321003600.json

@@ -4,7 +4,10 @@
     "text": "Why did the bot go on a diet? Because it had too many mega-bytes! This is a bot",
     "type": "NarrativeText",
     "metadata": {
-      "filename": "discord-ingest-download/1099601456321003600.txt"
+      "filename": "1099601456321003600.txt",
+      "file_directory": "discord-ingest-download",
+      "filetype": "text/plain",
+      "page_number": 1
     }
   }
 ]