Skip to content

Latest commit

 

History

History
323 lines (226 loc) · 17.7 KB

File metadata and controls

323 lines (226 loc) · 17.7 KB

Gen AI Roadmap for Everyone - 2024


     


Useful resources curated from the internet and created by various good creators. I believe this should be sufficient to gain a strong hold on GenAI-related tasks, likely more than 85% of the time. While this field is changing rapidly, the fundamentals remain the same. Avoid getting distracted by the constant influx of new models and technologies. Focus on mastering GenAI fundamentals and start building projects alongside your learning. Implementing what you learn will solidify your understanding. Dedicate at least one hour every day to GenAI, and you will have a strong grasp of the tech stack within 1-2 months.

Learning GenAI is now essential as it integrates into all aspects of software engineering and will soon be a mandatory requirement for all positions. Be prepared—it's easier to learn than you might think.

PS: I planned to create a new playlist on my GenAI learning, where I am working on 7-8 projects, including 3 in production, but unavoidable personal and professional circumstances delayed this. I will try to record YouTube videos in the coming months to share insights from my 15+ months of experience in GenAI development.



🚀 GenAI Crash Course for Beginners (Optional) (~3 Hrs)

This is a nice video to refresh your high-level overview of generative AI in brief. This is optional.

  • YouTube
  • Replace the OpenAI LLM used anywhere with the free Google’s Gemini Pro API-based LLM.
    • YouTube - How to setup Google's free Gemini Pro API Key
    • Note: To access the Gemini Model via Google AI, you only need a Google account and an API key. A Google Cloud account is not required. It's easy and straightforward as shown in the above yt video.

📚 Fundamentals of GenAI (1.2 Hr)

  • YouTube - Generative AI in Nutshell

  • YouTube - Intro to GenAI

  • YouTube - What is LLM

    Optional

  • YouTube - What is LLM

  • Useful LLM Concepts


🤖 What is GPT? (28 Min)

  • YouTube

⚡What is Transformer? (10 Min)

  • YouTube

📜 Python

  • YouTube - Python Core Crash Course (1 Hr)
  • YouTube - Python DS Crash Course (49 Min)

☁️ Understanding Google Colab (22 Min)

  • YouTube

🛠️ Why should you use Open Source LLM? (7 Min)

  • YouTube

🤗 Huggingface Open Source Models (34 Min)


🏠 Running LLM Locally using Ollama (~ 1.5 Hr)

  • YouTube

Some Cool examples (18 Min)

  • YouTube

🔗 LangChain

I prefer going through the LangChain documentation, which is well-written and includes example notebooks, as it updates very quickly. Referring to most of the LangChain YouTube videos might give you outdated content after a few weeks.


🎯 Prompt Engineering


📊 What is Vector Database?


🗺️ What is Vector Embedding?


📖 RAG Tutorials (~2 Hr)


⚖️ RAG Vs Prompt Engineering Vs Fine Tuning (15 Min)

  • YouTube

🔧 Fine Tuning LLM (~4 Hr)

  • YouTube

🤖 LLM Agents


🔀 What is MultiModel? (7 Min)


🧠 What is Mixture of Experts (MoE) (~30 Min)


🎨 Streamlit for fast prototype UI


📚 GenAI Use Cases (Used free Gemini Pro & huggingface LLMs only)

  • YouTube - How to setup Google Colab Notebook for free GPU
  • YouTube - How to setup Google's free Gemini Pro API Key
  • YouTube - Conversational Analytics (Full Stack GenAI App using React, MongoDB, Free Gemini Pro LLM, Docker, Authentication & Authorisation using JWT oken)
  • YouTube - Chat with Graph Database (Neo4j Graph Database, Gemini Pro LLM & Streamlit UI)
  • YouTube - Machine Translation (Gemini Pro LLM & Streamlit UI)
  • YouTube - Tagging (Gemini Pro LLM & Streamlit UI)
  • Webscraping (Gemini Pro LLM & Streamlit UI)
  • YouTube - Chatbot with SQL Database (Huggingface Opensource LLM & Streamlit UI)
  • YouTube - Chatbot with CSV (Huggingface Opensource LLM)
  • YouTube - Text to SQL generation (Huggingface Opensource LLM)
  • YouTube - Text Summarization (Huggingface Opensource LLM)
  • YouTube - Fully local RAG Agent with Llama3.1 (By LangChain Team)

🔍 LLM Evaluation


🏭 LLMOPs & Productionization of GenAI applications


📖 GenAI Glossary of terms


📝 GenAI Interview Questions & Answers


💻 GenAI Coding Round Preparation


🏆 LLM Leaderboard & Benchmarks


🤝 Contributing

Contributions to add good impactful resources/codes to the list are welcome!

Here’s how you can help:

  1. Fork the Repository

    Click on the "Fork" button at the top right corner of the page to create a personal copy of the repository.

  2. Clone the Repository

    Clone your forked repository to your local machine:

    git clone https://github.com/genieincodebottle/generative-ai.git
  3. Create a New Branch

    Create a new branch for your feature or bug fix:

    git checkout -b your-branch-name
  4. Make Your Changes

    Make your changes and commit them with a clear message:

    git commit -m "Brief description of your changes"
  5. Push Your Changes Push your changes to your forked repository:

    git push origin your-branch-name
  6. Create a Pull Request

    Go to the original repository and create a pull request. Make sure to explain your changes and why they should be merged.

Hi 👋, I am Rajesh Srivastava

Lead Data Scientist | Coder

Connect with me

genieincodebottle genieincodebottle genieincodebottle https://discord.gg/CUUeZvmP5j


Doc Updation History

  • 31 May 2024 - Added Multimodel doc
  • 01 Jun 2024
    • Added resources related LLM Evaluation
    • Added resources related LLMOPs
  • 11 Jun 2024
    • Added GenAI & LLM Essential Terms
  • 07 Jul 2024
    • Added LLM Ledaerboard links & benchmarks
  • 16 Jul 2024
    • Added resource related Graph RAG
    • Updated Interview pdf with Advance Topics
  • 19 Jul 2024
    • Added resource related GenAI Coding round preparation
  • 31 Jul 2024
    • Added Conversational Analytics project repo link
  • 01 Aug 2024
    • Organised the doc and some formatting