RAG with a Neo4j Knowledge Graph: How it Works and How to Set It Up

  Переглядів 22,452

Neo4j

Neo4j

День тому

In this video, Philipp Brunenberg explains how RAG (retrieval augmented generation) with a Neo4j Knowledge Graph works and how we can set it up on your laptop. He’ll also give a brief introduction on how we can customize the code from the Gen-AI Stack.
We’ll cover:
What is RAG?
How does RAG with a Neo4j Knowledge Graph work?
What are the benefits of using RAG & Neo4j?
How can I set up RAG with Neo4j using a Llama2 model and the GenAI Stack?
Links:
GenAI Walkthrough: neo4j.com/developer-blog/gena...
Neo4j & GenAI: neo4j.com/generativeai/
Github Repo: github.com/docker/genai-stack
RAG Blogs: neo4j.com/developer-blog/tagg...
LLM Blogs: neo4j.com/developer-blog/tagg...
@philippbrunenberg www.philipp-brunenberg.de/
00:00 Introduction
00:29 What is RAG?
02:09 The Neo4j Vector Store
03:03 Augmenting LLM answers with RAG
04:50 Using the GenAI-Stack
06:37 GenAI-Stack Configuration
08:08 The compose file
09:47 Loading data into Neo4j
11:59 Using the chat frontend
15:30 Conclusion
#neo4j #graphdatabase #knowledgegraph #langchain #genai #rag #ollama

КОМЕНТАРІ: 42
@aaen9417
@aaen9417 4 місяці тому
Thank you for publishing this type of content. This is absolutely amazing!
@AAL3087
@AAL3087 2 місяці тому
Great whirlwind tour to present a concrete understading of RAG with knowledge graphs in Neo4j. Thanks. Looking forward to exploring this channel more to learn more about RAG/KGs/GenAIStack etc.
@neo4j
@neo4j 2 місяці тому
Thank you very much!
@NelsLindahl
@NelsLindahl 4 місяці тому
Loved this video and the pace!
@neo4j
@neo4j 4 місяці тому
Thank you very much!
@roy.awderby
@roy.awderby 4 місяці тому
Thank you for the deep explanation
@neo4j
@neo4j 4 місяці тому
Thank you!
@deepbayes6808
@deepbayes6808 4 місяці тому
This was really useful., also the presentor did an amazing job. But it was too short. I wish to see a longer more tutorial like version of it too. Or to have links to relevant knowledge and tutorials.
@neo4j
@neo4j 3 місяці тому
Thank you very much! we have some more in-depth material on our blog. Check the links in the video description
@kenchang3456
@kenchang3456 4 місяці тому
Thanks for this robust example.
@neo4j
@neo4j 3 місяці тому
Thank you!
@joshuacunningham7912
@joshuacunningham7912 2 місяці тому
Excellent video. Thank you.
@neo4j
@neo4j 2 місяці тому
Thank you!
@jacobschuster5261
@jacobschuster5261 4 місяці тому
Brilliant, thank you!
@neo4j
@neo4j 4 місяці тому
Thanks! Glad you like it
@armelhyacinthe6173
@armelhyacinthe6173 4 місяці тому
Thank you ❤
@neo4j
@neo4j 4 місяці тому
You're welcome! Glad it is helpful
@tecnopadre
@tecnopadre 20 днів тому
It would be really useful to do this video adding how to convert the unstructured data to KG and the use it on a RAG. Step by step it's what makes people use Neo4j more. Thank you!
@neo4j
@neo4j 19 днів тому
Thank you for the suggestion!
@alimahmoudmansour9681
@alimahmoudmansour9681 4 місяці тому
Thank you so much
@neo4j
@neo4j 4 місяці тому
Glad it is helpful!
@RajendraKadam725
@RajendraKadam725 2 місяці тому
Thanks for sharing the video @neo4j. By the way, both responses provided in the video were inaccurate. Why wasn't the correct answer generated? 🤔
@neo4j
@neo4j 2 місяці тому
sorry - can you share the timestamp where you think the answers were wrong?
@allminhuman2602
@allminhuman2602 4 місяці тому
Great video! What would be the minimum recommended system specs for this to work?
@neo4j
@neo4j 4 місяці тому
Thank you! Any relatively modern laptop should work to give it a go and do a test-run.
@D1zZit
@D1zZit 3 місяці тому
Amazing! Planning on integrating this with my neo4j db which has 1 billion relationships, might be pushing the limits a bit 🤣🤣
@neo4j
@neo4j 3 місяці тому
let us know how it goes :)
@samreenkhan4994
@samreenkhan4994 Місяць тому
did it work ?
@D1zZit
@D1zZit Місяць тому
@@samreenkhan4994 Querying and using RAG on the database itself worked. Generating embeddings with FAST-RP did not despite the powerful specs of hardware. Instead had to generate embeddings on a condensed data form with many missing properties. Still working it out.
@leonh-kd3cm
@leonh-kd3cm Місяць тому
It is still not clear whether at the final stage what input do you provide to LLM to get the final question: - Original Question text - Text extracted from the KG nodes/edges - SO, you do not provide text associated with the best K answers resulted form initial generation of embeddings from the user prompt? ...and how to you compose the text extracted from the nodes? What is the technique?
@MatanItah
@MatanItah 25 днів тому
About how long can we expect the StackOverflow loader to import using the settings in the video to run?
@henkhbit5748
@henkhbit5748 4 місяці тому
Great video, I have Windows and ollama is not for windows yet. Can I run the docker under wsl2?
@nbbhaskar3294
@nbbhaskar3294 Місяць тому
I have wsl2 docker setup in my windows and I am able to run ollama successfully.
@podunkman2709
@podunkman2709 4 місяці тому
This is only demo of some commercial product? Can I use it within company to build some service?
@neo4j
@neo4j 4 місяці тому
the stack is based on open-source components which you can use to build your own product/servcice
@podunkman2709
@podunkman2709 2 місяці тому
Is there any loader ready to insert own data (csv or else - not pdf) instead of stackOverflow?
@neo4j
@neo4j 2 місяці тому
not as such, but the repo is available and you can modify the loader to take on other data: github.com/docker/genai-stack
@davidecacozza392
@davidecacozza392 2 місяці тому
Hi! It is possible to use an own neo4j graph?
@neo4j
@neo4j 2 місяці тому
yeah, totally - check out our recent Going Meta Episodes ( neo4j.com/video/going-meta-a-series-on-graphs-semantics-and-knowledge/ ) or our Courses on GraphAcademy ( graphacademy.neo4j.com/ )
@samreenkhan4994
@samreenkhan4994 Місяць тому
did u try? if yes, then how
@Aristocle
@Aristocle Місяць тому
How can I load PDF, markdown, into Neo4j?
@neo4j
@neo4j 19 днів тому
not directly, see this community post for a few pointers: community.neo4j.com/t/loading-pdf-or-doc-content-into-neo4j/8967 this doesnt cover AI assisted tools which you can use these days for similar results
Best of NODES 2023 - GenAI
1:00:31
Neo4j
Переглядів 935
Пескоструйный АППАРАТ! #shorts
01:00
Гараж 54
Переглядів 2,8 млн
Bro smelt it & passed out 😂 #comedy
00:10
MrTalalaa
Переглядів 7 млн
Помилка,  яку зробило військове керівництво 🙄
01:00
Радіо Байрактар
Переглядів 371 тис.
Этого От Него Никто Не Ожидал 😂
00:19
Глеб Рандалайнен
Переглядів 5 млн
Reliable, fully local RAG agents with LLaMA3
21:19
LangChain
Переглядів 58 тис.
Top 6 Tools to Turn Code into Beautiful Diagrams
3:24
ByteByteGo
Переглядів 489 тис.
What is a graph database? (in 10 minutes)
10:58
Neo4j
Переглядів 182 тис.
How to AUTOMATE LINKEDIN POSTS with CrewAI | CrewAI Tutorial
22:39
The Neural Maze
Переглядів 2,9 тис.
Convert Any Text into a Knowledge Graph
30:52
Hands-on AI
Переглядів 3,8 тис.
Is Tree-based RAG Struggling? Not with Knowledge Graphs!
9:06
Diffbot
Переглядів 21 тис.
Advanced RAG with Knowledge Graphs (Neo4J demo)
8:41
Johannes Jolkkonen | Funktio AI
Переглядів 34 тис.
The Future of Knowledge Graphs in a World of Large Language Models
28:29
Denny Vrandečić
Переглядів 34 тис.
All Learning Algorithms Explained in 14 Minutes
14:10
CinemaGuess
Переглядів 86 тис.
Local GenAI LLMs with Ollama and Docker (Ep 262)
1:06:43
Bret Fisher Docker and DevOps
Переглядів 4,4 тис.
Тестируем Gravis Ultrasound... ну почти.
48:18
Дмитрий Бачило
Переглядів 31 тис.
Распаковка айфона под водой!💦(🎥: @saken_kagarov on IG)
0:20
Взрывная История
Переглядів 10 млн
All New Atlas | Boston Dynamics
0:40
Boston Dynamics
Переглядів 5 млн
iPhone 15 Precision Finding | Find Your Friends | Apple
2:52