Apple MLX: Build Your Own Private AI Server

  Переглядів 6,907

Mervin Praison

Mervin Praison

17 днів тому

👋 Hi everyone! In today's tutorial, I'll show you how to set up and run a private AI server locally using MLX server, completely independent of the internet. 🖥️💻📱 We'll dive into how to create a user-friendly chat interface and test it directly from your phone. Perfect for enthusiasts and developers looking to harness the power of AI within their private network! Apple MLX: Build Your Own Private AI Server
🔍 What You'll Learn:
How to install and configure MLX server
Setting up ChainLit UI for a seamless chat experience
Running your private AI on both your computer and mobile device
🌐 mlx_server running on Mac
🤖 @chainlit_io Chat on my iPhone
🏠 100% Local AI
📍 Local Wifi Network
🔒 Data remains private
🔗 Resources:
Sponsor a Video: mer.vin/contact/
Do a Demo of Your Product: mer.vin/contact/
Patreon: / mervinpraison
Ko-fi: ko-fi.com/mervinpraison
Discord: / discord
Twitter / X : / mervinpraison
Code: mer.vin/2024/04/mlx-server-app/
📌 Timestamps:
0:02 - Introduction to MLX server setup
0:29 - Step-by-step MLX server configuration
1:07 - Installing MLX and starting the server
1:49 - Creating a UI with ChainLit
2:42 - Testing the chat interface
3:32 - Running the setup on your mobile device
💡 Make sure to subscribe and hit the bell icon to get notifications about more content like this. Smash the like button if you find this video helpful-it supports the channel and helps others discover our tutorials!
#MLX #Server #Local #MLX #AppleMLX #MLXAppleSilicon #MLXSharedMemory #MLXUsageExamples #MLXInstallationGuide #MLXVsPytorch #UnifiedMemoryMLX #AppleMLXInnovations #MLXMachineLearning #MLXQuickStart #PythonAPIMLX #MLXNeuralNetworks #MLXFineTune #MLXFineTuning #AppleMLXFineTuning #AppleAI #MLXTrain #AppleSiliconAI #AppleSilicon #AppleML #AI #MacOSLLM #MacOSAI #ML #Apple #MLTutorial #MLXTutorial #Tutorial #Guide

КОМЕНТАРІ: 48
@ChrisDolese
@ChrisDolese 15 днів тому
one thing I would add for the novices like myself trying to follow along is the need for "pip3 install openai", probably obvious for most but I missed it initially
@vincentnestler1805
@vincentnestler1805 15 днів тому
Another outstanding video. Short but informative, practical, link to code that works on the first go! Awesome!
@MervinPraison
@MervinPraison 15 днів тому
Thank you
@johnbarros1
@johnbarros1 15 днів тому
This is outstanding! Thank you Mervin!
@moses5407
@moses5407 14 днів тому
Great tutorial! Two requests: please provide sysreqs for the setups in these videos and for this one maybe show how to access this remotely.
@TzaraDuchamp
@TzaraDuchamp 15 днів тому
Thanks Mervin, great concise video. I have one suggestion for improvement. Can you put the terminal commands in the description?
@ChrisDolese
@ChrisDolese 15 днів тому
very nice - great video , great topic... thank you Mervin
@mihirpatel3704
@mihirpatel3704 14 днів тому
great video Mervin, thank you!
@Echo24081971
@Echo24081971 11 днів тому
Excellent video Mervin. Does this require GPU or it can perfectly run on CPU.
@SnarkyNoob
@SnarkyNoob 14 днів тому
brilliant work. can you create a video on how to train llama3 and then use groq with that model? maybe even how to deploy it on places like digital ocean or aws. Thanks keep it up
@LifeAsARecoveringPansy
@LifeAsARecoveringPansy 15 днів тому
I just purchased an m3 max macbook pro, so I will probably actually implement what you are suggesting in this video
@MervinPraison
@MervinPraison 15 днів тому
Sure
@vincentnestler1805
@vincentnestler1805 15 днів тому
How much ram did you get with the mac book. The M chips are great at running LLMs but the limiting factor is RAM. If you maxed out the ram to 128gb on the M3 then you can run almost any OS model out there - quantized.
@LifeAsARecoveringPansy
@LifeAsARecoveringPansy 15 днів тому
@@vincentnestler1805 yeah, I got the maxed out version. Only one terabyte of storage though.128 gb of ram.
@LifeAsARecoveringPansy
@LifeAsARecoveringPansy 15 днів тому
@@MervinPraison Do you think I am a marketing bot or something? I just didn't expect a comment from a UKposts content creator to be so curt and seemingly skeptical about my purchase. You could have just ignored my comment. What are you really adding to the convo by saying, "Sure"? I really appreciate your tutorials by the way. Thanks for posting them.
@cristianaguilar4253
@cristianaguilar4253 15 днів тому
Thank
@user-gp6ix8iz9r
@user-gp6ix8iz9r 15 днів тому
Love this 👍👍👍
@MervinPraison
@MervinPraison 15 днів тому
Thank you
@vincentnestler1805
@vincentnestler1805 15 днів тому
Thanks!
@MervinPraison
@MervinPraison 15 днів тому
Thank you
@nexuslux
@nexuslux 14 днів тому
What kind of m achine on mac does this work well? Feel like it doesn't work at all on my m1 macbook air. Seems like the server and the ui are not commuicating, or my machine is too slow
@yazanrisheh5127
@yazanrisheh5127 14 днів тому
Hi Mervin. A lot of companies have been connecting their AI chatbot on their social medias like whatsapp and also in multiple languages. Could you show us how can we do that? Basically a RAG connected on our socials in several different languages.
@TinyMagiq
@TinyMagiq 15 днів тому
Interesting I could do the same with ollama server also correct?
@lcwmg
@lcwmg 15 днів тому
thanks your tutorial! is it only for apple machine?
@BangaloreYoutube
@BangaloreYoutube 15 днів тому
The framework is made for apple
@lcwmg
@lcwmg 14 днів тому
@@BangaloreUKposts is it possibblr to extend to window or linux?
@MervinPraison
@MervinPraison 14 днів тому
I will do a tutorial soon to do it for windows and Linux but with a different package
@joacosolbes9283
@joacosolbes9283 15 днів тому
Hello mate, is this possible on Windows Also, production ready so this can be used by a local business vía internet 😢
@MervinPraison
@MervinPraison 15 днів тому
Sorry this is available only for Mac decide But I will create another one video to include both windows and Linux
@joacosolbes9283
@joacosolbes9283 15 днів тому
@@MervinPraison thanks mate
@_levyathan_
@_levyathan_ 15 днів тому
Genuine question, why use mlx server when If you use streamlit this is provided by out from the box? I can access my streamlit app trough my phone
@MervinPraison
@MervinPraison 15 днів тому
Yes you can use steam lit instead of chain lit
@MervinPraison
@MervinPraison 15 днів тому
MLX for serving LLM llama 3
@webnomad1453
@webnomad1453 12 днів тому
When I run pip install mlx-lm I get an error. To fix this you could try to: 1. loosen the range of package versions you've specified 2. remove package versions to allow pip attempt to solve the dependency conflict ERROR: ResolutionImpossible
@MervinPraison
@MervinPraison 12 днів тому
Make sure you install it on Mac Computers
@webnomad1453
@webnomad1453 12 днів тому
@@MervinPraison I don’t have a mac. Is this solution for Mac only? Would have been nice to mention that in the video
@parkersettle460
@parkersettle460 15 днів тому
I am working on a project, and the user talks to the model via text
@MervinPraison
@MervinPraison 15 днів тому
👍
@parkersettle460
@parkersettle460 15 днів тому
@@MervinPraison What projects are you working on?
@varma8669
@varma8669 15 днів тому
Why so many cuts in your video?
@MervinPraison
@MervinPraison 15 днів тому
Particularly in which section ?
@avi7278
@avi7278 14 днів тому
This is misleading. You can access any port on the local network from any browser on a device connected to the network. It has nothing to do with your phone other than that your phone has a browser. If you left your house, you'd no longer even have access to the server; you'd need to set up tunneling for that, which you can do most easily with a service like ngrok. But this is not running on your phone or anything of the sort.
@CrispinCourtenay
@CrispinCourtenay 14 днів тому
Can you and Matthew Berman please take one day off per week...ideally on the same day, so that I get one day off a week to play with my dogs, cut the grass, drink a cocktail, go for a swim, and read a fictional book - without having to learn anything new for the day.
@MervinPraison
@MervinPraison 14 днів тому
Haha 😂 love this Need to talk to him and make a deal
@maertscisum7243
@maertscisum7243 14 днів тому
At least explain first why Apple MLX, what are the features and benefits compare to others.
@iham1313
@iham1313 15 днів тому
you are NOT running “this on your phone”. you simply open the web ui from it. which is a completely different thing.
What M4 iPad Pro means for M4 Macs (Huge WWDC Reveal?)
11:47
Max Tech
Переглядів 119 тис.
Teenagers Show Kindness by Repairing Grandmother's Old Fence #shorts
00:37
Fabiosa Best Lifehacks
Переглядів 32 млн
Піхотинці - про потребу у людях
00:57
Суспільне Новини
Переглядів 1 млн
Hacking On Postgres is Hard! | Scaling Postgres 315
19:32
Scaling Postgres
Переглядів 484
How to use the ChatGPT API with Python!!
0:49
Nicholas Renotte
Переглядів 490 тис.
Build an AI App in 3 steps | Autonomous Assistants
7:31
Phidata
Переглядів 2,6 тис.
Apple MLX Fine Tuning: Complete Crash Course for Beginners
6:57
Mervin Praison
Переглядів 3,9 тис.
Mixtral MoE on Apple Silicon is Here, thanks to MLX
9:17
Prompt Engineering
Переглядів 12 тис.
Making Tmux Better AND Beautiful -- here’s how
10:56
typecraft
Переглядів 46 тис.
The 2024 M4 Mac Lineup! (INSANE POWER!)
11:15
GregsGadgets
Переглядів 50 тис.
Build your own Deep learning Machine - What you need to know
11:58
The AI Hacker
Переглядів 204 тис.
Паска #подарункиукраїна
0:30
Хома Джан
Переглядів 428 тис.
Jerry Heil зачитала реп Альони Альони 😳
0:22
JERRY HEIL SHORTS
Переглядів 138 тис.
河东狮吼
0:13
曹操大哥
Переглядів 12 млн
@Ustarhanpk
0:41
Софья Земляная
Переглядів 1,1 млн
Необычная посадка томатов: урожай будет хороший
0:54
Антон - цветочник
Переглядів 1,7 млн