Dylan Patel runs Semianalysis, the leading publication and research firm on AI hardware: Jon Y …
[ad_2]
source
Dylan Patel runs Semianalysis, the leading publication and research firm on AI hardware: Jon Y …
[ad_2]
source
Lorem ipsum dolor sit amet, consectetur.
Feels like you need a security clearance for this episode
This was such a cool podcast! Just dudes chillin out and also talking intellectual sh!t😀😍
What is this fucking channel and how is this motherfucker getting these insane interviewees but not cracking 1m views on more than one video??? Bruh, is it thumbnails or something? Interview someone who intimately knows about the YT algos or something and fix your shit because this is wild stuff.
I would think an AI recommender system consisting of say 7B SLM models would be able to split off large problems into smaller ones. If you have the ability to pull essentially any PHD level specialized discipline AI for any given topic, you could then just use a bunch of SLM agents to reduce your compute overhead instead of this massive model trying to encompass all information. As humans we work as a bunch of experts trying to collaborate with other human experts to accomplish a complex task. I would think creating AI systems that mimic this behavior would be much more effective than trying to train one large model to do everything. So instead of one model responding to a prompt it would offload the response to a domain specific model after analyzing the prompt for specific keywords. For example any coding related question would be answered by a different model trained only on code instead of natural language, hence the need for a massive amount of different but smaller domain specific models.
Okay dumb question, would a "folding at home" style distributed compute among consumer hardware work for AI training? I don't know if there's any way to make a large training set into something like a packet to essentially break down training into smaller segments or if the model has to be trained all at once.
Is it not open sourcing EDA tools a possible blockneck? On SW side, so many tools are open sourced node.js, compilers, nosql/sql DBs, caching solutions etc?
This is amazing 😂
I kinda feel lucky to have the background that I have. Power Systems/Electronics, Digital IC design, Analog circuits, Control/Signals Systems, and lastly AI design. This episode is such an overload that it is giving me anxiety.
this ep is gold in so many levels – combine this with CHIP WAR and you have a great understanding of whats going on.
Amazing episode, I had no idea how opaque the semiconductor world is. Great original content 😁
I am still dont understand. The use massive amounts of GPU is for build base LLM. Now is about RLHF , GPT 01 is reasoning is loopback from level 4 (according to AndreKarpaty 2023 microsoft presentation). Groq with they LPU work base on inference with different design. Is too much hype building thousand GPU pumping AI and chip stock
Wow very educational and information packed. Thanks for sharing your knowledge.
I'll never understand why guys like Dylan drink coffee. Bro, you need meditation, not stimulants.
dylan patel is way too smart to accidentally repeat chinese propaganda…
i really wonder why he is rooting for china and downplaying them as a threat, and uplaying their capabilities…
"successful sanctions mean they stop"
coooome oooon… thats bullshit…
when has ANYONE ever just given up when they were sanctioned?
I like the fact that he called that Devin demo bullshit 😂
china can build better AI chips than what the west can sell them?
DOUBT! lmao…
Sick interview propps
a most fascinating story of human collaboration mechanics!
i do love the content, but whew… fellas, less “likes” and “rights” to fill your sentences.
Asianometry is sneaky coward and gutless to face the public.
Interesting discussion. However, I could share in my network only if professional language was used throughout the podcast.
There's no path to AGI. There's just doing more ridiculous amounts of matrix calculations, and then a big question mark.
Like Like Like!
Promote Conspiracy theory . Pathetic . Who the hell told you guys Huawei is PLA company ? Shame on those who spread lies !
I LOVE IT
Does this Dylan Patel have an YT channel ?
Thanks for introducing dylan to me
Heard of "Terrance Tao", you dumbos? He's ethnically Chinese. Have the CIA/FBI harrass him a few times and he'll be off to China, to join the rest of the Chinese Americans that were treated like WW2 Japanese Americans living in America.
Your 'speculation' is weak, sons. Level up. Much more insightful podcasts in China that have more realistic analysis of the situations.
Big cheers to dwarkesh, throughout the interview with these two giants he´s clearly done its research, yet he´s constantly pushed to the edge of his knowledge, while still keeping them to getting into semiconductor cloud nine.
Almost didn't recognize him without the antlers
Miller Donald Wilson Larry Gonzalez Helen
You know a podcast audience is legit when the sponsor is freaking Jane Street looking for employees
Transformer with Chinese characteristics
What I thought Asianometry was a deer 🦌. I am disappointed 🙁