Micro Graph Transformer Powering Small Language Models // Jon Cooke // MLOps Podcast #208
Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops that will teach you how to set up your use cases and skip over all the headaches.
Join the AI in Production Conference on February 15 and 22 here:
________________________________________________________________________________________
MLOps podcast #208 with Jon Cooke, CTO of Dataception, Micro Graph Transformer – Specialist Small Language Models Using Graphs to Accelerate Data Product Eco-systems.
// Abstract
Specialist deconstructed Encoder/Decoder Transformers along with data product management and tech to vastly accelerate prototyping, building, and deploying business-facing data products at high speed and low cost.
// Bio
Jon is a 20-year veteran in Data, Analytics, and AI and is a Data product specialist. After many times seeing the massive time, friction, failures, and costs typically associated with data and analytics initiatives, Jon founded Dataception. Its mission is to use tech to eliminate the data grunt and work together with data product management and AI to build and iterate sophisticated, business-facing analytics in real-time in front of the business.
// MLOps Jobs board
// MLOps Swag/Merch
// Related Links
Website: www.dataception.com
Building Better Data Teams // Leanne Fitzpatrick // Coffee Sessions #113:
————— ✌️Connect With Us ✌️ ————-
Join our slack community:
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup:
Catch all episodes, blogs, newsletters, and more:
Connect with Demetrios on LinkedIn:
Connect with Jon on LinkedIn:
Timestamps:
[00:00] AI in Production Conference teaser
[02:12] Jon’s preferred coffee
[02:24] Takeaways
[03:48] Please like, share, and subscribe to our MLOps channels!
[04:02] Backpacking, traveling, and almost cast for Lord of the Rings
[06:40] Jon’s tech background
[11:07] Dataception
[15:05] Data Challenges: Delays & Causes
[16:46] Data Virtualization for Agility
[19:47] Large Company Change Challenges
[21:28] Sales Tools Migration Challenges
[24:44] Data and ML Integration
[28:13] Data Roles Evolution
[32:20] Tech for Prototyping Acceleration
[35:22] LLM Enables Natural Language Data Analytics
[36:36] Ensuring Reliable AI Information
[38:20] Proxy Routing and Intelligent Agents
[42:41] Human API for Data
[46:49] Engineer Success with Growth
[48:15] Tech CEO Balancing Act
[53:59] Iterative Development for Product-Market Fit
[56:16] Wrap up
[ad_2]
source
