Pre-training foundation models on Amazon SageMaker | Step 1: Prepare data | Amazon Web Services
Amazon SageMaker helps you reduce the time and cost of training foundation models (FMs) at scale without managing infrastructure. In this video series, we will provide step-by-step guidance on training FMs from scratch on SageMaker.
To pre-train FMs, you first need to prepare massive amounts of data from sources such as social media, online forums, and company-specific data. In this video, you will learn how to create a framework to prepare large datasets, store processed data in a variety of sources such as S3 and FSx for Lustre, and use a file system that can offer GBs of throughput to pre-train an LLM.
Learn more at:
Subscribe:
More AWS videos:
More AWS events videos:
Do you have technical AWS questions?
Ask the community of experts on AWS re:Post:
ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.
#AWS #AmazonWebServices #CloudComputing
[ad_2]
source
