06-07, 11:05–11:50 (Europe/London), Hardwick Hub
The only certainty in life is that the pendulum will always swing. Recently, the pendulum has been swinging towards repatriation. However, the infrastructure needed to build and operate AI systems using Python in a sovereign (even air-gapped) environment has changed since the shift towards the cloud. This talk will introduce the infrastructure you need to build and deploy Python applications for AI - from data processing, to model training and LLM fine-tuning at scale to inference at scale. We will focus on open-source infrastructure including:
a Python library server (Pypi, Conda, etc) and avoiding supply chain attacks
a container registry that works at scale
a S3 storage layer
a database server with a vector index
The only certainty in life is that the pendulum will always swing. Recently, the pendulum has been swinging towards repatriation. However, the infrastructure needed to build and operate AI systems using Python in a sovereign (even air-gapped) environment has changed since the shift towards the cloud. This talk will introduce the infrastructure you need to build and deploy Python applications for AI - from data processing, to model training and LLM fine-tuning at scale to inference at scale. We will focus on open-source infrastructure including:
a Python library server (Pypi, Conda, etc) and avoiding supply chain attacks
a container registry that works at scale
a S3 storage layer
a database server with a vector index
Previous knowledge expected
Lex Avstreikh is the Head of Strategy at Hopsworks; a Swedish startup at the forefront of machine learning infrastructure. He focuses on identifying pivotal market trends and product initiatives.