0.25 europython-2023 2023-07-17 2023-07-23 7 00:05 https://programme.europython.eu https://programme.europython.eu/media/europython-2023/img/epslogo_2rBf6vZ.png Europe/Prague Club A Announcements 2023-07-17T08:30:00+02:00 08:30 01:00 Welcome to EuroPython 2023! You can pick up your badges at any time during the week as long as we are open! If you want to avoid the morning rush on Wednesday, come on Monday and Tuesday! Queues will be sorted by your **first name** on your ticket. Your ticket can be located via your order confirmation email (from support@pretix.eu with the Subject: Your order: XXXX). If you ordered your ticket after we've sent badges for printing (after 10 July), go directly to the Info Desk (also referred as Debugging Desk) and a volunteer will help! europython-2023-35573-registration-welcome-forum-hall-foyer-1st-floor en false https://programme.europython.eu/europython-2023/talk/3HURZQ/ https://programme.europython.eu/europython-2023/talk/3HURZQ/feedback/ Club A Tutorial 2023-07-17T09:30:00+02:00 09:30 01:30 This tutorial aims to demystify asyncio builtin module by implementing it from scratch without any dependencies other than the Python Standard Library. We will go through the problem of blocking IO and how it is possible to solve it without single "async" and "await" statement using native Python concepts. Then, we will demystify async/await syntax and see how it is implemented. We will also build our own scheduler which will have a similar API as asyncio, which will be able to run async functions the same way asyncio does. And finally we will build real asynchronous http proxy using our own asyncio implementation. Why reinvent the wheel? - "I hear and I forget. I see and I remember. I do and I understand.". europython-2023-29567-0-asyncio-without-asyncio TBD - Multiple Tracks (2023) Yan Yanchii en false https://programme.europython.eu/europython-2023/talk/8XKCB8/ https://programme.europython.eu/europython-2023/talk/8XKCB8/feedback/ Club A Tutorial 2023-07-17T11:15:00+02:00 11:15 01:30 This tutorial aims to demystify asyncio builtin module by implementing it from scratch without any dependencies other than the Python Standard Library. We will go through the problem of blocking IO and how it is possible to solve it without single "async" and "await" statement using native Python concepts. Then, we will demystify async/await syntax and see how it is implemented. We will also build our own scheduler which will have a similar API as asyncio, which will be able to run async functions the same way asyncio does. And finally we will build real asynchronous http proxy using our own asyncio implementation. Why reinvent the wheel? - "I hear and I forget. I see and I remember. I do and I understand.". europython-2023-29567-1-asyncio-without-asyncio TBD - Multiple Tracks (2023) Yan Yanchii en false https://programme.europython.eu/europython-2023/talk/8XKCB8/ https://programme.europython.eu/europython-2023/talk/8XKCB8/feedback/ Club A Tutorial 2023-07-17T13:45:00+02:00 13:45 01:30 In this tutorial, you will learn about the various Python modules for processing geospatial data, including GDAL, Rasterio, Pyproj, Shapely, Folium, Fiona, OSMnx, Libpysal, Geopandas, Pydeck, Whitebox, ESDA, and Leaflet. You will gain hands-on experience working with real-world geospatial data and learn how to perform tasks such as reading and writing spatial data, reprojecting data, performing spatial analyses, and creating interactive maps. This tutorial is suitable for beginners as well as intermediate Python users who want to expand their knowledge in the field of geospatial data processing. europython-2023-29501-0-geospatial-data-processing-in-python-a-comprehensive-tutorial PyData: Data Engineering (2023) Martin Christen en Geospatial data, which refers to data that has a geographic component, is a crucial part of many fields, including geography, geography, urban planning, and environmental science. In this tutorial, you will learn about the various Python modules that are available for working with geospatial data. We will start by introducing the **GDAL** (Geospatial Data Abstraction Library) and **Rasterio** modules, which are used for reading and writing raster data (data stored in a grid of cells, where each cell has a value). You will learn how to read and write common raster formats such as GeoTIFF and ESRI ASCII, as well as how to perform common raster operations such as resampling and reprojecting. Next, we will cover the **Pyproj** module, which is used for performing coordinate system transformations. You will learn how to convert between different coordinate systems and how to perform common tasks such as converting latitude and longitude coordinates to UTM (Universal Transverse Mercator) coordinates. After that, we will introduce the **Shapely** module, which is used for working with geometric objects in Python. You will learn how to create and manipulate points, lines, and polygons, as well as how to perform spatial operations such as intersection and union. Then, we will cover the **Folium** module, which is used for creating interactive maps in Python. You will learn how to create simple maps, add markers and popups, and customize the appearance of your maps. Next, we will introduce the **Fiona** module, which is used for reading and writing vector data (data stored as individual features, each with its own geometry and attributes). You will learn how to read and write common vector formats such as ESRI Shapefile and GeoJSON, as well as how to access and manipulate the attributes of vector features. After that, we will cover the **OSMnx** module, which is used for working with OpenStreetMap data in Python. You will learn how to download and manipulate street networks, buildings, and other geospatial data. Next, we will introduce the **Libpysal** module, which is used for performing spatial statistics and econometrics in Python. You will learn how to calculate spatial weights, perform spatial autocorrelation tests, and estimate spatial econometric models. Then, we will cover the **Geopandas** module, which is used for working with geospatial data in a Pandas DataFrame. You will learn how to load and manipulate vector data, perform sp false https://programme.europython.eu/europython-2023/talk/3HDWUZ/ https://programme.europython.eu/europython-2023/talk/3HDWUZ/feedback/ Club A Tutorial 2023-07-17T15:30:00+02:00 15:30 01:30 In this tutorial, you will learn about the various Python modules for processing geospatial data, including GDAL, Rasterio, Pyproj, Shapely, Folium, Fiona, OSMnx, Libpysal, Geopandas, Pydeck, Whitebox, ESDA, and Leaflet. You will gain hands-on experience working with real-world geospatial data and learn how to perform tasks such as reading and writing spatial data, reprojecting data, performing spatial analyses, and creating interactive maps. This tutorial is suitable for beginners as well as intermediate Python users who want to expand their knowledge in the field of geospatial data processing. europython-2023-29501-1-geospatial-data-processing-in-python-a-comprehensive-tutorial PyData: Data Engineering (2023) Martin Christen en Geospatial data, which refers to data that has a geographic component, is a crucial part of many fields, including geography, geography, urban planning, and environmental science. In this tutorial, you will learn about the various Python modules that are available for working with geospatial data. We will start by introducing the **GDAL** (Geospatial Data Abstraction Library) and **Rasterio** modules, which are used for reading and writing raster data (data stored in a grid of cells, where each cell has a value). You will learn how to read and write common raster formats such as GeoTIFF and ESRI ASCII, as well as how to perform common raster operations such as resampling and reprojecting. Next, we will cover the **Pyproj** module, which is used for performing coordinate system transformations. You will learn how to convert between different coordinate systems and how to perform common tasks such as converting latitude and longitude coordinates to UTM (Universal Transverse Mercator) coordinates. After that, we will introduce the **Shapely** module, which is used for working with geometric objects in Python. You will learn how to create and manipulate points, lines, and polygons, as well as how to perform spatial operations such as intersection and union. Then, we will cover the **Folium** module, which is used for creating interactive maps in Python. You will learn how to create simple maps, add markers and popups, and customize the appearance of your maps. Next, we will introduce the **Fiona** module, which is used for reading and writing vector data (data stored as individual features, each with its own geometry and attributes). You will learn how to read and write common vector formats such as ESRI Shapefile and GeoJSON, as well as how to access and manipulate the attributes of vector features. After that, we will cover the **OSMnx** module, which is used for working with OpenStreetMap data in Python. You will learn how to download and manipulate street networks, buildings, and other geospatial data. Next, we will introduce the **Libpysal** module, which is used for performing spatial statistics and econometrics in Python. You will learn how to calculate spatial weights, perform spatial autocorrelation tests, and estimate spatial econometric models. Then, we will cover the **Geopandas** module, which is used for working with geospatial data in a Pandas DataFrame. You will learn how to load and manipulate vector data, perform sp false https://programme.europython.eu/europython-2023/talk/3HDWUZ/ https://programme.europython.eu/europython-2023/talk/3HDWUZ/feedback/ Club E Tutorial 2023-07-17T09:30:00+02:00 09:30 01:30 What's this thing called **MLOps**? You may have heard about it by now, but never really understood what all the fuzz is about. Let's find out together! In this tutorial, you will learn about MLOps and take your first steps in a hands-on way. To do so, we will be using **Open Source** tooling. We will be taking a simple example of Machine Learning use case and will gradually make it more ready for production 🚀. We start with a simple time-series model in Python using scikit-learn and first add logging steps to make the performance of the model measurable. Don't worry: we will go through it step-by-step, so you won't be overwhelmed. Then, we will log our ML model and load it back into an inference step. Lastly, we will learn about deploying these actual models by Dockerizing our application 🙏. europython-2023-30023-0-how-to-mlops-experiment-tracking-deployment PyData: Machine Learning, Stats (2023) Jeroen OverschieYke Rusticus en Welcome! You will be learning about MLOps in a hands-on way. So get ready to get your hands dirty and code along! 👏🏻 Join us if you 🫵: - Are working with Machine Learning / Data Science - Have some experience with Python - Are interested in MLOps and want to get some hands-on experience - Are interested in taking your Machine Learning model to production ### Contents of the tutorial 📌: 1. [15 min] MLOps: what's the fuzz about? 2. [15 min] Why Experiment tracking? 📊 3. [15 min] Hands-on: Logging metrics with MLFlow 4. [10 min] Hands-on: Comparing experiments in the MLFlow interface 5. [15 min] Hands-on: Saving a trained model with MLFlow 6. [20 min] Hands-on: Loading a model with MLFlow and running inference 7. [15 min] How to deploy our application? 🚀 8. [30 min] Hands-on: Dockerizing our application 9. [30 min] Hands-on: Deploying our application ### 🏡 What you will take home At the end of the tutorial, you will be taking home the following: - What MLOps is - When it's applicable, and why it is important - How you can track your Machine Learning experiments and build better models because of it - Separate model training from model inference - Know how you could deploy your ML model to production ### ❤️ Open Source Software Many of the used tooling is Open Source. Open software for all! ### 🎒 Pre-requisites Some Python knowledge is required, as well as some general Data Science knowledge: model- training and inference as well as cross-validation. We will not go into details on the Data Science part, but it is good to have a rough understanding about it 👍🏻. false https://programme.europython.eu/europython-2023/talk/PNYMHE/ https://programme.europython.eu/europython-2023/talk/PNYMHE/feedback/ Club E Tutorial 2023-07-17T11:15:00+02:00 11:15 01:30 What's this thing called **MLOps**? You may have heard about it by now, but never really understood what all the fuzz is about. Let's find out together! In this tutorial, you will learn about MLOps and take your first steps in a hands-on way. To do so, we will be using **Open Source** tooling. We will be taking a simple example of Machine Learning use case and will gradually make it more ready for production 🚀. We start with a simple time-series model in Python using scikit-learn and first add logging steps to make the performance of the model measurable. Don't worry: we will go through it step-by-step, so you won't be overwhelmed. Then, we will log our ML model and load it back into an inference step. Lastly, we will learn about deploying these actual models by Dockerizing our application 🙏. europython-2023-30023-1-how-to-mlops-experiment-tracking-deployment PyData: Machine Learning, Stats (2023) Jeroen OverschieYke Rusticus en Welcome! You will be learning about MLOps in a hands-on way. So get ready to get your hands dirty and code along! 👏🏻 Join us if you 🫵: - Are working with Machine Learning / Data Science - Have some experience with Python - Are interested in MLOps and want to get some hands-on experience - Are interested in taking your Machine Learning model to production ### Contents of the tutorial 📌: 1. [15 min] MLOps: what's the fuzz about? 2. [15 min] Why Experiment tracking? 📊 3. [15 min] Hands-on: Logging metrics with MLFlow 4. [10 min] Hands-on: Comparing experiments in the MLFlow interface 5. [15 min] Hands-on: Saving a trained model with MLFlow 6. [20 min] Hands-on: Loading a model with MLFlow and running inference 7. [15 min] How to deploy our application? 🚀 8. [30 min] Hands-on: Dockerizing our application 9. [30 min] Hands-on: Deploying our application ### 🏡 What you will take home At the end of the tutorial, you will be taking home the following: - What MLOps is - When it's applicable, and why it is important - How you can track your Machine Learning experiments and build better models because of it - Separate model training from model inference - Know how you could deploy your ML model to production ### ❤️ Open Source Software Many of the used tooling is Open Source. Open software for all! ### 🎒 Pre-requisites Some Python knowledge is required, as well as some general Data Science knowledge: model- training and inference as well as cross-validation. We will not go into details on the Data Science part, but it is good to have a rough understanding about it 👍🏻. false https://programme.europython.eu/europython-2023/talk/PNYMHE/ https://programme.europython.eu/europython-2023/talk/PNYMHE/feedback/ Club E Tutorial 2023-07-17T13:45:00+02:00 13:45 01:30 Join our hands-on workshop and discover how to build fast, production-ready APIs using Robyn, a developer-friendly web framework for Python. We'll guide you through key features like GraphQL, WebSockets, and data validation, as well as essential topics like app structure, database modeling, and code splitting. With our workshop, you'll gain practical experience and valuable insights into Robyn's simple and extensible API, middleware, and deployment process. europython-2023-29463-0-build-serve-and-deploy-a-fast-production-ready-api-with-python-and-robyn Web (2023) Sanskar Jethi en Are you looking to build a fast, scalable, and production-ready API using Python? Look no further than Robyn - one of the fastest and most developer-friendly web frameworks on the market! In this hands-on workshop, you'll learn how to use Robyn to build a robust API that can handle a high volume of requests. We will walk you through the key features of Robyn. You'll also learn how to take advantage of Robyn's easy deployment process, fast shipping process, and middleware functionality to customize your app's behavior. We'll cover essential topics like app structure, database modeling, and code splitting using views so that you can organize your code in a modular and reusable way. Additionally, we'll explore Robyn's simple and extensible API, which makes it easy to create a custom API that meets your unique requirements. Throughout the workshop, you'll have ample opportunity to practice your skills and ask questions. We'll provide a fully-functional codebase that you can use as a starting point for your own API, and our instructors will be on hand to help you troubleshoot any issues you encounter. By the end of the workshop, you'll have the confidence and expertise to build a fast, production-ready API using Python and Robyn. Whether you're building a web app, mobile app, or IoT device, this workshop is a must-attend event for anyone looking to take their API development skills to the next level. Sign up today and get ready to supercharge your API development workflow! false https://programme.europython.eu/europython-2023/talk/SEBRJA/ https://programme.europython.eu/europython-2023/talk/SEBRJA/feedback/ Club E Tutorial 2023-07-17T15:30:00+02:00 15:30 01:30 Join our hands-on workshop and discover how to build fast, production-ready APIs using Robyn, a developer-friendly web framework for Python. We'll guide you through key features like GraphQL, WebSockets, and data validation, as well as essential topics like app structure, database modeling, and code splitting. With our workshop, you'll gain practical experience and valuable insights into Robyn's simple and extensible API, middleware, and deployment process. europython-2023-29463-1-build-serve-and-deploy-a-fast-production-ready-api-with-python-and-robyn Web (2023) Sanskar Jethi en Are you looking to build a fast, scalable, and production-ready API using Python? Look no further than Robyn - one of the fastest and most developer-friendly web frameworks on the market! In this hands-on workshop, you'll learn how to use Robyn to build a robust API that can handle a high volume of requests. We will walk you through the key features of Robyn. You'll also learn how to take advantage of Robyn's easy deployment process, fast shipping process, and middleware functionality to customize your app's behavior. We'll cover essential topics like app structure, database modeling, and code splitting using views so that you can organize your code in a modular and reusable way. Additionally, we'll explore Robyn's simple and extensible API, which makes it easy to create a custom API that meets your unique requirements. Throughout the workshop, you'll have ample opportunity to practice your skills and ask questions. We'll provide a fully-functional codebase that you can use as a starting point for your own API, and our instructors will be on hand to help you troubleshoot any issues you encounter. By the end of the workshop, you'll have the confidence and expertise to build a fast, production-ready API using Python and Robyn. Whether you're building a web app, mobile app, or IoT device, this workshop is a must-attend event for anyone looking to take their API development skills to the next level. Sign up today and get ready to supercharge your API development workflow! false https://programme.europython.eu/europython-2023/talk/SEBRJA/ https://programme.europython.eu/europython-2023/talk/SEBRJA/feedback/ Club H Tutorial 2023-07-17T09:30:00+02:00 09:30 01:30 Python offers decorator to implement re-usable code for cross-cutting task. The support the separation of cross-cutting concerns such as logging, caching, or checking of permissions. This can improve code modularity and maintainability. This tutorial is an in-depth introduction to decorators. It covers the usage of decorators and how to implement simple and more advanced decorators. Use cases demonstrate how to work with decorators. In addition to showing how functions can use closures to create decorators, the tutorial introduces callable class instance as alternative. Class decorators can solve problems that use be to be tasks for metaclasses. The tutorial provides uses cases for class decorators. While the focus is on best practices and practical applications, the tutorial also provides deeper insight into how Python works behind the scene. After the tutorial participants will feel comfortable with functions that take functions and return new functions. europython-2023-29384-0-decorators-a-deep-dive Python Internals & Ecosystem (2023) Mike Müller en ## Audience This tutorial is for intermediate Python programmers who want to dive deeper. Solid working knowledge of functions and classes basics is required. ## Format The tutorial will be hands on. I will start with a blank Notebook for each topic and develop the content step-by-step. The participants are encouraged to type along. My typing speed is usually appropriate and allows participants to follow. The students will receive a comprehensive PDF with all course content as well Python source code files for all use cases and large code blocks I use. I will load these files in my Notebook. The students can do the same or open the files in their preferred editor or IDE. I also explicitly ask for feedback if I am too fast or things are unclear. I encourage questions at any time. In fact, questions and my answers are often an important part of my teaching, making the learning experience much more lively and typically more useful. So the participants will be active throughout the whole tutorial. There will be two exercises that each participant has to do on its own (or in breakout rooms if the tutorials should be remote) during the tutorial. We will look at the solutions during the tutorial. I also supply a solutions PDF after the tutorial. ## Outline * Examples of using decorators * from the standard library * from third-party packages * Closures for decorators * Write a simple decorator * Best Practice * Use case: Caching * Use case: Logging * Parameterizing decorators * Chaining decorators * Callable instances instead of functions * Use case: Argument Checking * Use case: Registration * Class decorators * Wrap-up and questions false https://programme.europython.eu/europython-2023/talk/BGEYP7/ https://programme.europython.eu/europython-2023/talk/BGEYP7/feedback/ Club H Tutorial 2023-07-17T11:15:00+02:00 11:15 01:30 Python offers decorator to implement re-usable code for cross-cutting task. The support the separation of cross-cutting concerns such as logging, caching, or checking of permissions. This can improve code modularity and maintainability. This tutorial is an in-depth introduction to decorators. It covers the usage of decorators and how to implement simple and more advanced decorators. Use cases demonstrate how to work with decorators. In addition to showing how functions can use closures to create decorators, the tutorial introduces callable class instance as alternative. Class decorators can solve problems that use be to be tasks for metaclasses. The tutorial provides uses cases for class decorators. While the focus is on best practices and practical applications, the tutorial also provides deeper insight into how Python works behind the scene. After the tutorial participants will feel comfortable with functions that take functions and return new functions. europython-2023-29384-1-decorators-a-deep-dive Python Internals & Ecosystem (2023) Mike Müller en ## Audience This tutorial is for intermediate Python programmers who want to dive deeper. Solid working knowledge of functions and classes basics is required. ## Format The tutorial will be hands on. I will start with a blank Notebook for each topic and develop the content step-by-step. The participants are encouraged to type along. My typing speed is usually appropriate and allows participants to follow. The students will receive a comprehensive PDF with all course content as well Python source code files for all use cases and large code blocks I use. I will load these files in my Notebook. The students can do the same or open the files in their preferred editor or IDE. I also explicitly ask for feedback if I am too fast or things are unclear. I encourage questions at any time. In fact, questions and my answers are often an important part of my teaching, making the learning experience much more lively and typically more useful. So the participants will be active throughout the whole tutorial. There will be two exercises that each participant has to do on its own (or in breakout rooms if the tutorials should be remote) during the tutorial. We will look at the solutions during the tutorial. I also supply a solutions PDF after the tutorial. ## Outline * Examples of using decorators * from the standard library * from third-party packages * Closures for decorators * Write a simple decorator * Best Practice * Use case: Caching * Use case: Logging * Parameterizing decorators * Chaining decorators * Callable instances instead of functions * Use case: Argument Checking * Use case: Registration * Class decorators * Wrap-up and questions false https://programme.europython.eu/europython-2023/talk/BGEYP7/ https://programme.europython.eu/europython-2023/talk/BGEYP7/feedback/ Club H Tutorial 2023-07-17T13:45:00+02:00 13:45 01:30 Learn how to build powerful terminal-based user interfaces (TUIs) with ease using Textual - an open-source Python framework. Throughout this tutorial, you'll learn how to use Textual's built-in widgets, reactive features, and message-passing system to create a dynamic and user-friendly TODO app that's perfect for managing your daily tasks. From creating and displaying tasks to editing and deleting them, you'll cover all the essential features needed to make a functional TODO app. You'll also learn how to use Textual CSS to style your TUI for a polished and elegant look, together with some tips and tricks to make it even easier to develop your TUIs in Textual. This tutorial provides everything you need to get started with building TUIs in Python. By the end of the tutorial, you'll have a fully functional and stylish TODO app that showcases Textual's versatility and useful features. europython-2023-29196-0-build-a-terminal-todo-app-with-textual Python Libraries (2023) Rodrigo Girão Serrão en [Instructions below!] During this tutorial, we will build a terminal-user interface for a TODO app. This will showcase all the essential features that make Textual a very interesting Python framework to build terminal user interfaces. Topics covered in this tutorial include: - the vast built-in widget gallery; - reactive attributes; - handling messages; - key bindings and action methods; - Textual CSS; - the Textual developer console; and - creation of custom widgets. Attendees are not expected to have prior Textual experience but they are expected to have a working knowledge of classes, methods, and attributes. If you want to attend the workshop, please follow the instructions in [this GitHub repo](https://github.com/Textualize/TODO-tutorial): https://github.com/Textualize/TODO-tutorial. false https://programme.europython.eu/europython-2023/talk/C7AZ33/ https://programme.europython.eu/europython-2023/talk/C7AZ33/feedback/ Club H Tutorial 2023-07-17T15:30:00+02:00 15:30 01:30 Learn how to build powerful terminal-based user interfaces (TUIs) with ease using Textual - an open-source Python framework. Throughout this tutorial, you'll learn how to use Textual's built-in widgets, reactive features, and message-passing system to create a dynamic and user-friendly TODO app that's perfect for managing your daily tasks. From creating and displaying tasks to editing and deleting them, you'll cover all the essential features needed to make a functional TODO app. You'll also learn how to use Textual CSS to style your TUI for a polished and elegant look, together with some tips and tricks to make it even easier to develop your TUIs in Textual. This tutorial provides everything you need to get started with building TUIs in Python. By the end of the tutorial, you'll have a fully functional and stylish TODO app that showcases Textual's versatility and useful features. europython-2023-29196-1-build-a-terminal-todo-app-with-textual Python Libraries (2023) Rodrigo Girão Serrão en [Instructions below!] During this tutorial, we will build a terminal-user interface for a TODO app. This will showcase all the essential features that make Textual a very interesting Python framework to build terminal user interfaces. Topics covered in this tutorial include: - the vast built-in widget gallery; - reactive attributes; - handling messages; - key bindings and action methods; - Textual CSS; - the Textual developer console; and - creation of custom widgets. Attendees are not expected to have prior Textual experience but they are expected to have a working knowledge of classes, methods, and attributes. If you want to attend the workshop, please follow the instructions in [this GitHub repo](https://github.com/Textualize/TODO-tutorial): https://github.com/Textualize/TODO-tutorial. false https://programme.europython.eu/europython-2023/talk/C7AZ33/ https://programme.europython.eu/europython-2023/talk/C7AZ33/feedback/ Club B Tutorial 2023-07-17T09:30:00+02:00 09:30 01:30 This tutorial presents sktime - a unified, open source framework for machine learning with time series in python. sktime provides interfaces to algorithms of various types, and modular tools for pipelining, composition, and tuning. You will learn how identify your learning task, and how to build, use, and evaluate different algorithms on real-world data sets. All tutorial notebooks are available in this repository and runnable from the cloud: https://github.com/sktime/sktime-tutorial-europython-2023 europython-2023-29642-0-sktime-python-toolbox-for-time-series PyData: Software Packages & Jupyter (2023) Franz KiralySagar MishraKiril Ralinovski en Time series are ubiquitous in real-world applications, but often add considerable complications to data science workflows. In this tutorial, we will present sktime - a unified framework for machine learning with time series. sktime covers multiple time series learning problems, including time series transformation, classification and forecasting, among others. In addition, sktime allows you to easily apply an algorithm for one task to solve another (e.g. a scikit-learn regressor to solve a forecasting problem). In the tutorial, you will learn about how you can identify these problems, what their key differences are and how they are related. To solve these problems, sktime provides various time series algorithms and modular tools for pipelining, composition and tuning. In addition, sktime is interoperable with common libraries in the data science stack, including scikit-learn, statsmodels and prophet. You will learn how to use, combine, tune and evaluate different algorithms on real-world data sets. We'll work through all of this step by step using Jupyter Notebooks. sktime is an openly governed open source community where everyone can join or become a leader. We encourage contributions and provide mentoring opportunities. false https://programme.europython.eu/europython-2023/talk/CRTSNK/ https://programme.europython.eu/europython-2023/talk/CRTSNK/feedback/ Club B Tutorial 2023-07-17T11:15:00+02:00 11:15 01:30 This tutorial presents sktime - a unified, open source framework for machine learning with time series in python. sktime provides interfaces to algorithms of various types, and modular tools for pipelining, composition, and tuning. You will learn how identify your learning task, and how to build, use, and evaluate different algorithms on real-world data sets. All tutorial notebooks are available in this repository and runnable from the cloud: https://github.com/sktime/sktime-tutorial-europython-2023 europython-2023-29642-1-sktime-python-toolbox-for-time-series PyData: Software Packages & Jupyter (2023) Franz KiralySagar MishraKiril Ralinovski en Time series are ubiquitous in real-world applications, but often add considerable complications to data science workflows. In this tutorial, we will present sktime - a unified framework for machine learning with time series. sktime covers multiple time series learning problems, including time series transformation, classification and forecasting, among others. In addition, sktime allows you to easily apply an algorithm for one task to solve another (e.g. a scikit-learn regressor to solve a forecasting problem). In the tutorial, you will learn about how you can identify these problems, what their key differences are and how they are related. To solve these problems, sktime provides various time series algorithms and modular tools for pipelining, composition and tuning. In addition, sktime is interoperable with common libraries in the data science stack, including scikit-learn, statsmodels and prophet. You will learn how to use, combine, tune and evaluate different algorithms on real-world data sets. We'll work through all of this step by step using Jupyter Notebooks. sktime is an openly governed open source community where everyone can join or become a leader. We encourage contributions and provide mentoring opportunities. false https://programme.europython.eu/europython-2023/talk/CRTSNK/ https://programme.europython.eu/europython-2023/talk/CRTSNK/feedback/ Club B Tutorial 2023-07-17T13:45:00+02:00 13:45 01:30 In a world, full of Micro-Services, distributing tasks is a constant challenge, and there's only one tool that can rule them all. In this workshop, we'll introduce Celery - a tool for distributing tasks in an easy, fast, and flexible manner, and take you from zero to hero! - We're going to understand why we need a distributed task system, and why to choose Celery. - We'll write our first Celery task. - Understand how to configure and run Celery. - Familiarize ourselves with Celery's fundamental concepts. - Dive into celery customizable options. - Finally, we'll see a real-life example of how we used Celery in our production system and how we customized it to fit our needs, and discuss how you can do the same. europython-2023-28791-0-food-for-rabbits-celery-from-zero-to-hero TBD - Multiple Tracks (2023) Roy M Mezan en **Outline:** - Setup [5 min] - What is Celery? When to use it and why. [5 min] - Let's write our first Celery Task. [5 min + 10 min Exercise] - Getting statuses and results. [5 min + 15 min Exercise] - The Celery Worker. [5 min] - Go configure - the Celery Config. [5 min] - Customize it & Retry [10 min + 15 min Exercise] - Break - [15min] - Celery Workflows and Signature. [10 min + 25 min Exercise] - How we use Celery to solve complex problems & Production use-case [10 min] - Final Excercise [40 min] - Recap [5 min] --- ## [link to the workshop materials](https://gitlab.com/88roy88/celery_workshop) false https://programme.europython.eu/europython-2023/talk/Z7HAUH/ https://programme.europython.eu/europython-2023/talk/Z7HAUH/feedback/ Club B Tutorial 2023-07-17T15:30:00+02:00 15:30 01:30 In a world, full of Micro-Services, distributing tasks is a constant challenge, and there's only one tool that can rule them all. In this workshop, we'll introduce Celery - a tool for distributing tasks in an easy, fast, and flexible manner, and take you from zero to hero! - We're going to understand why we need a distributed task system, and why to choose Celery. - We'll write our first Celery task. - Understand how to configure and run Celery. - Familiarize ourselves with Celery's fundamental concepts. - Dive into celery customizable options. - Finally, we'll see a real-life example of how we used Celery in our production system and how we customized it to fit our needs, and discuss how you can do the same. europython-2023-28791-1-food-for-rabbits-celery-from-zero-to-hero TBD - Multiple Tracks (2023) Roy M Mezan en **Outline:** - Setup [5 min] - What is Celery? When to use it and why. [5 min] - Let's write our first Celery Task. [5 min + 10 min Exercise] - Getting statuses and results. [5 min + 15 min Exercise] - The Celery Worker. [5 min] - Go configure - the Celery Config. [5 min] - Customize it & Retry [10 min + 15 min Exercise] - Break - [15min] - Celery Workflows and Signature. [10 min + 25 min Exercise] - How we use Celery to solve complex problems & Production use-case [10 min] - Final Excercise [40 min] - Recap [5 min] --- ## [link to the workshop materials](https://gitlab.com/88roy88/celery_workshop) false https://programme.europython.eu/europython-2023/talk/Z7HAUH/ https://programme.europython.eu/europython-2023/talk/Z7HAUH/feedback/ Club C Conference Workshop 2023-07-17T09:30:00+02:00 09:30 01:30 Are you a complete beginner to coding, but would love to learn how to get started? Have you been curious about data science, but feel overwhelmed with all the talk of AI? Many people working in data science were once in the same position and know how hard it is to take those first steps. However, fear not! It’s easier than you think to get started, and to help make this transition easier we’re hosting a workshop to teach beginners how to get started in Python and data science. We’ll start with Python basics, and show you how you can use this knowledge to easily read and transform data using Pandas, Python’s powerful data analysis library. You’ll also see how you can create beautiful, customized visualizations in Python using packages such as Matplotlib and Seaborn. You’ll also learn how to use a core data science tool, Jupyter notebooks, to run and check the output of your code. See more details on the workshop here: https://ep2023.europython.eu/humble-data europython-2023-33697-0-humble-data Jodie BurchellLais Carvalho en This workshop is aimed at both those with no programming experience, and those with some experience in Python who want to get started in data science, and who want to learn in a supportive, relaxed and empathic environment. As part of the workshop, participants will work through a series of approachable tutorials with the help of a mentor. For 3 hours (breaks included) we will have teams that will work together with mentors to do plenty of exercises, quizzes and games, to go from Zero to Hero in Python data science. All that participants will need to bring is a tablet or a laptop with internet access - we will help them get started with the rest! false https://programme.europython.eu/europython-2023/talk/BABLES/ https://programme.europython.eu/europython-2023/talk/BABLES/feedback/ Club C Conference Workshop 2023-07-17T11:15:00+02:00 11:15 01:30 Are you a complete beginner to coding, but would love to learn how to get started? Have you been curious about data science, but feel overwhelmed with all the talk of AI? Many people working in data science were once in the same position and know how hard it is to take those first steps. However, fear not! It’s easier than you think to get started, and to help make this transition easier we’re hosting a workshop to teach beginners how to get started in Python and data science. We’ll start with Python basics, and show you how you can use this knowledge to easily read and transform data using Pandas, Python’s powerful data analysis library. You’ll also see how you can create beautiful, customized visualizations in Python using packages such as Matplotlib and Seaborn. You’ll also learn how to use a core data science tool, Jupyter notebooks, to run and check the output of your code. See more details on the workshop here: https://ep2023.europython.eu/humble-data europython-2023-33697-1-humble-data Jodie BurchellLais Carvalho en This workshop is aimed at both those with no programming experience, and those with some experience in Python who want to get started in data science, and who want to learn in a supportive, relaxed and empathic environment. As part of the workshop, participants will work through a series of approachable tutorials with the help of a mentor. For 3 hours (breaks included) we will have teams that will work together with mentors to do plenty of exercises, quizzes and games, to go from Zero to Hero in Python data science. All that participants will need to bring is a tablet or a laptop with internet access - we will help them get started with the rest! false https://programme.europython.eu/europython-2023/talk/BABLES/ https://programme.europython.eu/europython-2023/talk/BABLES/feedback/ Club C Conference Workshop 2023-07-17T13:45:00+02:00 13:45 01:30 europython-2023-33699-0-women-in-ai-workshop Nabanita RoyLiliya Akhtyamova en false https://programme.europython.eu/europython-2023/talk/73TAHG/ https://programme.europython.eu/europython-2023/talk/73TAHG/feedback/ Club C Conference Workshop 2023-07-17T15:30:00+02:00 15:30 01:30 europython-2023-33699-1-women-in-ai-workshop Nabanita RoyLiliya Akhtyamova en false https://programme.europython.eu/europython-2023/talk/73TAHG/ https://programme.europython.eu/europython-2023/talk/73TAHG/feedback/ Club D Free Workshop 2023-07-17T09:30:00+02:00 09:30 01:30 europython-2023-33698-0-beginners-day-pyladies-snake-workshop Petr ViktorinMia Bajić en false https://programme.europython.eu/europython-2023/talk/JWTGPG/ https://programme.europython.eu/europython-2023/talk/JWTGPG/feedback/ Club D Free Workshop 2023-07-17T11:15:00+02:00 11:15 01:30 europython-2023-33698-1-beginners-day-pyladies-snake-workshop Petr ViktorinMia Bajić en false https://programme.europython.eu/europython-2023/talk/JWTGPG/ https://programme.europython.eu/europython-2023/talk/JWTGPG/feedback/ Club D Free Workshop 2023-07-17T13:45:00+02:00 13:45 01:30 europython-2023-33698-2-beginners-day-pyladies-snake-workshop Petr ViktorinMia Bajić en false https://programme.europython.eu/europython-2023/talk/JWTGPG/ https://programme.europython.eu/europython-2023/talk/JWTGPG/feedback/ Club D Free Workshop 2023-07-17T15:30:00+02:00 15:30 01:30 europython-2023-33698-3-beginners-day-pyladies-snake-workshop Petr ViktorinMia Bajić en false https://programme.europython.eu/europython-2023/talk/JWTGPG/ https://programme.europython.eu/europython-2023/talk/JWTGPG/feedback/ Club A Announcements 2023-07-18T08:30:00+02:00 08:30 01:00 Welcome to EuroPython 2023! You can pick up your badges at any time during the week as long as we are open! If you want to avoid the morning rush on Wednesday, come on Monday and Tuesday! Queues will be sorted by your **first name** on your ticket. Your ticket can be located via your order confirmation email (from support@pretix.eu with the Subject: Your order: XXXX). If you ordered your ticket after we've sent badges for printing (after 10 July), go directly to the Info Desk (also referred as Debugging Desk) and a volunteer will help! europython-2023-35574-registration-welcome-forum-hall-foyer-1st-floor en false https://programme.europython.eu/europython-2023/talk/3KTQQW/ https://programme.europython.eu/europython-2023/talk/3KTQQW/feedback/ Club A Tutorial 2023-07-18T09:30:00+02:00 09:30 01:30 Information is abundant and readily available on the internet. However, the sheer amount of data can be overwhelming and time-consuming to navigate through. That's where web scraping comes in - a powerful tool used to extract data from websites and turn it into a usable format. In this tutorial, we will explore the basics of web scraping and how to implement it using Scrapy (a Python framework). Whether you are a data analyst, programmer, or researcher, this tutorial will equip you with the fundamental skills needed to create your own web scraper and extract valuable information from websites. europython-2023-29497-0-gathering-data-from-the-web-using-python Python Libraries (2023) Renne Rocha en During the tutorial, we will learn concepts of web scraping doing some exercises against a fake website with challenges that are very similar to the ones we will find in real websites using Scrapy, a Python framework designed for web scraping tasks. **To better follow the tutorial, it would be good to install Scrapy in your machine**. More information at https://github.com/rennerocha/europython-2023-gathering-data-tutorial#before-the-tutorial 1. (presentation) Web scraping fundamentals - What is web scraping, why we want to do web scraping and real use cases for web scraping 2. (presentation) Scrapy basic concepts - What is Scrapy, what its advantages over other tools, its basic classes (Spider, Request, Response, parses) and how to create a very simple web crawler 3. (presentation + exercise) Scraping a basic HTML page - Gathering data from http://quotes.toscrape.com/, a plain well-structure HTML page 4. (presentation exercise) Scraping Javascript generated content (external API) - Gathering data from http://quotes.toscrape.com/scroll, where the data is gathered from an API call 5. (presentation + exercise) Scraping Javascript generated content (data into HTML) - Gathering data from http://quotes.toscrape.com/js/, where the data to be gathered is located inside the HTML code, but processed by Javascript 6. (presentation + exercise) Scraping page with forms and ViewState - Gathering data from http://quotes.toscrape.com/search.aspx, where we need to handle forms submission and ViewStates 7. (presentation) Proxies and headless browsers - When simple requests are not enough, what other tools we have to proceed 8. (presentation) Being polite and not gathering data you shouldn't gather - How to avoid interfering in your target website and some restrictions about what data you can and you can't gather false Slides and Code Samples of the Tutorial https://programme.europython.eu/europython-2023/talk/FGWHPW/ https://programme.europython.eu/europython-2023/talk/FGWHPW/feedback/ Club A Tutorial 2023-07-18T11:15:00+02:00 11:15 01:30 Information is abundant and readily available on the internet. However, the sheer amount of data can be overwhelming and time-consuming to navigate through. That's where web scraping comes in - a powerful tool used to extract data from websites and turn it into a usable format. In this tutorial, we will explore the basics of web scraping and how to implement it using Scrapy (a Python framework). Whether you are a data analyst, programmer, or researcher, this tutorial will equip you with the fundamental skills needed to create your own web scraper and extract valuable information from websites. europython-2023-29497-1-gathering-data-from-the-web-using-python Python Libraries (2023) Renne Rocha en During the tutorial, we will learn concepts of web scraping doing some exercises against a fake website with challenges that are very similar to the ones we will find in real websites using Scrapy, a Python framework designed for web scraping tasks. **To better follow the tutorial, it would be good to install Scrapy in your machine**. More information at https://github.com/rennerocha/europython-2023-gathering-data-tutorial#before-the-tutorial 1. (presentation) Web scraping fundamentals - What is web scraping, why we want to do web scraping and real use cases for web scraping 2. (presentation) Scrapy basic concepts - What is Scrapy, what its advantages over other tools, its basic classes (Spider, Request, Response, parses) and how to create a very simple web crawler 3. (presentation + exercise) Scraping a basic HTML page - Gathering data from http://quotes.toscrape.com/, a plain well-structure HTML page 4. (presentation exercise) Scraping Javascript generated content (external API) - Gathering data from http://quotes.toscrape.com/scroll, where the data is gathered from an API call 5. (presentation + exercise) Scraping Javascript generated content (data into HTML) - Gathering data from http://quotes.toscrape.com/js/, where the data to be gathered is located inside the HTML code, but processed by Javascript 6. (presentation + exercise) Scraping page with forms and ViewState - Gathering data from http://quotes.toscrape.com/search.aspx, where we need to handle forms submission and ViewStates 7. (presentation) Proxies and headless browsers - When simple requests are not enough, what other tools we have to proceed 8. (presentation) Being polite and not gathering data you shouldn't gather - How to avoid interfering in your target website and some restrictions about what data you can and you can't gather false Slides and Code Samples of the Tutorial https://programme.europython.eu/europython-2023/talk/FGWHPW/ https://programme.europython.eu/europython-2023/talk/FGWHPW/feedback/ Club A Tutorial 2023-07-18T13:45:00+02:00 13:45 01:30 You don't have to be an Ops expert to make Kubernetes useful! In this workshop, you will learn how to overcome complexity, and love Kubernetes as a Platform to deploy a Python web application or your data science and machine learning pipelines. You will learn how and when to use basic elements of Kubernetes like Deployments and Stateful Sets. Once you understand these basic elements, you will learn how to extend Kubernetes using Python. You will learn how to define custom resources and controllers to automate all things related to your applications' life cycle, from ETL through sending email for password reset to where your imagination stops. In the end of this workshop, you will have deployed a python web application and successfully extend Kubernetes with so-called operators to manage the complete life-cycle of your application. europython-2023-29261-0-kubernetes-3-python-deploy-python-apps-extend-kubernetes-with-python Infrastructure: Cloud & Hardware (2023) Oz Tiram en Why you need this workshop? Kubernetes is a platform for running applications on one or more computer. It provides a command line and a set of APIs to provision applications, virtual machines and even a complete cloud infrastructure. In this workshop, you will learn why Kubernetes is a great platform to host your applications or run your data pipeline consistently - whether you run on a single Raspberry Pi or tens of Virtual machines in the public cloud. What will you do in this workshop? 1. You will see that deploying Kubernetes isn't hard. You can use a single node or a cluster. Furthermore, you will learn the differences and trade-off between managed Kubernetes and DIY approach. 2. After a basic introduction to Kubernetes, you will learn to deploy and run a web application written in Python using a Kubernetes deployment and store data in a data using a Stateful Set. You will learn how to define these resources using YAML manifests and learn to use a pure Python alternative to create these manifests. 3. Finally, you will learn how you can extend Kubernetes to more than just serving a web application to almost anything you want, using so-called Kubernetes Operators. To do this, you will create a Kubernetes "extension". You first learn how to store your own data inside Kubernetes, using Custom Resources. Once you define your own custom definitions, you will learn how to create a controller that interacts with this data and other objects in your Kubernetes. The ultimate goal of this training: By the end of this workshop, you will know how to deploy a Python application, and you will be able to extend Kubernetes using operators written also in Python. false Workshop notes https://programme.europython.eu/europython-2023/talk/WB7ALT/ https://programme.europython.eu/europython-2023/talk/WB7ALT/feedback/ Club A Tutorial 2023-07-18T15:30:00+02:00 15:30 01:30 You don't have to be an Ops expert to make Kubernetes useful! In this workshop, you will learn how to overcome complexity, and love Kubernetes as a Platform to deploy a Python web application or your data science and machine learning pipelines. You will learn how and when to use basic elements of Kubernetes like Deployments and Stateful Sets. Once you understand these basic elements, you will learn how to extend Kubernetes using Python. You will learn how to define custom resources and controllers to automate all things related to your applications' life cycle, from ETL through sending email for password reset to where your imagination stops. In the end of this workshop, you will have deployed a python web application and successfully extend Kubernetes with so-called operators to manage the complete life-cycle of your application. europython-2023-29261-1-kubernetes-3-python-deploy-python-apps-extend-kubernetes-with-python Infrastructure: Cloud & Hardware (2023) Oz Tiram en Why you need this workshop? Kubernetes is a platform for running applications on one or more computer. It provides a command line and a set of APIs to provision applications, virtual machines and even a complete cloud infrastructure. In this workshop, you will learn why Kubernetes is a great platform to host your applications or run your data pipeline consistently - whether you run on a single Raspberry Pi or tens of Virtual machines in the public cloud. What will you do in this workshop? 1. You will see that deploying Kubernetes isn't hard. You can use a single node or a cluster. Furthermore, you will learn the differences and trade-off between managed Kubernetes and DIY approach. 2. After a basic introduction to Kubernetes, you will learn to deploy and run a web application written in Python using a Kubernetes deployment and store data in a data using a Stateful Set. You will learn how to define these resources using YAML manifests and learn to use a pure Python alternative to create these manifests. 3. Finally, you will learn how you can extend Kubernetes to more than just serving a web application to almost anything you want, using so-called Kubernetes Operators. To do this, you will create a Kubernetes "extension". You first learn how to store your own data inside Kubernetes, using Custom Resources. Once you define your own custom definitions, you will learn how to create a controller that interacts with this data and other objects in your Kubernetes. The ultimate goal of this training: By the end of this workshop, you will know how to deploy a Python application, and you will be able to extend Kubernetes using operators written also in Python. false Workshop notes https://programme.europython.eu/europython-2023/talk/WB7ALT/ https://programme.europython.eu/europython-2023/talk/WB7ALT/feedback/ Club E Tutorial 2023-07-18T09:30:00+02:00 09:30 01:30 In a hands-on workshop I'll introduce some of the tools and methods I have developed to improve documentation consistently and effectively, at scale - by a thousand people or more, working on a hundred or so software products and other projects. europython-2023-29891-0-practical-tools-for-documentation-at-scale Software Engineering & Architecture (2023) Daniele Procida en At Canonical, I lead documentation practice - the way we, as an organisation, do documentation. That means establishing a shared understanding of standards, and how to reach them. To help do this I have developed a number of tools and methods to help all of us understand our progress and achieve it faster. In this hands-on workshop I will introduce some of them, and help you start to adapt them to your own needs. I hope that this workshop will be of value to anyone working in an engineering organisation where documentation discipline and success seems harder to obtain than it should be. false https://programme.europython.eu/europython-2023/talk/3HR8HZ/ https://programme.europython.eu/europython-2023/talk/3HR8HZ/feedback/ Club E Tutorial 2023-07-18T11:15:00+02:00 11:15 01:30 In a hands-on workshop I'll introduce some of the tools and methods I have developed to improve documentation consistently and effectively, at scale - by a thousand people or more, working on a hundred or so software products and other projects. europython-2023-29891-1-practical-tools-for-documentation-at-scale Software Engineering & Architecture (2023) Daniele Procida en At Canonical, I lead documentation practice - the way we, as an organisation, do documentation. That means establishing a shared understanding of standards, and how to reach them. To help do this I have developed a number of tools and methods to help all of us understand our progress and achieve it faster. In this hands-on workshop I will introduce some of them, and help you start to adapt them to your own needs. I hope that this workshop will be of value to anyone working in an engineering organisation where documentation discipline and success seems harder to obtain than it should be. false https://programme.europython.eu/europython-2023/talk/3HR8HZ/ https://programme.europython.eu/europython-2023/talk/3HR8HZ/feedback/ Club E Tutorial 2023-07-18T13:45:00+02:00 13:45 01:30 pytest lets you write simple tests fast - but also scales to very complex scenarios: Beyond the basics of no-boilerplate test functions, this training will show various intermediate/advanced features, as well as gems and tricks. To attend this training, you should already be familiar with the pytest basics (e.g. writing test functions, parametrize, or what a fixture is) and want to learn how to take the next step to improve your test suites. If you're already familiar with things like fixture caching scopes, autouse, or using the built-in tmp_path/monkeypatch/... fixtures: There will probably be some slides about concepts you already know, but there are also various little hidden tricks and gems I'll be showing. europython-2023-29310-0-pytest-tips-and-tricks-for-a-better-testsuite Testing (2023) Freya Bruhin en We'll cover things like: - Recommended pytest settings for more strictness - What's xfail and why is it useful? - How to mark an entire test file or single parameters - Ways to deal with parametrize IDs and syntax - Useful built-in pytest fixtures - Caching for fixtures - Using fixtures implicitly - Advanced fixture and parametrization topics - How to customize fixtures behavior based on markers or custom CLI arguments - Patching, mocking, and alternatives - Various useful plugins, and how to write your own - Short intro to property-based testing with Hypothesis false https://programme.europython.eu/europython-2023/talk/TGRMDT/ https://programme.europython.eu/europython-2023/talk/TGRMDT/feedback/ Club E Tutorial 2023-07-18T15:30:00+02:00 15:30 01:30 pytest lets you write simple tests fast - but also scales to very complex scenarios: Beyond the basics of no-boilerplate test functions, this training will show various intermediate/advanced features, as well as gems and tricks. To attend this training, you should already be familiar with the pytest basics (e.g. writing test functions, parametrize, or what a fixture is) and want to learn how to take the next step to improve your test suites. If you're already familiar with things like fixture caching scopes, autouse, or using the built-in tmp_path/monkeypatch/... fixtures: There will probably be some slides about concepts you already know, but there are also various little hidden tricks and gems I'll be showing. europython-2023-29310-1-pytest-tips-and-tricks-for-a-better-testsuite Testing (2023) Freya Bruhin en We'll cover things like: - Recommended pytest settings for more strictness - What's xfail and why is it useful? - How to mark an entire test file or single parameters - Ways to deal with parametrize IDs and syntax - Useful built-in pytest fixtures - Caching for fixtures - Using fixtures implicitly - Advanced fixture and parametrization topics - How to customize fixtures behavior based on markers or custom CLI arguments - Patching, mocking, and alternatives - Various useful plugins, and how to write your own - Short intro to property-based testing with Hypothesis false https://programme.europython.eu/europython-2023/talk/TGRMDT/ https://programme.europython.eu/europython-2023/talk/TGRMDT/feedback/ Club H Tutorial 2023-07-18T09:30:00+02:00 09:30 01:30 This tutorial provides a hands-on introduction to LocalStack - the leading platform to develop and test cloud applications entirely on your local machine! LocalStack provides a set of 70+ AWS services, running in a local Docker container. The hugely popular open source project (46k+ Github stars, 130+ million downloads) is today considered a “must-have” in the toolbox of every AWS cloud developer around the globe. Outline: (1) Intro to AWS cloud development with Python (2) Developing Python cloud apps with LocalStack (3) Advanced integrations for IaC and CI/CD pipelines (4) Python internals & advanced features in LocalStack (5) Summary and wrap-up This interactive session covers live coding to showcase common use cases, settings for local debugging of Lambdas and containerized apps, as well as advanced features that can radically improve team collaboration. We'll also glance over the large ecosystem of tools & integrations - including Terraform, Pulumi, CDK, Serverless. europython-2023-29607-0-develop-your-python-cloud-applications-offline-with-localstack Software Engineering & Architecture (2023) Waldemar HummerThomas RauschAlex Rashed en In this tutorial, we provide a hands-on introduction to LocalStack - the leading community platform that allows you to develop and test cloud&serverless applications entirely on your local machine, without ever having to connect to the real cloud! LocalStack is the leading AWS cloud emulator that provides a set of 70+ AWS services, running in a Docker container entirely on your local machine. Being a hugely popular open source project, LocalStack is among the top ~150 all-time repositories ranked on Github (46k+ stars), has been downloaded over 130+ million times, and is today considered a “must-have” in the toolbox of every AWS cloud developer around the globe. This tutorial is designed to follow along on participants’ own laptops. There are no special requirements - literally the only prerequisite is having Python 3.x and Docker installed on the local machine. We are going to develop AWS applications, but since LocalStack runs entirely on the local machine without ever talking to the real cloud, *no* cloud access credentials are required to follow the tutorial. The tutorial is structured as follows: (1) Intro to AWS cloud development with Python (0:00-0:30h) (2) Developing Python cloud apps with LocalStack (0:30-1:30h) (3) Advanced integrations for IaC and CI/CD pipelines (1:30-2:15h) (4) Python internals and advanced team collaboration features in LocalStack (2:15-2:45h) (5) Summary and wrap-up (2:45-3:00h) The session covers interactive live coding to showcase common scenarios and use cases, different settings for local debugging of Lambdas and containerized apps (e.g., ECS/EKS), as well as some advanced new features that can radically improve productivity and team collaboration patterns. We will also glance over the large ecosystem of tools that LocalStack natively integrates with - from IaC frameworks like Terraform or Pulumi, to application frameworks like Serverless, to a whole suite of tools in the AWS ecosystem, including CDK, SAM, Copilot, Chalice, etc. false https://programme.europython.eu/europython-2023/talk/PZQHFU/ https://programme.europython.eu/europython-2023/talk/PZQHFU/feedback/ Club H Tutorial 2023-07-18T11:15:00+02:00 11:15 01:30 This tutorial provides a hands-on introduction to LocalStack - the leading platform to develop and test cloud applications entirely on your local machine! LocalStack provides a set of 70+ AWS services, running in a local Docker container. The hugely popular open source project (46k+ Github stars, 130+ million downloads) is today considered a “must-have” in the toolbox of every AWS cloud developer around the globe. Outline: (1) Intro to AWS cloud development with Python (2) Developing Python cloud apps with LocalStack (3) Advanced integrations for IaC and CI/CD pipelines (4) Python internals & advanced features in LocalStack (5) Summary and wrap-up This interactive session covers live coding to showcase common use cases, settings for local debugging of Lambdas and containerized apps, as well as advanced features that can radically improve team collaboration. We'll also glance over the large ecosystem of tools & integrations - including Terraform, Pulumi, CDK, Serverless. europython-2023-29607-1-develop-your-python-cloud-applications-offline-with-localstack Software Engineering & Architecture (2023) Waldemar HummerThomas RauschAlex Rashed en In this tutorial, we provide a hands-on introduction to LocalStack - the leading community platform that allows you to develop and test cloud&serverless applications entirely on your local machine, without ever having to connect to the real cloud! LocalStack is the leading AWS cloud emulator that provides a set of 70+ AWS services, running in a Docker container entirely on your local machine. Being a hugely popular open source project, LocalStack is among the top ~150 all-time repositories ranked on Github (46k+ stars), has been downloaded over 130+ million times, and is today considered a “must-have” in the toolbox of every AWS cloud developer around the globe. This tutorial is designed to follow along on participants’ own laptops. There are no special requirements - literally the only prerequisite is having Python 3.x and Docker installed on the local machine. We are going to develop AWS applications, but since LocalStack runs entirely on the local machine without ever talking to the real cloud, *no* cloud access credentials are required to follow the tutorial. The tutorial is structured as follows: (1) Intro to AWS cloud development with Python (0:00-0:30h) (2) Developing Python cloud apps with LocalStack (0:30-1:30h) (3) Advanced integrations for IaC and CI/CD pipelines (1:30-2:15h) (4) Python internals and advanced team collaboration features in LocalStack (2:15-2:45h) (5) Summary and wrap-up (2:45-3:00h) The session covers interactive live coding to showcase common scenarios and use cases, different settings for local debugging of Lambdas and containerized apps (e.g., ECS/EKS), as well as some advanced new features that can radically improve productivity and team collaboration patterns. We will also glance over the large ecosystem of tools that LocalStack natively integrates with - from IaC frameworks like Terraform or Pulumi, to application frameworks like Serverless, to a whole suite of tools in the AWS ecosystem, including CDK, SAM, Copilot, Chalice, etc. false https://programme.europython.eu/europython-2023/talk/PZQHFU/ https://programme.europython.eu/europython-2023/talk/PZQHFU/feedback/ Club H Tutorial 2023-07-18T13:45:00+02:00 13:45 01:30 We will explore possibilities for making our data analyses and transformations in Pandas robust and production ready. We will see how advanced group-by, resample or rolling aggregations work on large time series weather data. (As a bonus, you will learn about Prague climate.) We will use type annotations and schema validations with the Pandera library to make our code more readable and robust. We will also show the potential of property-based testing using the Hypothesis package, with strategies generated from Pandera schemas. We will show how to avoid issues with time zones when working with time series data. By the end of the tutorial, you will have a deeper understanding of advanced Pandas aggregations and be able to write robust, production ready Pandas code. europython-2023-35393-0-robust-data-transformation-with-pandas-typing-validation-testing Jakub UrbanJan Pipek en ## Instructions Before attending the workshop, it's important to prepare your environment by following the **instructions in the repository located at https://github.com/coobas/robust-pandas-workshop**. This will ensure that you have all the necessary tools and dependencies installed to participate in the workshop. Please note that we will be continuously updating the repository leading up to the workshop, so it's important to **pull the latest changes on the day of the workshop** to ensure that you have the most up-to-date materials. false https://programme.europython.eu/europython-2023/talk/AEAPDB/ https://programme.europython.eu/europython-2023/talk/AEAPDB/feedback/ Club H Tutorial 2023-07-18T15:30:00+02:00 15:30 01:30 We will explore possibilities for making our data analyses and transformations in Pandas robust and production ready. We will see how advanced group-by, resample or rolling aggregations work on large time series weather data. (As a bonus, you will learn about Prague climate.) We will use type annotations and schema validations with the Pandera library to make our code more readable and robust. We will also show the potential of property-based testing using the Hypothesis package, with strategies generated from Pandera schemas. We will show how to avoid issues with time zones when working with time series data. By the end of the tutorial, you will have a deeper understanding of advanced Pandas aggregations and be able to write robust, production ready Pandas code. europython-2023-35393-1-robust-data-transformation-with-pandas-typing-validation-testing Jakub UrbanJan Pipek en ## Instructions Before attending the workshop, it's important to prepare your environment by following the **instructions in the repository located at https://github.com/coobas/robust-pandas-workshop**. This will ensure that you have all the necessary tools and dependencies installed to participate in the workshop. Please note that we will be continuously updating the repository leading up to the workshop, so it's important to **pull the latest changes on the day of the workshop** to ensure that you have the most up-to-date materials. false https://programme.europython.eu/europython-2023/talk/AEAPDB/ https://programme.europython.eu/europython-2023/talk/AEAPDB/feedback/ Club B Tutorial 2023-07-18T09:30:00+02:00 09:30 01:30 with Jeremy europython-2023-33701-0-write-your-first-web-api-with-rust Jeremy Lempereur en In this 180 minutes tutorial, we will take a hands on approach to Rust, and write our first web API! We will only focus on the parts you'll need to know to start building APIs, so you can learn while you build! No need to know Rust as long as you're curious about the language. If you've already built web APIs in python, you should be good to go! false https://programme.europython.eu/europython-2023/talk/ZSCRBC/ https://programme.europython.eu/europython-2023/talk/ZSCRBC/feedback/ Club B Tutorial 2023-07-18T11:15:00+02:00 11:15 01:30 with Jeremy europython-2023-33701-1-write-your-first-web-api-with-rust Jeremy Lempereur en In this 180 minutes tutorial, we will take a hands on approach to Rust, and write our first web API! We will only focus on the parts you'll need to know to start building APIs, so you can learn while you build! No need to know Rust as long as you're curious about the language. If you've already built web APIs in python, you should be good to go! false https://programme.europython.eu/europython-2023/talk/ZSCRBC/ https://programme.europython.eu/europython-2023/talk/ZSCRBC/feedback/ Club B Tutorial 2023-07-18T13:45:00+02:00 13:45 01:30 This workshop will teach you how to create your first GraphQL API using Python and Strawberry. We will be using using Fastapi as our framework of choice, but most of the concept will be applicable to other frameworks too. We'll learn how GraphQL works under the hood, and how we can leverage type hints to create end to end type safe GraphQL queries. To run this workshop you need to have at least python 3.8 and have followed the installation guide here: https://github.com/patrick91/strawberry-tiny-workshop europython-2023-35672-build-your-first-graphql-api-using-python Web (2023) Patrick Arminio en false https://programme.europython.eu/europython-2023/talk/ADBP8B/ https://programme.europython.eu/europython-2023/talk/ADBP8B/feedback/ Club B Tutorial 2023-07-18T15:30:00+02:00 15:30 01:30 Descriptors are not black magic and this practical tutorial will show you that. In fact, you use descriptors every day and you don't even know it! Through a series of practical, hands-on exercises, you will learn - how to create a descriptor; - how to use the dunder methods `__get__`, `__set__`, and `__set_name__`; - what the descriptor protocol is; and - where descriptors show up in day-to-day Python code. europython-2023-35732-practical-introduction-to-descriptors Python Internals & Ecosystem (2023) Rodrigo Girão Serrão en The expected Python level for participants is “intermediate”. In practice, if you are comfortable with using the built-in `property` and if you have used [dunder methods](https://mathspp.com/blog/pydonts/dunder-methods) before, you should be fine. This tutorial is based off of [an article I wrote about descriptors](https://mathspp.com/blog/pydonts/describing-descriptors). All materials can be accessed from [this GH repo](https://github.com/mathspp/talks). false https://programme.europython.eu/europython-2023/talk/SXEJWS/ https://programme.europython.eu/europython-2023/talk/SXEJWS/feedback/ Club C Conference Workshop 2023-07-18T09:30:00+02:00 09:30 01:30 This summit aims to bring together maintainers and users of the Python with WebAssembly, to discuss the state of this ecosystem, existing challenges and ongoing work. Find out more, including how to sign up, here: [https://ep2023.europython.eu/wasm](https://ep2023.europython.eu/wasm) europython-2023-33700-0-wasm-summit Roman YurchakNicholas Tollervey en Agenda: * 9:00: Meet and greet (many of us won’t know each other) + unconference-y post-it based organisation. * 9:30: Presentations (30mins each) * 11:00: Coffee * 11:20: Presentations * 13:00: Lunch at the PCC (included) * 14:00: Unconference-y activities (discussions, hacks, ad hoc tutorials etc…) * 16:00: Round-up / plenary session for feedback and organising next steps. * 18:30: Dinner false https://programme.europython.eu/europython-2023/talk/MQRJXF/ https://programme.europython.eu/europython-2023/talk/MQRJXF/feedback/ Club C Conference Workshop 2023-07-18T11:15:00+02:00 11:15 01:30 This summit aims to bring together maintainers and users of the Python with WebAssembly, to discuss the state of this ecosystem, existing challenges and ongoing work. Find out more, including how to sign up, here: [https://ep2023.europython.eu/wasm](https://ep2023.europython.eu/wasm) europython-2023-33700-1-wasm-summit Roman YurchakNicholas Tollervey en Agenda: * 9:00: Meet and greet (many of us won’t know each other) + unconference-y post-it based organisation. * 9:30: Presentations (30mins each) * 11:00: Coffee * 11:20: Presentations * 13:00: Lunch at the PCC (included) * 14:00: Unconference-y activities (discussions, hacks, ad hoc tutorials etc…) * 16:00: Round-up / plenary session for feedback and organising next steps. * 18:30: Dinner false https://programme.europython.eu/europython-2023/talk/MQRJXF/ https://programme.europython.eu/europython-2023/talk/MQRJXF/feedback/ Club C Conference Workshop 2023-07-18T13:45:00+02:00 13:45 01:30 This summit aims to bring together maintainers and users of the Python with WebAssembly, to discuss the state of this ecosystem, existing challenges and ongoing work. Find out more, including how to sign up, here: [https://ep2023.europython.eu/wasm](https://ep2023.europython.eu/wasm) europython-2023-33700-2-wasm-summit Roman YurchakNicholas Tollervey en Agenda: * 9:00: Meet and greet (many of us won’t know each other) + unconference-y post-it based organisation. * 9:30: Presentations (30mins each) * 11:00: Coffee * 11:20: Presentations * 13:00: Lunch at the PCC (included) * 14:00: Unconference-y activities (discussions, hacks, ad hoc tutorials etc…) * 16:00: Round-up / plenary session for feedback and organising next steps. * 18:30: Dinner false https://programme.europython.eu/europython-2023/talk/MQRJXF/ https://programme.europython.eu/europython-2023/talk/MQRJXF/feedback/ Club C Conference Workshop 2023-07-18T15:30:00+02:00 15:30 01:30 This summit aims to bring together maintainers and users of the Python with WebAssembly, to discuss the state of this ecosystem, existing challenges and ongoing work. Find out more, including how to sign up, here: [https://ep2023.europython.eu/wasm](https://ep2023.europython.eu/wasm) europython-2023-33700-3-wasm-summit Roman YurchakNicholas Tollervey en Agenda: * 9:00: Meet and greet (many of us won’t know each other) + unconference-y post-it based organisation. * 9:30: Presentations (30mins each) * 11:00: Coffee * 11:20: Presentations * 13:00: Lunch at the PCC (included) * 14:00: Unconference-y activities (discussions, hacks, ad hoc tutorials etc…) * 16:00: Round-up / plenary session for feedback and organising next steps. * 18:30: Dinner false https://programme.europython.eu/europython-2023/talk/MQRJXF/ https://programme.europython.eu/europython-2023/talk/MQRJXF/feedback/ Club D Free Workshop 2023-07-18T09:30:00+02:00 09:30 01:30 Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. FInd more details including how to sign up here: https://ep2023.europython.eu/trans_code europython-2023-33696-0-trans-code Naomi Ceder en Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Trans\*Code events are informal hackdays where participants can explore their ideas in collaboration with like-minded people. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. Trans*Code events are similar to hackathons, but with some key differences: * Events are only one day long. So you don’t need to take off an entire weekend; * Events are not competitive. At Trans\*Code events, we’re all pulling for each other. While we do have final presentations, they are made in the spirit of sharing, not in the spirit of competition; * Events encourage following your interests. Want to work on that project? Fine, do it. Want to spend the morning with this one, and the afternoon with that one? The choice is yours. Trans*Code subscribes to the Un-Conference philosophy - whatever happens is exactly what should happen. false https://programme.europython.eu/europython-2023/talk/P77JBK/ https://programme.europython.eu/europython-2023/talk/P77JBK/feedback/ Club D Free Workshop 2023-07-18T11:15:00+02:00 11:15 01:30 Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. FInd more details including how to sign up here: https://ep2023.europython.eu/trans_code europython-2023-33696-1-trans-code Naomi Ceder en Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Trans\*Code events are informal hackdays where participants can explore their ideas in collaboration with like-minded people. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. Trans*Code events are similar to hackathons, but with some key differences: * Events are only one day long. So you don’t need to take off an entire weekend; * Events are not competitive. At Trans\*Code events, we’re all pulling for each other. While we do have final presentations, they are made in the spirit of sharing, not in the spirit of competition; * Events encourage following your interests. Want to work on that project? Fine, do it. Want to spend the morning with this one, and the afternoon with that one? The choice is yours. Trans*Code subscribes to the Un-Conference philosophy - whatever happens is exactly what should happen. false https://programme.europython.eu/europython-2023/talk/P77JBK/ https://programme.europython.eu/europython-2023/talk/P77JBK/feedback/ Club D Free Workshop 2023-07-18T13:45:00+02:00 13:45 01:30 Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. FInd more details including how to sign up here: https://ep2023.europython.eu/trans_code europython-2023-33696-2-trans-code Naomi Ceder en Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Trans\*Code events are informal hackdays where participants can explore their ideas in collaboration with like-minded people. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. Trans*Code events are similar to hackathons, but with some key differences: * Events are only one day long. So you don’t need to take off an entire weekend; * Events are not competitive. At Trans\*Code events, we’re all pulling for each other. While we do have final presentations, they are made in the spirit of sharing, not in the spirit of competition; * Events encourage following your interests. Want to work on that project? Fine, do it. Want to spend the morning with this one, and the afternoon with that one? The choice is yours. Trans*Code subscribes to the Un-Conference philosophy - whatever happens is exactly what should happen. false https://programme.europython.eu/europython-2023/talk/P77JBK/ https://programme.europython.eu/europython-2023/talk/P77JBK/feedback/ Club D Free Workshop 2023-07-18T15:30:00+02:00 15:30 01:30 Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. FInd more details including how to sign up here: https://ep2023.europython.eu/trans_code europython-2023-33696-3-trans-code Naomi Ceder en Trans\*Code is an international hack event series focused on building connections and community while exploring the tech side of transgender issues and opportunities. Trans\*Code events are informal hackdays where participants can explore their ideas in collaboration with like-minded people. Coders, designers, activists, visionaries of all sorts, and community members not currently working in technology are all welcome and encouraged to participate. Trans*Code events are similar to hackathons, but with some key differences: * Events are only one day long. So you don’t need to take off an entire weekend; * Events are not competitive. At Trans\*Code events, we’re all pulling for each other. While we do have final presentations, they are made in the spirit of sharing, not in the spirit of competition; * Events encourage following your interests. Want to work on that project? Fine, do it. Want to spend the morning with this one, and the afternoon with that one? The choice is yours. Trans*Code subscribes to the Un-Conference philosophy - whatever happens is exactly what should happen. false https://programme.europython.eu/europython-2023/talk/P77JBK/ https://programme.europython.eu/europython-2023/talk/P77JBK/feedback/ Club D Talk 2023-07-18T16:10:00+02:00 16:10 00:50 Are you new to EuroPython or any Python conference? You must have a lot of questions like: - What is a Lightning Talk? - What is an Open Space? - Besides going to talk, what else can I do? - Why everyone seems to know each other, how can I join in conversations? Don't worry, we are here to help you get the most out of your first EuroPython experience. Come to join us in this Beginner Conference Orientation that is tailer made for you. europython-2023-34099-beginner-conference-orientation Cheuk Ting Ho en In this orientation, we will break into 2 parts **1) Suggestions about what you can do as a first-time attendee at the conference (30 mins)** We will give you many tips on how you can get the most out of your experience here at EuroPython. We will also tell you what you can expect at the conference and how to make new connections at the conference. **2) No questions are stupid questions, ask away Q &A session (20 mins)** Since we are here to help we would like to let you ask us questions. We love your questions! Please ask us anything, we are happy to answer and no questions are stupid questions. Slides can be found here: https://drive.google.com/file/d/1Sga1kbrMkmj1rHWpjBispQ-PnTOx0KOi/view?usp=sharing false https://programme.europython.eu/europython-2023/talk/GRDPPX/ https://programme.europython.eu/europython-2023/talk/GRDPPX/feedback/ PyCharm (Forum Hall) Announcements 2023-07-19T08:00:00+02:00 08:00 01:00 Welcome to EuroPython 2023! You can pick up your badges at any time during the week as long as we are open! If you want to avoid the morning rush on Wednesday, come on Monday and Tuesday! Queues will be sorted by your **first name** on your ticket. Your ticket can be located via your order confirmation email (from support@pretix.eu with the Subject: Your order: XXXX). If you ordered your ticket after we've sent badges for printing (after 10 July), go directly to the Info Desk (also referred as Debugging Desk) and a volunteer will help! europython-2023-35610-registration-welcome-forum-hall-foyer-1st-floor en false https://programme.europython.eu/europython-2023/talk/ZPN8UC/ https://programme.europython.eu/europython-2023/talk/ZPN8UC/feedback/ PyCharm (Forum Hall) Announcements 2023-07-19T09:00:00+02:00 09:00 00:30 europython-2023-34200-opening-session en false https://programme.europython.eu/europython-2023/talk/QUQSZH/ https://programme.europython.eu/europython-2023/talk/QUQSZH/feedback/ PyCharm (Forum Hall) Keynote 2023-07-19T09:30:00+02:00 09:30 00:45 The more applications you build, the more libraries you share, the more they become an excuse to meet people and have fun together. What makes it fun? And how do we keep it fun? europython-2023-33369-kindnesses-promises Petr Viktorin en false https://programme.europython.eu/europython-2023/talk/C7SMXT/ https://programme.europython.eu/europython-2023/talk/C7SMXT/feedback/ PyCharm (Forum Hall) Talk 2023-07-19T10:45:00+02:00 10:45 00:30 Python 3.11 is considerably faster than 3.10. How did we do that? And how are we going to make 3.12 and following releases even faster? In this talk, I will present a high level overview of the approach we are taking to speeding up CPython. Starting with a simple overview of some basic principles, I will show how we can apply those to streamline and speedup CPython. I will try to avoid computer science and software engineering terminology, in favor of diagrams, a few simple examples, and some high-school math. Finally, I make some estimates about how much faster the next few releases of CPython will be, and how much faster Python could go. europython-2023-29666-how-we-are-making-cpython-faster-past-present-and-future Python Internals & Ecosystem (2023) Mark Shannon en false https://programme.europython.eu/europython-2023/talk/C3GDXY/ https://programme.europython.eu/europython-2023/talk/C3GDXY/feedback/ PyCharm (Forum Hall) Talk 2023-07-19T11:35:00+02:00 11:35 00:30 Everybody loves f-strings in Python. But what if they could be even better? Thanks to PEP 701, Python 3.12 will ship with an improved version of f-strings that will once and for all fix the little remaining problems that f-strings have had, while also supercharging them with new cool powers. In this talk, you will discover the dark little secrets of how f-strings were being processed before Python 3.12 and the many things that didn't work and you didn't know about. You will learn how we changed thousands of lines of manually written C code without anybody noticing, how we changed the oldest part of CPython so quotes behave like parentheses, and how we taught the PEG parser to understand f-strings. Plus, you'll gain an understanding of how these new and improved capabilities will provide several advantages for both end-users and library developers, while also reducing the maintenance cost of the CPython implementation. europython-2023-29848-f-yeah-how-we-are-supercharging-f-strings-in-python-3-12 Python Internals & Ecosystem (2023) Pablo Galindo SalgadoMarta Gomez en In this talk, we will cover one of the primary syntactic changes of Python 3.12: PEP 701 – Syntactic formalisation of f-strings. Here is the structure of the talk: - How f-strings were originally introduced - Problems with f-strings * Backslashes cannot be used within the expression part of f-strings * It is impossible to use the quote character delimiting the f-string within the expression portion * Comments are forbidden, even in multi-line f-strings * Arbitrary nesting of expressions without expansion of escape sequences is impossible * There is no referential transparency - How f-strings are currently parsed: The two-pass process - How PEP 701 formalises a grammar for f-strings - How we changed the tokeniser and parser to understand f-strings - Syntactic and semantic consequences of the new grammar - Implementation challenges Attendees will not only learn the (normally unknown) problems that f-strings previously had, but also will learn through the journey of how the PEP was implemented several techniques and approaches to changing big codebases such as CPython in an efficient way, while minimising user impact. Attendees will also learn how changes to the CPython grammar that also require lexer changes are implemented, which is quite a unique situation, as most changes to the Python Grammar do not require lexer changes. No matter whether someone is new to Python or an advanced developer that enjoys hacking with the interpreter, there is something in this talk for them. false https://programme.europython.eu/europython-2023/talk/BCDBBR/ https://programme.europython.eu/europython-2023/talk/BCDBBR/feedback/ PyCharm (Forum Hall) Talk 2023-07-19T12:10:00+02:00 12:10 00:30 Updating Python versions often forces us to update native extensions at the same time. But what if you need to update Python because of a security issue, but cannot (yet) move to a newer version of a dependency? Or you are running a proprietary binary extension that cannot easily be recompiled? The HPy project provides a better C extension API for Python. It compiles to binaries that work across all versions of CPython, PyPy, GraalPy. HPy makes porting from the existing C API easy and its design ensures that the binaries we produce today stay binary compatible with future Python versions. NumPy is the single largest direct user of the CPython C API we know of. After over 2 years of work and more than 30k lines of code ported, we can demonstrate NumPy running its tests and benchmarks with HPy. We will show the same NumPy binary run on multiple CPython versions and GraalPy. And we will discuss performance characteristics of this port across CPython, GraalPy, and PyPy. europython-2023-28908-hpy-the-future-of-python-native-extensions Python Internals & Ecosystem (2023) Štěpán ŠindelářFlorian Angerer en false Slides https://programme.europython.eu/europython-2023/talk/NVW8EF/ https://programme.europython.eu/europython-2023/talk/NVW8EF/feedback/ PyCharm (Forum Hall) Panel 2023-07-19T14:00:00+02:00 14:00 01:00 Come meet the folks who make the Python programming language! A panel discussion of core Python developers will take place on Wednesday at 2pm. Hear what's on their mind, what they're working on, and what the future holds for Python. The panel will include: * sitting Steering Council member Pablo Galindo Salgado; * cybersecurity expert and aspiring core developer Marta Gómez Macías who made f-strings much better in 3.12; * CPython's Windows expert Steve Dower; * Red Hat veteran and emeritus Steering Council member Petr Viktorin; * and the tech lead of Microsoft's "Faster Python" team Dr. Mark "HotPy" Shannon. The panel will be chaired by Łukasz "Any-color-you-like-as-long-as-it's-black" Langa. europython-2023-33374-cpython-core-developer-panel Łukasz LangaPetr ViktorinPablo Galindo SalgadoMark ShannonSteve DowerMarta Gomez en false https://programme.europython.eu/europython-2023/talk/AAJLRW/ https://programme.europython.eu/europython-2023/talk/AAJLRW/feedback/ PyCharm (Forum Hall) Talk 2023-07-19T15:30:00+02:00 15:30 00:30 In other words, Descriptors + PEP-362 (function signature object) and a seasoning of PEP-487 (simpler customization of class creation via `__init_subclass__`). There are different ways to have generated methods and attributes attached to all classes in a library, and this talk presents the way we’re doing it in scikit-learn. Here you’ll understand the use-case, and see the details and challenges presented by it, and how we approached them. europython-2023-30039-dynamically-generated-methods-with-a-non-generic-signature Python Internals & Ecosystem (2023) Adrin Jalali en Title: Dynamically generated methods with a non-generic signature Abstract: In other words, Descriptors + PEP-362 (function signature object) and a seasoning of PEP-487 (simpler customization of class creation via `__init_subclass__`). There are different ways to have generated methods and attributes attached to all classes in a library, and this talk presents the way we’re doing it in scikit-learn. Here you’ll understand the use-case, and see the details and challenges presented by it, and how we approached them. Long: The use-case we study here goes as: we would like to add methods to all `Estimator`s, which are all subclasses of the `BaseEstimator`. The signature of the methods generated depends on the signature of other methods existing in those subclasses, but we also want to give the option of modifying generated methods without having to change the existing methods. The solution we present involves a few concepts which we’ll explain during the talk: Investigate the existing methods’ signature using `inspect` Manually traverse MRO (method resolution order) and inspect class attributes allowing for modifications on what the `inspect` has concluded Use a descriptor to generate methods accordingly Use PEP-362 to attach a signature object to the generated methods Dynamically generate docstrings for those methods Use PEP-487, aka `__init_subclass__`, to attach those methods to child classes when appropriate This is a hands-on talk, explaining each concept in isolation and then showing how they fit together, and we’ll be presenting and testing code during the talk. false https://programme.europython.eu/europython-2023/talk/9GJFZZ/ https://programme.europython.eu/europython-2023/talk/9GJFZZ/feedback/ PyCharm (Forum Hall) Talk 2023-07-19T16:05:00+02:00 16:05 00:45 You use the Python interpreter every single day. It does a lot of things for you: checks that your code has valid syntax and is properly indented, imports modules from various locations, and runs your code instruction-by-instruction. But if you've ever wondered how exactly it happens, this talk will teach you the entire process, by building a working python interpreter from scratch. europython-2023-28769-writing-a-python-interpreter-from-scratch-in-half-an-hour Python Internals & Ecosystem (2023) Tushar Sadhwani en The plan is to write a really simple, but working Python interpreter that can run Python code, from scratch. The topics we'll be going through to build this interpreter: - Lexing an indentation based language - Why `Indent` and `Dedent` need to be tokens - Writing a Recursive Descent parser - Parsing literals: ints, strings, lists, dictionaries - Parsing expressions - Parsing function calls - `print("Hello world!")` - Semantic analysis: removing invalid code - A tree-walk interpreter - Interpreting `print()` statements - Running `import` statements - File I/O: implementing `open()` calls - Running `json.loads()` and `json.dumps()` from scratch false https://programme.europython.eu/europython-2023/talk/XW8RB3/ https://programme.europython.eu/europython-2023/talk/XW8RB3/feedback/ PyCharm (Forum Hall) Keynote 2023-07-19T17:00:00+02:00 17:00 00:45 Large Language Models (LLMs) have shown some impressive capabilities and their impact is the topic of the moment. What will the future look like? Are we going to only talk to bots? Will prompting replace programming? Or are we just hyping up unreliable parrots and burning money? In this talk, I'll present visions for NLP in the age of LLMs and a pragmatic, practical approach for how to use Large Language Models to ship more successful NLP projects from prototype to production today. europython-2023-33372-large-language-models-from-prototype-to-production Ines Montani en false https://programme.europython.eu/europython-2023/talk/LJZBKW/ https://programme.europython.eu/europython-2023/talk/LJZBKW/feedback/ PyCharm (Forum Hall) Talk 2023-07-19T17:50:00+02:00 17:50 00:45 Enjoy Wednesday's lightning talks, hosted by Laís Carvalho ⬇️ - **Pyvo Meetup @ EuroPython** — Mia Bajić - **AI Game Tournament** — Neil Vaytet - **How Government Policy Can Affect Open Source** — Cheuk Ting Ho - **AWS Lambda ❤️ Python 3.11** — Jonas Weissensel - **Brings Llamas Closer** — Vaibhav (VB) Srivastav - **Adding Arrow Function to Python Grammar** — Oguz Albayrak - **A Curious Bug that Happened with List Comprehensions** — Jouni Seppänen - **Spy** — Antonio Cuni - **Learning Python Through Blocks** — Joshua Lowe - **25 Years of Open Source Software** — Radomir Dopieralski europython-2023-34203-lightning-talks-wednesday en false https://programme.europython.eu/europython-2023/talk/938SAD/ https://programme.europython.eu/europython-2023/talk/938SAD/feedback/ South Hall 2A Talk 2023-07-19T10:45:00+02:00 10:45 00:30 Zero-downtime migration is a technique for running database migrations without stopping the web app. As clients' databases grow larger, applying necessary updates to the database can become time-consuming or potentially break the database schema. This talk will describe problematic operation types and provide a strategy for writing and running migrations to release new software versions without downtime. europython-2023-30022-adding-zero-downtime-migrations-strategy-in-a-saas-project Web (2023) Iga Karbowiak en When running a web-based SaaS application, it is important to provide software updates without causing downtime for users. However, these updates often require changing the database schema with migrations. In this talk, we will discuss a solution that allows the software to remain life and able to handle incoming traffic while performing migrations. To ensure zero downtime during this process, the old code must be compatible with the new database schema. Although this may seem easy, it often isn't. In this talk, we will cover problematic operations such as: - renaming tables or columns, - deleting tables or columns, - adding new columns, - updating all records in a table with a large amount of data. We will discuss potential problems that may arise due to certain changes and provide corresponding solutions. Additionally, I will describe the challenges we encountered when introducing this approach to Saleor, an open-source e-commerce platform powered by Django. While the topic and examples are from the Django project, the issue is general and can be faced by any database-related project. The structure of the talk: 1. Background of the problem 2. Examples of operations causing the downtime 3. Introducing the zero-downtime strategy a) Writing migrations that follow a zero downtime approach b) Proceeding the software update without any downtime false https://programme.europython.eu/europython-2023/talk/UVUXFQ/ https://programme.europython.eu/europython-2023/talk/UVUXFQ/feedback/ South Hall 2A Talk 2023-07-19T11:35:00+02:00 11:35 00:30 The python `logging` module is a really powerful tool for troubleshooting with a lot of potential to save us hours of debugging. The aim for the talk is to provide an overview how the logging module in python works, how Django uses it and how to improve our logging to make it better for our web project. europython-2023-29402-a-quick-guide-to-logging-for-django-developers Web (2023) Ivaylo Donchev en As Django developers, we implictly use the python `logging` module daily in our work - for HTTP requests, for SQL queries, for custom logs, etc. The aim of this talk is to provide useful information for Django developers on: 1. How does logging in python works? 2. How to setup a logging configuration based on our needs? 3. How to configure logging in our Django app? 4. Tips and tricks for custom logging in Django app false https://programme.europython.eu/europython-2023/talk/PMNVR3/ https://programme.europython.eu/europython-2023/talk/PMNVR3/feedback/ South Hall 2A Talk 2023-07-19T12:10:00+02:00 12:10 00:30 If you're like me, then you've long known about Python's "logging" module, but you've ignored it because it seemed too complex. In this talk, I'll show you that "logging" is easy to learn and use, giving you far more flexibility than you can get from inserting calls to "print" all over your code. I'll show you how you can start to use "logging" right away -- but also how you can use it to create a sophisticated logging system that sends different types of output to different destinations. After this talk, you'll know how to use "logging", and you'll be less likely to use "print" in your applications. europython-2023-29482-stop-using-print-understanding-and-using-the-logging-module Python Libraries (2023) Reuven M. Lerner en You don't need to be a Python expert to use the "logging" module! In this talk, I'll show how you can take advantage of it almost right away, with the basic configuration. We'll then go into more complex parts of the module, looking at different handler types (and using multiple handlers), formatters, and filters. We'll look at different ways you can configure your logging system, and what some of the best practices are for including logging in your programs. I'm aiming this talk at beginners because it took me far too long to recognize the usefulness of the "logging" module, and I'm hoping to help others start using it much earlier in their Python journey. false https://programme.europython.eu/europython-2023/talk/VPWTYU/ https://programme.europython.eu/europython-2023/talk/VPWTYU/feedback/ South Hall 2A Talk 2023-07-19T14:00:00+02:00 14:00 00:30 Abstract: Data validation is a critical component of any software application, ensuring that the data processed by the application is accurate and consistent. However, data validation can often be a tedious and error-prone process, especially when dealing with complex data structures. Pydantic, a powerful and flexible data validation library for Python, simplifies the process of data validation by providing a declarative syntax that is easy to read and write. europython-2023-29927-pydantic-making-life-easier-with-data-validation Python Libraries (2023) Bojan Miletic en In this talk, we will introduce Pydantic and discuss how it can be used to make data validation easy in Python. We will cover the following topics: - What is Pydantic and how does it work? - How to define data models using Pydantic - Validating and converting data using Pydantic - Working with complex data structures using Pydantic - Integrating Pydantic with other Python libraries We will also provide real-world examples of how Pydantic has been used to simplify data validation in production applications. By the end of this talk, attendees will have a solid understanding of Pydantic and how it can be used to make data validation easy in their Python applications. Target Audience: This talk is aimed at Python developers of all levels who are interested in simplifying the process of data validation in their applications. No prior knowledge of Pydantic is required, but a basic understanding of Python is recommended. Conclusion: In this talk, attendees will learn how to use Pydantic to simplify data validation in their Python applications. Whether you are building a small script or a large-scale application, Pydantic can be an invaluable tool for data validation false https://programme.europython.eu/europython-2023/talk/CUEWG8/ https://programme.europython.eu/europython-2023/talk/CUEWG8/feedback/ South Hall 2A Talk 2023-07-19T14:35:00+02:00 14:35 00:30 Do you feel like digging through github code to learn how to use it is painful? Also think simply packaging and publishing your library to the world on pypi sometimes isn't enough to help others use what you are working on? Then come join me, as this talks is definitely for you! In this presentation, I'd like to present you typer, and why it's probably the easiest and most affordable way to create command line applications (in 2023) that your users will love to use. We'll discuss it's key strong points, how to structure your CLI application, and make it ready to be packaged and published with no hussle. europython-2023-29170-cli-application-development-made-easier-with-typer Python Libraries (2023) Vinícius Gubiani Ferreira en false https://programme.europython.eu/europython-2023/talk/MEXBJ7/ https://programme.europython.eu/europython-2023/talk/MEXBJ7/feedback/ South Hall 2A Talk 2023-07-19T15:30:00+02:00 15:30 00:30 Have you heard about Polars? What are the differences? Is Polars replacing Pandas? In this talk, we are going to demystify these questions about Polars. Compares the differences between Polars and Pandas, and explains the pros and cons of both of them. europython-2023-29456-polars-vs-pandas-what-s-the-difference PyData: Software Packages & Jupyter (2023) Cheuk Ting Ho en In this talk, we will explore what is Polars, a new tabular data management package that is written in Rust and used Arrow. Many people compare it to Pandas, the goto package for tabular data management for years. However, there is still some confusion regarding what Polars really is, whether or not it is more efficient than Pandas and if you can just replace Pandas with Polars. Hopefully, by the end of the talk, all of these questions will be answered and for people new to Polars, they will feel encouraged to try it out and more confident to make the switch. ## Goal This talk is for data scientists who have been using Pandas and have only heard of the name Polars to understand more about the difference and similarities between the two libraries and can make a better decision of which one to use when they start their next project. ## Outline - Introduction: why I am talking about this (5 mins) - Polars is not Pandas 2.0 (5 mins) - If you do this in Pandas, do that in Polars (10 mins) - Performance comparison (5 mins) - Which one should I use? (5 mins) false https://programme.europython.eu/europython-2023/talk/NLZZBQ/ https://programme.europython.eu/europython-2023/talk/NLZZBQ/feedback/ South Hall 2A Talk 2023-07-19T16:05:00+02:00 16:05 00:45 As the number of production machine learning use-cases increase, we find ourselves facing new and bigger challenges where more is at stake. Because of this, it's critical to identify the key areas to focus our efforts, so we can ensure our machine learning pipelines are reliable and scalable. In this talk we dive into the state of production machine learning, and we will cover the concepts that make production machine learning so challenging, as well as some of the recommended tools available to tackle these challenges. europython-2023-29438-the-state-of-production-machine-learning-in-2023 PyData: Machine Learning, Stats (2023) Alejandro Saucedo en As the number of production machine learning use-cases increase, we find ourselves facing new and bigger challenges where more is at stake. Because of this, it's critical to identify the key areas to focus our efforts, so we can ensure our machine learning pipelines are reliable and scalable. In this talk we dive into the state of production machine learning, and we will cover the concepts that make production machine learning so challenging, as well as some of the recommended tools available to tackle these challenges. This talk will cover key principles, patterns and frameworks around the open source frameworks powering single or multiple phases of the end-to-end MLOps lifecycle, incluing model training, deploying, monitoring, etc. We will be covering a high level overview of the production ML ecosystem and dive into best practices that have been abstracted from production use-cases of machine learning operations at scale, as well as how to leverage tools to that will allow us to deploy, explain, secure, monitor and scale production machine learning systems. false https://programme.europython.eu/europython-2023/talk/EATNFR/ https://programme.europython.eu/europython-2023/talk/EATNFR/feedback/ South Hall 2B Talk 2023-07-19T10:45:00+02:00 10:45 00:30 We'll cover the basics of Rust and demonstrate how to create a Rust module that can be imported and used within Python. Discover the advantages of using Rust in Python, especially regarding improved performance. europython-2023-29606-building-native-rust-modules-for-python Software Engineering & Architecture (2023) Arthur Pastel en As Python developers, we love our favorite language's ease of use and flexibility. However, performance becomes increasingly important as projects grow in size and complexity. That's where Rust can come in. In this session, we'll explore the basics of Rust and demonstrate how to build native Rust modules for Python. We'll cover the advantages of using Rust in Python, including improved performance and memory safety, and how to leverage existing Rust libraries within our Python projects. Detailed plan: - Why Rust? - Introduction to Rust for Python developers - Rust tooling for Python module development - Building a simple Python extension module in Rust - Writing tests to ensure proper integration with Python - Performance comparisons between the Rust and Python implementation - Real-world examples of successful Rust and Python integration Whether you're a Python developer looking to improve the performance of your projects or just curious about Rust, this session will provide valuable insights and practical guidance on building native Rust modules for Python. false https://programme.europython.eu/europython-2023/talk/D88LXE/ https://programme.europython.eu/europython-2023/talk/D88LXE/feedback/ South Hall 2B Talk 2023-07-19T11:35:00+02:00 11:35 00:30 Python is a popular language for data engineering but has some limitations in performance, concurrency, and production deployments. The Rust programming language offers powerful alternatives with strong compile-time and memory safety guarantees. In this talk, I'll explore how data engineers can leverage Rust to build high-performance data pipelines and processing systems. I'll cover the Rust ecosystem for data work, including frameworks and libraries for working with data formats, databases, streaming systems, and scientific computing. By combining Rust and Python, data engineers can harness the benefits of both languages and build robust end-to-end data systems that scale to meet demanding production needs. europython-2023-28774-rust-for-python-data-engineers PyData: Data Engineering (2023) Karim Jedda en After using Python for almost a decade now, mostly for data engineering, I thought I'd give Rust a try to solve some of the problems I face daily as a data engineer. What I learned doing so is that Rust can be a great and valid additional tool for any data engineer, especially in combination with Python. I'll elaborate on: - How the Python ecosystem can benefit from integrating Rust in data engineering workflows - How Rust can be interfaced with Python - The strengths of each programming language Further reading material: - [Blog post](https://karimjedda.com/carefully-exploring-rust/) - [HN discussion](https://news.ycombinator.com/item?id=33581901) - [LinkedIn post](https://www.linkedin.com/feed/update/urn:li:activity:7035701103337828352/) - [Website](https://datawithrust.com/) false https://programme.europython.eu/europython-2023/talk/H3TBAP/ https://programme.europython.eu/europython-2023/talk/H3TBAP/feedback/ South Hall 2B Talk 2023-07-19T12:10:00+02:00 12:10 00:45 What would a Pythonista gain from becoming a Rustacean other than semicolons and brackets? In this talk I'll share the learnings and achievements I got by adding the Rust programming language into my Python life. Illustrating a real story now in production at scale, I'll walk you through all the pains and joys of this unexpected journey which changed me more than I anticipated. Proposed agenda: - Project introduction - Motivations of selecting this project to learn Rust - Tales of a Pythonista learning Rust - Results, numbers and production graphs - How Rust influences my daily Python - Was it worth it? Should you do it too? europython-2023-29385-would-rust-make-you-a-better-pythonista Software Engineering & Architecture (2023) Alexys Jacob en false https://programme.europython.eu/europython-2023/talk/AXWQBB/ https://programme.europython.eu/europython-2023/talk/AXWQBB/feedback/ South Hall 2B Talk 2023-07-19T14:00:00+02:00 14:00 00:30 The Internet of Things has been flourishing for many years, and Python has been playing an important role on the “easy to automate” topic for many devices. One of the challenges for the next generation ML is to think small, you read that right “thinking small”. It’s time to start being able to have mechanisms with super well-trained ML models in small-devices: ML on Microcontrollers. We are going to dive into TinyML and evaluate different setups to interact with sensors on microcontrollers. We will discuss the different hardware options and frameworks to start with, while checking different use cases that TinyML can solve, like: agriculture, conservation, health issues detection, ecology monitoring etc. In this talk, you will learn about Tiny Machine Learning (TinyML), which is an approach that explores machine learning to be deployed in embedded systems that enable run ML on microcontrollers. Lastly, we will discuss real use-cases and a practical case that could be implemented at home europython-2023-29542-continue-thinking-small-next-level-machine-learning-with-tinyml Makers, Microcontrollers and IoT (2023) Maria Jose Molina Contreras en We usually associate the future of computing as large clusters being able to perform tasks in a fraction of a second, but is it really the only scenario on how computational hardware will evolve? Machine learning has become an important component in our societies, we see how people, communities, and global companies are focusing their resources into improving their technological stack, and being the leader into the next generation of AI. At the same time that we see clusters getting larger, GPUs more powerful, and our phones are practically computers being capable of doing almost everything, we do see that some of the smart devices are becoming smaller. The Internet of Things has been flourishing for many years, and Python has been playing an important role on the “easy to automate” topic for many devices, but can Python help us in all scenarios? One of the challenges for the next generation ML is to think small, you read that right “thinking small”. It’s time to start being able to have mechanisms with super well-trained ML models in small-devices: ML on Microcontrollers. We are going to dive into TinyML and evaluate different setups to interact with sensors on microcontrollers. We will discuss the different hardware options and frameworks to start with, while checking different use cases that TinyML can solve, like: agriculture, conservation, health issues detection, ecology monitoring, autonomous vehicles, etc. In this talk, you will learn about Tiny Machine Learning (TinyML), which is an approach that explores machine learning to be deployed in embedded systems that enable run ML on microcontrollers. Lastly, we will discuss a real use-case that you will be able to implement at home. false https://programme.europython.eu/europython-2023/talk/DQBDJE/ https://programme.europython.eu/europython-2023/talk/DQBDJE/feedback/ South Hall 2B Talk 2023-07-19T14:35:00+02:00 14:35 00:30 Interactive control of robots can be a challenge, as it requires a lot of things to happen in parallel while at the same time reacting to data from sensors and control signals. Using python's async facilities may greatly simplify this task, allowing us to write code that is similar to the non-parallel version, but that is at the same time easy to compose into bigger program doing many things at once. I will talk about my own experiences programming the Fluffbug robot with CircuitPython, point out the problems and the solutions I found. europython-2023-29210-async-robots Makers, Microcontrollers and IoT (2023) Radomir Dopieralski en Fluffbug is a small, affordable walking robot programmed with CircuitPython. The way it moves and reacts to sensors and control signals requires code that seemingly does a lot of things all at once, but we don't have direct access to mechanisms like threads or interrupts. What we use instead is Python's async syntax and the minimal version of asyncio library available in CircuitPython. This makes an interesting use case for asynchronous programming that is different from the usual web servers and API frontends. The resulting code is much shorter and easier to maintain than similar code written in a traditional, linear way. false https://programme.europython.eu/europython-2023/talk/NZ8J7S/ https://programme.europython.eu/europython-2023/talk/NZ8J7S/feedback/ South Hall 2B Talk 2023-07-19T15:30:00+02:00 15:30 00:30 A fully typed code base requires less test code to achieve the same level of confidence in its correctness. We'll analyze specific code examples and see how dependent types and exhaustiveness checking make certain classes of tests obsolete. europython-2023-29480-bulletproof-python-writing-fewer-tests-with-a-typed-code-base Software Engineering & Architecture (2023) Michael Seifert en A type system forms a set of rules that is imposed on a programming language with the goal to avoid invalid operations. Type checking Python code is particularly interesting, because it happens before running the code or the test code. This allows software engineers to perform checks on the source code that otherwise would have to be performed at runtime. The typing module in the Python standard library provides powerful concepts to provide hints to the type checker. Specifically, we'll look at use cases for NewType, dependent functions, and exhaustiveness checking. Audience members are expected to be able to read and understand Python code and have a basic understanding of unit testing. false Slides Annotated slides https://programme.europython.eu/europython-2023/talk/T3JFHR/ https://programme.europython.eu/europython-2023/talk/T3JFHR/feedback/ South Hall 2B Talk 2023-07-19T16:05:00+02:00 16:05 00:45 Behaviour-driven development promises evergreen documentation or human-readable executable specification - sounds great. However, adopting it takes much more than simply installing behave or pytest-bdd and writing Gherkin. This talk will show what. europython-2023-29107-bdd-how-to-make-it-work Testing (2023) Sebastian Buczyński en This talk discusses common issues with BDD specifications, such as: - lengthy, hard to maintain & read specifications - intertwined order of given-when-then steps - technical details leaking to specifications. Then it shows how to deal with them: - how to write good specifications, - what do modularization and DDD have to do with focused scenarios, - building automation layer to have reusable blocks for Gherkin scenarios. false https://programme.europython.eu/europython-2023/talk/FNLQH7/ https://programme.europython.eu/europython-2023/talk/FNLQH7/feedback/ North Hall Talk 2023-07-19T10:45:00+02:00 10:45 00:45 Apache Arrow, and its Python library PyArrow are becoming the standard de facto for transfering data and interoperability between libraries and languages. As more compute engines, storages and databases start to speak arrow, you might be relying on it without even knowing. The same transformation is happening with Substrait, that is on track to be the standard representation of query plans themselves. Allowing queries to be routed to different engines as far as they speak substrait, or even decomposed and forwarded to different engines. This talk we will provide a quick introduction to the Arrow ecosystem, showing to Python developers how libraries like Pandas, Polars and PyArrow itself leverage Arrow and how compute engines like Velox, Datafusion and Acero are embracing Arrow and Substrait. The talk will also show how a basic database system based on Arrow and Substrait can be built with a minimum amount of code thanks to all the foundations they provide. europython-2023-29712-apache-arrow-and-substrait-the-secret-foundations-of-data-engineering PyData: Data Engineering (2023) Alessandro Molina en false https://programme.europython.eu/europython-2023/talk/HSPJMX/ https://programme.europython.eu/europython-2023/talk/HSPJMX/feedback/ North Hall Sponsored 2023-07-19T11:35:00+02:00 11:35 00:30 This talk discusses asyncio, an essential tool for asynchronous, non-blocking code in Python, and its limitations, such as non-durability and inability to distribute across multiple machines. Temporal.io, an open-source microservice orchestration platform, is introduced as a robust solution capable of using event sourcing for durability, scalability, and resilience, effectively managing system failures. Temporal based asyncio event loop implementation adds seamless durability to Python code. The complete state of the program, including local variables and await calls, is fully preserved across process and other infra failures. We highlight real-world applications and conclude by emphasizing how Temporal transforms the design and implementation of distributed fault-tolerant systems. europython-2023-33364-temporal-python-a-durable-distributed-asyncio-event-loop Maxim Fateev en false Temporal Python SDK Blog Post: Temporal Python 1.0.0 – A Durable, Distributed Asyncio Event Loop https://programme.europython.eu/europython-2023/talk/RAXZVW/ https://programme.europython.eu/europython-2023/talk/RAXZVW/feedback/ North Hall Talk 2023-07-19T12:10:00+02:00 12:10 00:30 Currently, SQL and Cloud Data Warehouses (DWH) are extremely popular for good reason. They are great for dashboarding and business intelligence (BI) use cases due to their ease-of-use. However, their combination might not be the best choice for every problem. More precisely, business-critical data pipelines with high complexity might be better suited for frameworks such as Apache Spark which greatly benefit from the tight integration with general purpose languages like Python (e.g., PySpark). Expect an opinionated comparison between Apache Spark and seemingly easier-to-use cloud native SQL engines. By the end of this talk, you will be challenged to think about why they are complementary and when each has its justification. europython-2023-29564-apache-spark-vs-cloud-native-sql-engines PyData: Data Engineering (2023) Franz Wöllert en This talk is intended for data engineers, solution architects and alike who deal with distributed computation engines for analytical batch workloads in their day to day work. While SQL is the lingua franca for data analysis, it might not be the best choice for every problem. Business-critical data pipelines with high complexity demand for appropriate abstractions, proper testability and enhanced debugging tooling that is hard to achieve with SQL and surrounding frameworks. In contrast, using the power of Python in conjunction with frameworks like Apache Spark is a promising solution for the following reasons: - Apache Spark’s DataFrame API is embedded in a general purpose programming language like Python which allows to leverage software engineering concepts such as inheritance, composition, introspection and higher order functions. This provides data engineers a toolbox of abstractions to properly handle complexity. More precisely, it allows to structure, modularize, reuse, and dynamically generate building blocks of data pipelines. - To ensure semantic correctness, data engineers can develop unit tests on individual transformations or integration tests on entire pipelines in classical software development tradition which is hardly possible with cloud-native SQL engines. - Apache Spark's future-proof is ensured due to its wide adoption, runtime flexibility and vendor independence. The talk will guide you through each of the claims stated above using a real world IoT use case while comparing the strengths and weaknesses of both Apache Spark and cloud-native SQL engines. false https://programme.europython.eu/europython-2023/talk/EWHVWK/ https://programme.europython.eu/europython-2023/talk/EWHVWK/feedback/ North Hall Talk 2023-07-19T14:00:00+02:00 14:00 00:30 From recommendation systems to LLM-based applications, vector search is a critical component of the modern AI workflow. Existing vector solutions are complicated to use, hard to maintain, and cost too much. LanceDB is a free open-source vector store that can perform low latency vector search on billion-scale vector datasets on a single node. europython-2023-29231-serverless-billion-scale-vector-search-for-ai-applications PyData: Deep Learning, NLP, CV (2023) Chang She en LanceDB is powered by Lance format, a modern columnar data format for machine learning and data science. Compatible with pandas/polars/duckdb, Lance format supports vector index, predicate pushdown, and random access performance 2000x faster than parquet. This talk will: 1. Introduce LanceDB and show some example workflows 2. Outline Lance format design and what makes it so fast 3. Review the Lance roadmap and ecosystem integrations You can find Lance here: https://github.com/eto-ai/lance false https://programme.europython.eu/europython-2023/talk/3AD79Q/ https://programme.europython.eu/europython-2023/talk/3AD79Q/feedback/ North Hall Talk 2023-07-19T14:35:00+02:00 14:35 00:30 Python tools like Bokeh and Dash let you build custom Web-based interactive visualization apps and dashboards. While these solutions work well to visualize megabyte-sized datasets, web technologies struggle to render gigabyte or larger datasets efficiently, because they transfer all the data into the client browser. Pre-rendering the data on the server using a tool like Datashader can visualize such large datasets efficiently, but the resulting static renderings make exploring individual datapoints difficult. This talk demonstrates how the HoloViz ecosystem of tools (holoviz.org) allows you to run exploratory notebooks and build dashboards that do server-side rendering of billions of data points without losing the ability to interactively inspect and annotate individual samples in the browser. europython-2023-29655-the-needle-and-the-haystack-visualizing-single-datapoints-out-of-billions PyData: Software Packages & Jupyter (2023) Jean-Luc Stevens en false https://programme.europython.eu/europython-2023/talk/BBZVUP/ https://programme.europython.eu/europython-2023/talk/BBZVUP/feedback/ North Hall Talk 2023-07-19T15:30:00+02:00 15:30 00:30 This talk will provide an introduction to Integer Programming and demonstrate how it can be used for conference scheduling. We will explore the basics of Integer Programming and how it can be applied to optimize the allocation of talks to time slots and rooms in a conference program. By the end of the talk, attendees will have a better understanding of how this powerful tool can help to create an efficient and effective conference schedule that maximizes attendee satisfaction. Whether you're a conference organizer or simply interested in learning more about optimization algorithms, this talk is for you! europython-2023-29751-from-algorithms-to-agendas-a-beginner-s-guide-to-integer-programming PyData: Machine Learning, Stats (2023) Florian Wilhelm en ### Introduction * Overview of the challenges of conference scheduling and the potential benefits of using optimization algorithms * Explanation of the basics of Integer Programming and its role in conference scheduling ### Key Concepts * The importance of defining clear objectives and constraints for a conference program * The different types of variables used in Integer Programming models for conference scheduling (e.g. binary, integer, continuous) * An overview of popular optimization algorithms and their application to conference scheduling (e.g. branch-and-bound, cutting plane methods, column generation) * A step-by-step guide to constructing an Integer Programming model for conference scheduling, including how to formulate objectives and constraints ### PyConDE / PyData 2023 Berlin Example: * A real-world conference scheduling problem, that is for the PyConDE / PyData 2023, and how we used Integer Programming ### Conclusion * Recap of the key concepts and takeaways from the talk * Q&A session to answer any remaining questions from the audience Overall, this talk aims to provide attendees with a beginner-friendly introduction to Integer Programming and its applications in conference scheduling. By the end of the talk, attendees will have a better understanding of how to use optimization algorithms to create an efficient and effective conference schedule that maximizes attendee satisfaction. false Slides https://programme.europython.eu/europython-2023/talk/AG7JR9/ https://programme.europython.eu/europython-2023/talk/AG7JR9/feedback/ North Hall Talk 2023-07-19T16:05:00+02:00 16:05 00:30 Pymoo is an open source python framework with state-of-the-art optimisation and post performance analysis capabilities. It provides an object oriented interface to solve constrained Single/Multi-Objective optimisation problems with a catalog of algorithms, customisations and post-optimisation evaluation functionalities. With additional features like Visualisation of optimal pareto-fronts, decision making, parallelization and customised sampling, Pymoo promises to be highly valuable for scalable optimisation solutions. europython-2023-29367-solving-multi-objective-constrained-optimisation-problems-using-pymoo TBD - Multiple Tracks (2023) Pranjal Biyani en I will share a github repository with jupyter notebooks and datasets with the attendees, before the talk and have multiple hands on segments during the talk. The talk will take the users step-by-step through the sections mentioned below - 1. What is an optimisation problem ? 2. Core components of an optimisation problem ? 3. Finding the right type of solution ? 4. Identifying constraints, bounds and objectives 5. Pymoo API - Object Oriented Interface, Parallelization, Visulization 6. Hands on Example : a ML Model as an objective function, to find optimal input variables for a desired output variable 7. Customisations using Pymoo : Termination, Crossover, Mutation etc 8. A one-stop solution for Optimisation Problems false https://programme.europython.eu/europython-2023/talk/3Y3BJN/ https://programme.europython.eu/europython-2023/talk/3Y3BJN/feedback/ Terrace 2A Talk 2023-07-19T10:45:00+02:00 10:45 00:45 Python packaging is quickly evolving and new tools pop up on a regular basis. Lots of talks and posts on packaging exist but none of them give a structured, unbiased overview of the available tools. This talk will shed light on the jungle of packaging and environment management tools, comparing them on a basis of predefined features. europython-2023-29785-an-unbiased-evaluation-of-environment-management-and-packaging-tools Software Engineering & Architecture (2023) Anna-Lena Popkes en Python packaging has come a long way in the last years. The landscape is evolving quickly and new tools pop up on a regular basis. Lots of talks and posts on packaging exist but none of them give a structured, unbiased overview of the available tools. This talk will shed light on the jungle of packaging and environment management tools, comparing them on a basis of predefined features. We will categorize tools using the following categories: - Python version management - Environment management - Package management - Package building - Package publishing A lot of tools exist, including: pyenv, pip, poetry, hatch, flit, and many more. We will categorize all of them and discuss some in more detail. Most importantly, we will evaluate the tools on the basis of features that are important for developers like: - Does the tool manage dependencies? - Can it manage Python installations? - Does it have a clean build/publish flow? - Does it allow for plugins? - Does it support important PEPs, e.g. PEP 660, PEP 621, PEP 582? This talk is intended for developers who - Have used packaging and want to get to know new tools - Want to have an overview of existing tools and their capabilities false PDF of slides https://programme.europython.eu/europython-2023/talk/HMJU9J/ https://programme.europython.eu/europython-2023/talk/HMJU9J/feedback/ Terrace 2A Talk 2023-07-19T11:35:00+02:00 11:35 00:30 Python’s expressive syntax, ease of use, and powerful ecosystem of third-party packages are all major contributing factors to its thriving use for accelerator controls at CERN. Providing access to this rich ecosystem in a protected environment, whilst also allowing developers to augment this with internally developed packages is a key enabling service. Existing open-source solutions didn’t meet our needs, and the evolving Package index standardisation, as well as exposure to dependency confusion attacks, left us searching for a more modular and flexible approach. In this presentation we will demonstrate the Python package upload, index, and browsing services developed at CERN. We will discuss the gradual transition from our existing repository service (based on Nexus), and demonstrate - with the help of recent packaging PEPs - the flexibility that modularising the services has brought, helping us to meet our needs for local specialisation and enhanced security measures. europython-2023-29828-the-python-package-repository-accelerating-software-development-at-cern DevOps (2023) Phil ElsonIvan Sinkarenko en CERN, the European Organization for Nuclear Research, operates the largest particle physics laboratory in the world, including the 27km long Large Hadron Collider (LHC). Python is increasingly at the heart of CERN’s accelerator control software, with hundreds of domain specialists using Python on a daily basis to research, engineer and operate this world-leading facility. Python’s expressive syntax, ease of use, and powerful ecosystem of third-party packages are all major contributing factors to its success. Providing access to this rich ecosystem in a protected environment, whilst also allowing developers to augment this with internally developed packages is a key enabling service. Existing open-source solutions didn’t meet our needs, and the evolving Package index standardisation as well as exposure to dependency confusion attacks, left us wishing for a more modular and flexible approach. In this presentation we will demonstrate the Python package upload, index, and browsing services developed at CERN, and will show that modularising the service gives greater opportunities for local specialisation and enhanced security approaches, as well as offering easy evaluation and adoption of PEP-standardised packaging enhancements. Starting from an existing package repository setup (based on Nexus), we will present the steps taken to gradually introduce this modular infrastructure using specific packaging PEPs to demonstrate the existing challenges and motivation. We will look at code snippets that we are able to inject into the package index definition, and get into fine detail about recent packaging PEPs (e.g., PEP-658) in order to build the case that modularity is essential to build package index services that can evolve with the standards, and which can be adapted to the specific needs of an organisation such as CERN (e.g., specific authentication methods, resource ownership, network segregation). Finally, we will demonstrate our package browsing service, which is a FastAPI-based web service offering a browser on a “Simple Index” (PEP-503) package repository which mimics the look-and-feel of PyPI.org. false https://programme.europython.eu/europython-2023/talk/LLHGKF/ https://programme.europython.eu/europython-2023/talk/LLHGKF/feedback/ Terrace 2A Talk 2023-07-19T12:10:00+02:00 12:10 00:30 A Jupyter notebook is quite handy for rapid REPL (Read-Eval-Print-Loop) style tasks such as exploratory data analysis and data science. However, we would feel deficiencies in proper SW engineering supports at some point as the notebook grows to have larger and more complicated code. It is because the Jupyter notebook lacks several important features including code sharing, refactoring support, version control and advanced editing. Fortunately, traditional full-fledged IDEs, such as *VS Code* or *PyCharm*, are available at hand and they support these lacking features very well. Then, why don’t we take advantage of the best of both worlds? In this beginner-level hands-on talk, I will demonstrate how to transform Jupyter notebook workflows to a proper Python package using *VS Code*. I will also introduce several basic but essential refactoring recommendations. By doing so, you can use the package for several notebooks and even share with your colleagues and friends. europython-2023-28949-from-jupyter-notebooks-to-a-python-package-the-best-of-both-worlds PyData: Software Packages & Jupyter (2023) Sin-seok SEO en Notebooks, code and slides are available in [this repo](https://github.com/sesise0307/europython2023-package). ## Introduction - Jupyter Notebook - Provides ideal workflows for data science - Pros: REPL, interactivity, integration of code / output / documentation, visualization, rapid prototyping, result sharing, etc. - Cons: lacks of debugging, code sharing, refactoring, version control, advanced editing, etc. - Full-fledged IDEs - Designed to maximize programmer productivity - One iteration might take a long journey - We can benefit from the best of both worlds by using a Python package ## Jupyter Notebook Data Science Workflow - Data Loading - Preprocessing - Exploratory Data Analysis (EDA) - Prediction ## To (Your Own) Python Package - What is a package and why do we want to use it? - How to create a (minimal) package - How to import and use - Live refactoring examples ## Wrap up / Some tips - Publish your awesome package - PyScaffold - VS Code false GitHub repo Slides https://programme.europython.eu/europython-2023/talk/RRJAZA/ https://programme.europython.eu/europython-2023/talk/RRJAZA/feedback/ Terrace 2A Poster 2023-07-19T13:00:00+02:00 13:00 01:00 Multilabel classification is a machine learning task in which each instance is assigned to a group of labels. It has gained widespread use in various applications in recent years. Preprocessing, such as feature selection, is an important step in any machine learning or data mining task. It helps to improve the performance of an algorithm and reduce computational time by eliminating highly correlated, irrelevant, and noisy features. A new algorithm called Black Hole, inspired by the phenomenon of black holes, has recently been developed to tackle multi-label classification problems. In this talk, we present a modified version of the Black Hole algorithm that combines it with two genetic algorithm operators: crossover and mutation. The combination of Black Hole and genetic algorithms has the potential to solve multi-label classification problems across a range of domains. europython-2023-29633-from-dataset-to-features-a-python-based-evolutionary-approach PyData: Deep Learning, NLP, CV (2023) Neeraj PandeyHitesh Khandelwal en Multilabel classification is a machine learning task where each instance in a dataset is assigned to multiple labels. This is in contrast to traditional classification, where each instance is assigned to a single label. Multilabel classification has gained popularity in recent years due to its expanding use in a variety of applications across domains. One of the key challenges in multilabel classification is the high dimensionality of the data, which can make it difficult for machine learning algorithms to learn effectively. This is where feature selection comes in. Feature selection is the process of identifying and selecting a subset of relevant and non-redundant features from a larger set of features. It is a critical preprocessing step that can improve the performance and efficiency of machine learning algorithms. One of the recent developments in feature selection is the Black Hole algorithm, which is inspired by the phenomenon of black holes in space. The Black Hole algorithm is a metaheuristic that iteratively removes the least relevant features from a dataset, based on a relevance measure such as mutual information. In this talk, we present a modified standalone Black Hole algorithm that incorporates genetic algorithm operators, such as crossover and mutation, to improve its performance in solving multilabel classification problems. The hybridization of Black Hole and Genetic Algorithms has shown to be effective in solving multilabel classification problems in different domains. false https://programme.europython.eu/europython-2023/talk/WAZGKA/ https://programme.europython.eu/europython-2023/talk/WAZGKA/feedback/ Terrace 2A Talk 2023-07-19T14:00:00+02:00 14:00 00:30 Our EuroPython takes place in Prague - a city with some lessons for us, about programming, software and technology. More than 100 years ago Prague produced buildings that hint at how far our ideas in software might take us, and writers and artists who imagined challenges that have lately become real. europython-2023-30077-lessons-from-prague Ethics, Philosophy & Politics (2023) Daniele Procida en Cities, electronic circuits and software all have *architectures*; they are machines that process signals and messages, balance forces and respond to demands, strongly analogous ways. Cities are much older than circuits and software. They are full of lessons about systems - I think some of these lessons van apply directly to our work in software, and I think that Prague, our host city, has some special ones. Some of the lessons are built literally into its buildings: Prague has the most intense concentration of Cubist architecture in the world. Architecture springs from ideas - this talk will discuss those ideas, and the people who had them, and what we can think about our software when we think about them. I'll discuss, amongst other things, Karel Čapek, the Czech writer who gave us the word "robot" in 1920, and who also offers us ways of thinking about how artificial intelligence might occupy a space in our life and civilisation, and the Czech movement from Cubism to functionalism in architecture, and the connection between them, and more besides. false https://programme.europython.eu/europython-2023/talk/VATHTK/ https://programme.europython.eu/europython-2023/talk/VATHTK/feedback/ Terrace 2A Talk 2023-07-19T14:35:00+02:00 14:35 00:30 Most introductory Python books and online resources like w3schools.com try to be complete when a new concept is explained. This does not always work well for beginners. E.g. if you have just grasped how a while-loop works, it may cause too much cognitive load to also understand the break and continue options, let alone the else clause. The learning psychologist Jerome Bruner introduced the term "spiral learning". The idea is that you don't teach all aspects of a new concept, but just enough to use it. At a later stage a teacher can revisit the subject and explain more details, when a student needs this to take the next step. Spiral Python is a road map of subjects that can be found in any introductory book or online resource about Python, but absolutely original in the sense that it takes into account how people learn in a natural way. You do not need to know the whole language before you can use it. Spiral Python also contains exercises (to practice) and challenges (to motivate). europython-2023-29376-spiral-python Education, Teaching & Training (2023) Jan Kroon en The idea of Spiral Python comes from the original Meccano construction kits. In Kit #1 you found building materials, some simple tools and a booklet with ideas what to build. It was possible, however, to build much cooler contraptions than those in the booklet. Meccano enabled children to be creative. Soon a kid needed Kit #2 to realise his or her ideas. In a workshop, I can first summarise what cognitive psychology understands about learning (e.g. from "How We Learn", Dehaene 2020). Subsequently I can share our experience at Rotterdam University on what beginner programmers find difficult or misunderstand when they learn programming. In general the problem is that there is too much cognitive load, too much new ideas at once ("The Programmer's Brain", Hermans 2021). Finally I will sketch the Spiral Python approach, in which new concepts build on prior experience of students (e.g. the Python List is related to shopping lists and to-do lists) and gradually explained. At each stage of Spiral Python, students don't make just standard exercises but are challenged to be creative and follow their own passion in building software-driven products. We use libraries (turtle, opencv) and hardware (microbit, raspberry pi with sense hat) to make the software products more interesting. Students that take the Spiral Python approach get used to extending and adapting the mental models they have made of the Python programming language, computers, networking and computing. This makes them more flexible and independent thinkers, who hopefully enjoy lifelong learning. false https://programme.europython.eu/europython-2023/talk/RQCYKG/ https://programme.europython.eu/europython-2023/talk/RQCYKG/feedback/ Terrace 2A Talk 2023-07-19T15:30:00+02:00 15:30 00:30 Proteins are essential components of our bodies, with their function often dependent on their 3D structure. However, uncovering the 3D structure has for a long time been redeemed by months of hard work in the lab. Recent advances in Machine learning and Natural language processing have made it possible to build models (eg. AlphaFold) capable of predicting the protein's 3D structure with the same precision as experimental methods. In this talk, I will explore an even more specific application of language models for proteins - the detection of a knot in a protein's 3D structure solely from the protein amino acid sequence. Knotting in proteins is a phenomenon that can affect their function and stability. Thanks to NLP and interpretation techniques we can try to uncover why and how proteins tie themself into a knot. In this research, we rely on many Python-based tools starting from Biopython to Pymol and Hugging Face transformer library. europython-2023-29109-using-nlp-to-detect-knots-in-protein-structures PyData: Deep Learning, NLP, CV (2023) Eva Klimentová en false https://programme.europython.eu/europython-2023/talk/JHY3ZK/ https://programme.europython.eu/europython-2023/talk/JHY3ZK/feedback/ Terrace 2A Talk 2023-07-19T16:05:00+02:00 16:05 00:45 We will follow master detective Robot Holmes on his way to solve one of his hardest cases so far - a series of mysterious murders in the city of MLington. The traces lead him to the Vision-Language part of town, which has been a quiet and tranquil place with few incidents until lately. For a few months the neighbourhood has been growing extensively and careless benchmark leaders are dropping dead at an alarming rate. Robot Holmes sets out to find the cause for this new development and will gather intel on some of the most notorious of the new citizens of the Vision-Language neighbourhood and find out what makes them tick. europython-2023-29428-robot-holmes-and-the-mlington-murder-mysteries PyData: Deep Learning, NLP, CV (2023) Johannes Kolbe en Join the detective Robot Holmes on an adventure through the streets of the vibrant city of MLington. Together, we will find out who is behind a series of mysterious murders in the bustling neighbourhood of Vision-Language Village (ViLaVi). ViLaVi has seen a steady influx of new posh Vision-Language models, which are not only rapidly expanding the size of the district but also the quality of services that are offered in these streets. On his journey Robot Holmes will compile an overview of the tasks these new models excel in and find out what makes them so good at it. Additionally he will gather details on some of the most successful of the Vision-Language models and eventually find out who or what is behind the series of murders. By the end of our journey you will have a better overview of the rapidly expanding Vision-Language neighbourhood and will have knowledge of the most important inner workings of Vision-Language models like CLIP, OWL-ViT, and BLIP. You will also know how to run them yourself in a few lines of code with the transformers library by Hugging Face. The talk is for everyone interested in the topic of Vision-Language models and who wants to gain some first insights into their ways of working. People who already have a profound knowledge of Vision-Language models are welcome as well, as they probably have never seen it presented as a crime story in a strangely familiar city. false https://programme.europython.eu/europython-2023/talk/VCNMWZ/ https://programme.europython.eu/europython-2023/talk/VCNMWZ/feedback/ Terrace 2B Talk 2023-07-19T10:45:00+02:00 10:45 00:30 Black, Flake8, isort, and Mypy are useful Python linters but it’s challenging to use them effectively at scale in the case of multiple codebases, in a large codebase, or with many developers. Linter analysis on large codebases is slow. Linters may slow down developers by asking them to fix trivial issues. Running linters in distributed CI jobs makes it hard to understand the overall developer experience. In this talk, we'll walk you through solving those scaling problems using a reusable linter framework that releases new linter updates automatically, reuses consistent configurations, runs linters on only updated code to speedup runtime, collects logs and metrics to provide observability, and builds auto fixes for common linter issues. Our linter runs are fast and scalable. Every week, they run 10k times on multiple millions of lines of code in over 25 codebases, generating 25k suggestions for more than 200 developers. Its autofixes also save 20 hours of developer time every week. europython-2023-29624-python-linters-at-scale DevOps (2023) Jimmy Lai en Popular Python linters overview and configuration recommendation (6 mins) - Black, Flake8, isort, mypy Common practice: linter versions and config files managed by version control (1.5 mins) - dependency management - cached dependencies in CI jobs Scaling Challenges: (5 mins) - Multiple codebases 1. Inconsistent linter version and configuration 2. Endless effort on upgrading linters and configs - Large codebases (1 min): Linters run slow on analyzing million lines of code - Many developers (2 mins): Linter suggestions of trivial issues slow down developers Solutions for the challenges: (12.5 mins in total) - The solution for inconsistent version and configuration (2.5 mins) - Tradeoff between consistent version and flexible versions - All codebases use the same version and configurations of linters - Need to fix existing linter errors while upgrading linters - Reusable workflow - The solution for slow linter run: (2.5 mins) - Avoid repeated analysis by caching linter results - Only run linters on updated files - The solution for lake of developer experience overview (2.5 mins) - Collect linter suggestions from CI jobs - Detect linter errors that are merged to the main branch and find the breaking change easily - Understand frequent linter suggestions - The solution for slowing down developers (2.5 mins) - Build autofixes for frequent linter suggestions: Black and isort formatting, Flake8 unused import, and Mypy missing return type. - The solution for providing guidance on more best practices (2.5 minutes) - Build custom linters for best practices using PyGithub and LibCST Effective linter strategies: (3 mins) - Use linters to guide developers on best practices - Convention over configuration - With linters, developer don’t need to remember too many things - Use autofix to help developer on fixing issues - DRY: don’t repeat yourself - Wth autofixes, developers move fast to focus on developing products Results and Recap: (2 mins) - scaled out our linters to run 10k times on 25 codebases for 200 developers and provide 25k suggestions on a weekly basis - recap the solutions for scaling out linters false https://programme.europython.eu/europython-2023/talk/FFTHXB/ https://programme.europython.eu/europython-2023/talk/FFTHXB/feedback/ Terrace 2B Talk 2023-07-19T11:35:00+02:00 11:35 00:30 Take your Continuous Integration to the next level! Learn how to optimize your pipelines for faster and more efficient builds through parallelization, caching, failing early, conditional runs, and more. europython-2023-29105-optimizing-your-ci-pipelines DevOps (2023) Sebastian Witowski en This talk aims to show you some ideas on how to improve your CI pipelines. I assume that you already know what CI is, you chose one of many tools available on the market and wrote some kind of a CI setup for your project. Great! Now, let’s take it one step forward and see how we can make it even better. I will talk mainly about improving the speed of your CI pipelines (which in many cases will correspond to also lowering costs if you use a paid service) through: - Making more things run at the same time - parallelization - Making things start faster - caching, smaller containers - Making things finish faster - failing early, splitting tests, running CI conditionally, etc. I will use Gitlab CI to show concrete examples, but I will also try to make this talk as generic as possible to make it useful for people using different CI tools. false https://programme.europython.eu/europython-2023/talk/PNVM3S/ https://programme.europython.eu/europython-2023/talk/PNVM3S/feedback/ Terrace 2B Talk 2023-07-19T12:10:00+02:00 12:10 00:30 Learn about the advantages and disadvantages of zero downtime deployment strategy, as well as best practices for implementing it in your organization. Learn how to make changes to production systems while keeping users up to date. Don't pass up this chance to optimize your software deployments. europython-2023-30125-zero-downtime-deployments-is-it-worth-the-effort TBD - Multiple Tracks (2023) Rafał Nowicki en Minimizing downtime during deployments is critical in the world of software development for maintaining high-availability applications and ensuring users have continuous access to applications. In this presentation, we will look at the advantages, disadvantages, and best practices of zero-downtime deployments. We will go over the technical aspects of achieving zero downtime, such as blue-green deployments, canary releases, feature toggles, and so on. We'll also talk about how to balance the benefits of zero-downtime deployments with the effort required to put them in place. You will discover the significance of testing, monitoring, and automation in achieving successful zero-downtime deployments. false https://programme.europython.eu/europython-2023/talk/F3KLX7/ https://programme.europython.eu/europython-2023/talk/F3KLX7/feedback/ Terrace 2B Poster 2023-07-19T13:00:00+02:00 13:00 01:00 Make your coding meaningful to non-technical recipients! Write your code in Jupyter Notebook, add widgets with the Mercury framework, and easily turn your notebook into an interactive web app. Or.. create a dashboard, a report, and DEPLOY it. europython-2023-29650-serve-notebook-as-a-web-app-with-mercury-framework PyData: Software Packages & Jupyter (2023) Aleksandra PlonskaPiotr Płoński en Problem: sharing coding work, notebooks with stakeholders, non-technical people without any basic knowledge of coding. Solution: 1. Write code in Jupyter Notebook. 2. Install Mercury 3. Choose widgets and decide how to present it. 3. Deploy. The poster will show how, with a few steps transform, a notebook into an interactive website, report, and dashboard easily. Using the Mercury framework doesn't require frontend technologies knowledge, only python. With this open-source solution, you can decide to restrict access to the created web app by adding authentication. What is more, you can set up notifications, show or hide code, serve multiple apps without the user's limit, users can easily export the executed notebook as a PDF or HTML. It doesn't require rewriting your code. In the end, you can decide if you want to self-host it or deploy it with Mercury Cloud. false https://programme.europython.eu/europython-2023/talk/YRM7GF/ https://programme.europython.eu/europython-2023/talk/YRM7GF/feedback/ Terrace 2B Talk 2023-07-19T14:00:00+02:00 14:00 00:30 Testing is a crucial part of the software development process. But, with so many testing techniques available, it can be challenging to know which one to use. While unit testing is a popular technique, it's not always the most effective or efficient way to ensure software quality. In this talk, we’ll explore spec-based testing, a technique that focuses on verifying that the software behaves in accordance with its specifications or requirements. europython-2023-29948-the-power-of-spec-based-testing-adding-functional-requirements-to-unit-test Testing (2023) Anupama Tiruvaipati en Our focus in this talk will be on the benefits of spec-based testing, including: 1. Problems with unit testing: How spec-based testing can bridge this gap. 2. Improved test coverage: Spec-based testing will ensure all the requirements or specifications are covered by the test, thereby helping to attain better overall software quality. 3. Reducing maintenance work: Since they are based on the software’s intended behaviour and not implementation details, spec-based tests are less likely to break due to changes in the code. This can lead to fewer tests needing to be maintained over time. 4. Better alignment: Spec-based testing ensures that software meets its intended purpose as defined by the requirements or specifications. Key takeaways: 1. Benefits of spec-based testing 2. How to boost your testing strategy with spec-based testing 3. How to get started with spec-based testing in your own project development 4. Learn how to identify functional requirements or specifications and create effective test cases false https://programme.europython.eu/europython-2023/talk/YPKPWV/ https://programme.europython.eu/europython-2023/talk/YPKPWV/feedback/ Terrace 2B Talk 2023-07-19T14:35:00+02:00 14:35 00:30 Are you just getting started in the world of data science and feeling overwhelmed by the abundance of information on various packages, models, and techniques? Perhaps you're finding it challenging to decide which visualization package to use or which tools to begin with. Maybe you're puzzled by the distinctions between pip and Conda, or you're feeling bombarded by all the news about AI and large language models. Worry no more! Join us for this Q&A session, where a panel of data science experts will be there to address all of your pressing questions. This session is designed to create a relaxed and welcoming environment for complete beginners in the field, offering guidance on topics that might be causing confusion. europython-2023-34742-q-a-panel-for-data-science-newbies Cheuk Ting HoVaibhav SrivastavJodie BurchellValerio Maggio en false https://programme.europython.eu/europython-2023/talk/M93HCV/ https://programme.europython.eu/europython-2023/talk/M93HCV/feedback/ Terrace 2B Talk 2023-07-19T15:30:00+02:00 15:30 00:30 It's great when you can share the results of your analysis not only as a presentation but as something that non-data scientists can explore on their own, looking for insights and applying their business expertise to understand the significance of what they find. With its accessibility for both creators and viewers, Streamlit offers a brilliant platform for data scientists to build and deploy data apps. Now, with the integration of [ipyvizzu](https://ipyvizzu.vizzuhq.com/latest/) - a new, open-source data visualization tool focusing on animation and storytelling - you can quickly create and publish interactive, animated reports and dashboards on top of static or dynamic data sets and your models. europython-2023-29337-interactive-animated-reports-and-dashboards-in-streamlit-with-ipyvizzu PyData: Software Packages & Jupyter (2023) Peter Vidos en The ability to build Streamlit apps that enable business users to explore data on their own is an excellent way to support data-driven decision-making in any organization. Pair this up with the animated transitions between the charts provided by the new, open-source library, ipyvizzu, and you have a self-service, interactive report or dashboard that makes it much easier for non-experts to make sense of complex data sets. In this talk, one of the creators of ipyvizzu shows how their technology works within Streamlit and the advantages of using animation in self-service data exploration to help business stakeholders feel smarter and do a better job. We'll cover the following topics within the talk: - Introduction to Vizzu, the open-source C++/JavaScript library behind ipyvizzu - Benefits of animated charts for storytelling and data exploration - Basic logic and options of ipyvizzu - Quick walkthrough of building an interactive report within Streamlit - Live examples to showcase the benefits and the opportunities false https://programme.europython.eu/europython-2023/talk/LQZ7BP/ https://programme.europython.eu/europython-2023/talk/LQZ7BP/feedback/ Terrace 2B Talk 2023-07-19T16:05:00+02:00 16:05 00:45 In this talk, we will present DuckDB. DuckDB is a novel data management system that executes analytical SQL queries without requiring a server. DuckDB has a unique, in-depth integration with the existing PyData ecosystem. This integration allows DuckDB to query and output data from and to other Python libraries without copying it. This makes DuckDB an essential tool for the data scientist. In a live demo, we will showcase how DuckDB performs and integrates with the most used Python data-wrangling tool, Pandas. Besides learning about DuckDB's main charactestics, users will also experience a live demo of DuckDB and Pandas in a typical data science scenario, focusing on comparing their performance and usability while showcasing their cooperation. The demo is most interesting for an audience familiar with Python, the Pandas API, and SQL. europython-2023-28844-duckdb-bringing-analytical-sql-directly-to-your-python-shell PyData: Data Engineering (2023) Pedro Holanda en The talk is catered primarily towards data scientists and data engineers. The talk aims to familiarize users with the design differences between Pandas and DuckDB and how to combine them to solve their data-science needs. We will have an overview about five main characteristics of DuckDB. 1) Vectorized Execution Engine, 2) End-to-end Query Optimization, 3) Automatic Parallelism, 4) Beyond Memory Execution, and 5) Data Compression. false https://programme.europython.eu/europython-2023/talk/BXZD9Z/ https://programme.europython.eu/europython-2023/talk/BXZD9Z/feedback/ PyCharm (Forum Hall) Announcements 2023-07-20T08:00:00+02:00 08:00 01:00 europython-2023-35608-registration-welcome-forum-hall-foyer-1st-floor en Welcome to EuroPython 2023! You can pick up your badges at any time during the week as long as we are open! If you want to avoid the morning rush on Wednesday, come on Monday and Tuesday! Queues will be sorted by your **first name** on your ticket. Your ticket can be located via your order confirmation email (from support@pretix.eu with the Subject: Your order: XXXX). If you ordered your ticket after we've sent badges for printing (after 10 July), go directly to the Info Desk (also referred as Debugging Desk) and a volunteer will help! false https://programme.europython.eu/europython-2023/talk/XPARN3/ https://programme.europython.eu/europython-2023/talk/XPARN3/feedback/ PyCharm (Forum Hall) Announcements 2023-07-20T09:00:00+02:00 09:00 00:15 europython-2023-34202-morning-announcement en false https://programme.europython.eu/europython-2023/talk/CHSAUC/ https://programme.europython.eu/europython-2023/talk/CHSAUC/feedback/ PyCharm (Forum Hall) Keynote 2023-07-20T09:15:00+02:00 09:15 00:45 The Future of Microprocessors - a talk about the history of microprocessors, how we got here and what might happen next. There will be two laws, one equation, some graphs and a particle beam weapon out of Star Trek. europython-2023-33371-the-future-of-microprocessors Sophie Wilson en false https://programme.europython.eu/europython-2023/talk/ZJRTGW/ https://programme.europython.eu/europython-2023/talk/ZJRTGW/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T10:30:00+02:00 10:30 00:45 Python running on the browser is the new frontier to creating true client-side web and mobile applications. Today we can many incredible things that were not possible just a few months ago before WASM, Pyodide and PyScript. The talk will cover what's possible today, cover the major features offered by PyScript and walk through creating amazing applications and games with Python, on the browser, without the need for Python server-side logic. europython-2023-29609-pyscript-and-the-magic-of-python-in-the-browser Web (2023) Nicholas TollerveyFabio Pliger en A year after its announcement, PyScript is a very different project. From major performance improvements to great plugins, PyScript applications allow a new way to create fun and educational opportunities that were not possible until now. This talk summarizes the work done over the past year, and what you might expect in the future. In this talk I will: * Give a quick overview of what PyScript is * Talk about features and changes introduced this year: * Support for the blazing-fast MicroPython interpreter * Powerful Plugins System (support for Python and Javascript) * Much improved Pythonic Dom interface * Improved support for data * Execution in web workers * Many amazing plugins! * Much more… * Show how to create PyScript applications [running on the browser] and leverage the new possibilities that the web and the browser provide to the Python ecosystem * Live demo of amazing [PyScript] web applications running Python on the browser * Give you a sneak preview of some upcoming features What should you expect? Fun! Yes, I promise we’ll make it fun :) To walk away with a good understanding of how to write a PyScript application To have an understanding of what parts of Python on the browser are different than “regular Python” See snippets and examples that you can use to build your own PyScript apps Why should you care? Python on the browser is the new frontier of Python. You’ll have the chance to learn more about it, how to create your own Python apps on the browser, and see what’s coming. false Web based slides (press "S" for speaker notes and allow popups from the site) https://programme.europython.eu/europython-2023/talk/ZUSHKU/ https://programme.europython.eu/europython-2023/talk/ZUSHKU/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T11:20:00+02:00 11:20 00:30 Pyodide is a port of CPython to WebAssembly/Emscripten enabling Python packages to run directly in the browser or Node.js. We will provide an overview of Pyodide's architecture, capabilities, and potential use cases before looking into building, running, and testing Python packages for the browser. We will also discuss how browser-specific optimizations, such as code splitting, tree shaking, and lazy loading could be adapted to Python to reduce package size and load time. Finally, we will mention some of the common restrictions of the browser runtime and how they can be overcome in Python packages. europython-2023-29656-running-python-packages-in-the-browser-with-pyodide Web (2023) Roman Yurchak en false https://programme.europython.eu/europython-2023/talk/XLLSWL/ https://programme.europython.eu/europython-2023/talk/XLLSWL/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T11:55:00+02:00 11:55 00:30 In the recent years we saw an explosion of usage of Python in the browser: Pyodide, CPython on WASM, PyScript, etc. All of this is possible thanks to the powerful functionalities of the underlying platform, WebAssembly, which is essentially a virtual CPU inside the browser. europython-2023-28768-the-cpu-in-your-browser-webassembly-demystified Web (2023) Antonio Cuni en In the recent years we saw an explosion of usage of Python in the browser: Pyodide, CPython on WASM, PyScript, etc. All of this is possible thanks to the powerful functionalities of the underlying platform, WebAssembly. In this talk we will examine what is exactly WebAssembly, what are the strong and weak points, what are the limitations and what the future will bring us. We will also see why and how WebAssembly is useful and used outside the browser. This talk is targeted to an intermediate/advanced audience: no prior knowledge of WebAssembly is required, but it is required to have a basic understanding of what is a compiler, an interpreter and the concept of bytecode. The introduction will cover the basics to make sure that the talk is understandable also by people who are completely new to the WebAssembly world, but after that we will dive into the low-level technical details, with a special focus on those who are relevant to the Python world, such WASI vs emscripten, dynamic linking, JIT compilation, interoperability with other languages, etc. false https://programme.europython.eu/europython-2023/talk/HL8XCC/ https://programme.europython.eu/europython-2023/talk/HL8XCC/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T12:30:00+02:00 12:30 00:30 Python has proven itself to be a powerful tool for data science, and for web servers. However, one area where it hasn't historically been popular is in building applications for end users. In this talk, you'll discover how you can use Briefcase to distribute an app to users on desktop, mobile, and the web - all from a single Python codebase. europython-2023-28781-packaging-python-apps-with-briefcase Python Libraries (2023) Russell Keith-Magee en Once you're written your amazing new application using Python, the next problem you'll face is how to get that application into the hands of users. If your users are familiar with `pip` and and `venv`, you can put `pip install` into a README, and leave it at that. But what if your audience aren't Python programmers? What if your app needs to be used by people who don't write Python at all? How do you distribute your code so that others can use it? In this talk, you'll learn about **Briefcase**, a tool that can convert a Python project into platform-native installers on macOS, Windows, Linux - and can also target iOS, Android, and the web. You'll learn how to use Briefcase to start a new project, or convert an existing project for distribution. You'll learn about the features of Briefcase that can support you while you develop your application. Finally, you'l learn how to generate installers and standalone applications for multiple platforms from a single Python codebase. false https://programme.europython.eu/europython-2023/talk/B7WYKQ/ https://programme.europython.eu/europython-2023/talk/B7WYKQ/feedback/ PyCharm (Forum Hall) Panel 2023-07-20T14:00:00+02:00 14:00 01:00 The [EU Cyber Resilience Act (CRA)](https://digital-strategy.ec.europa.eu/en/library/cyber-resilience-act) may have a huge impact on the open-source community. There are concerns about how this framework would be applied to the open-source software contribution and distribution. If you would like to know more and voice out your concerns, join our sessions with leaders in the Python community and experts in the field. europython-2023-33482-0-cyber-resilience-act-panel en ## Agenda - 2:00 pm - 2:40 pm - CRA panel - 2:40 pm - 3:00 pm - CRA panel Q&A - 3:00 pm - 3:30 pm - Coffee break - 3:30 pm - 4:30 pm - CRA Unconference Discussion (at Open Space) --- ## CRA Panel We have invited leaders in the Python community and domain experts to discuss the current state of CRA, related regulations and the potential effect to open-source, especially in the Python community. Confirmed Panelists are: - Deb Nicholson - Executive Director at the Python Software Foundation - Jannis Leidel - Founder of the Python Packaging Authority and the PSF Board of Directors - Ciarán O'Riordan - Senior Policy Advisor of OpenForum Europe ## CRA panel Q&A After the panel, it is your turn to ask questions and voice out your concern regarding the CRA. Are you a contributor to open-source software and wonder who will be held accountable for the software that you contributed? Are you working for a company that publishes open-source software and wonder if that will affect the business model of your company? Are you using open-source software and wonder if the open-source ecosystem would be the same after the CRA has been put into action? Join us to discuss all these. ## CRA Unconference Discussion If you would like to discuss further about CRA and the related PLD (Product Liability Directive), and their potential effect in the open source community. We reserved a 1-hour session in the open space for unconference discussion. false https://programme.europython.eu/europython-2023/talk/F9UBUW/ https://programme.europython.eu/europython-2023/talk/F9UBUW/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T15:30:00+02:00 15:30 00:30 The advancements of artificial intelligence in computer vision and natural language processing often make the headlines, but the subspace of musical AI is developing just as rapidly. Let’s take a dive into the research area of music information retrieval and see how Python enables some of its proudest achievements. You’ll learn about common MIR tasks and get ideas on how you can analyze, generate and interact with music using code, so you can start exploring right away! No music theory knowledge nor prior experience with MIR is expected. europython-2023-29748-music-information-retrieval-with-python PyData: Deep Learning, NLP, CV (2023) Mateusz Modrzejewski en The talk gives an overview of the music information retrieval (MIR) research area. The area encompasses music analysis, generation, processing and recommendation. Python is one of the main tools used in MIR, with many dedicated libraries and more and more pre-trained AI models available for Pythonistas. Both the research area of MIR and the contents of this talk are highly interdisciplinary - MIR has something for you regardless whether you're a music lover, an active musician, deep learning researcher or web app builder! false https://programme.europython.eu/europython-2023/talk/CRPQGK/ https://programme.europython.eu/europython-2023/talk/CRPQGK/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T16:05:00+02:00 16:05 00:45 We're entering the age of machine-generated art. Many of the new systems are shockingly impressive but impossible to replicate by individuals because they rely on complex machine learning techniques with huge datasets that aren't feasible to do in a home environment. Fortunately, there's an entire group of clever approaches to generate graphics that look cohesive, unique, and deliberate... and that you can easily do on your own computer. In this short talk we'll go through a few of those algorithms like Clifford attractors, slime mold simulation, and reduction of source imagery to geometric primitives. We'll generate images and animations, we'll dabble in 2D and 3D. You'll leave the talk with your own ideas how to create attractive visualizations out of thin air. The talk assumes familiarity with Python and high-school math. europython-2023-29572-games-of-life-generative-art-in-python Arts, Crafts Culture & Demos (2023) Łukasz Langa en false https://programme.europython.eu/europython-2023/talk/KYAWCJ/ https://programme.europython.eu/europython-2023/talk/KYAWCJ/feedback/ PyCharm (Forum Hall) Keynote 2023-07-20T16:55:00+02:00 16:55 00:45 In 2018 the author, journalist and broadcaster Andrew Smith realized that although computer code now mediated almost everything he did, he understood next to nothing about it. The only way to participate in the growing debates around what our code should and should not do, he reasoned, would be to enter the world of the people writing it, by learning to code himself. Nice idea! In a near thirty year writing career, Smith had flown to the edge of space, slept under Spearfish torpedoes aboard a nuclear hunter-killer submarine, roamed the vast Victorian sewer system under London, spent six months on the road with Bianca Jagger, toured with artists including Radiohead and The Prodigy, and been perhaps the only person ever to shake Fidel Castro's hand by accident. None of which prepared him for the challenge of learning to code. After a miserable false start with JavaScript, a kindly C++ programmer pointed him in the direction of Python and he fell in love not just with the language, but with the remarkable community behind it. In this unusual keynote, Andrew, with help from his great friend and Python stalwart Nicholas Tollervey, will describe what he found—explaining the joys, frustrations and surprises, while touching on his experiences in Silicon Valley and the intriguing historical discoveries he made during his research. Smith's meditation on code's relationship to the wider world, Devil in the Stack: Searching for the Soul of the New Machine, will be published next March. This is his chance to share a preview of his reflections with the community that did so much to make them possible, of which he is grateful to consider himself a part. europython-2023-33370-welcome-to-your-world Andrew Smith en false https://programme.europython.eu/europython-2023/talk/RMHLRA/ https://programme.europython.eu/europython-2023/talk/RMHLRA/feedback/ PyCharm (Forum Hall) Talk 2023-07-20T17:45:00+02:00 17:45 00:45 Enjoy Thursday's lightning talks, hosted by Omotola Omotayo ⬇️ - **Being Nice** — Daniele Procida - **I am Biased** — Filipa Andrade - **What APL Taught Me about Python** — Rodrigo Girão Serrão - **All You Need to Know About Federated Learning in 2 Minutes** — Sarah Diot-Girard - **A Different (Travel) Program** — Riccardo Polli - **fstring.help Or: How I Bought Yet Another Domain** — Florian Bruhin - **Community Conference / Events Announcements & Celebration!** - **Pick a Side: Planet or Profit?** — Chiin-Rui Tan - **Isolated Python Functions** — Meder Kamalov - **Gambatte Terminal** — Vincent Michel europython-2023-34204-lightning-talks-thursday en false https://programme.europython.eu/europython-2023/talk/YWGAUU/ https://programme.europython.eu/europython-2023/talk/YWGAUU/feedback/ South Hall 2A Talk 2023-07-20T10:30:00+02:00 10:30 00:30 Don’t you love pickles? In the data science space, the pickle module has become one of the most popular ways to serialise and distribute machine learning models - yet, pickles introduce a wide range of problems. For starters, it is incredibly easy to poison a pickle. Once this happens, a poisoned pickle can be used by an attacker to inject any arbitrary code into your ML pipelines. And what’s even worse: it’s incredibly hard to detect if a pickle has been poisoned! Good news? Help is on the way! You now have access to an increasing number of tools to help you generate higher-quality pickles. And when those are not enough, you can always draw inspiration from the DevOps movement and their trust-or-discard processes. This talk will show you how widespread pickles are and how easy it is to poison models serialised with pickle, but also how easy it is to start protecting them from attacks. europython-2023-29804-poisoned-pickles-make-you-ill PyData: Machine Learning, Stats (2023) Adrian Gonzalez-Martin en false Notebooks & Code Slides https://programme.europython.eu/europython-2023/talk/SDEUCB/ https://programme.europython.eu/europython-2023/talk/SDEUCB/feedback/ South Hall 2A Sponsored 2023-07-20T11:20:00+02:00 11:20 00:30 What-if analysis is the key to exploring datasets and assessing outcomes by gradually varying input parameters. It is a vital tool for users in the realm of data analysis and decision-making. However, implementing what-if analysis can be challenging. Join this captivating talk as we delve into the practical implementation of what-if analysis using Taipy. europython-2023-33361-unlocking-the-power-of-what-if-analysis-for-bi-data-and-ai-with-taipy Jean-Baptiste Braun en This session will delve into a real-world industry case study highlighting the profound benefits of what-if analysis. While the focus is on Business Intelligence (BI), the concepts discussed are equally applicable to AI and data analysis in general. Agenda: Understanding the limitations of data exploration without what-if analysis Discovering why your users will fall in love with what-if analysis Demystifying the possibility of implementing what-if analysis with popular tools like PowerBI and Looker Introducing Taipy: The Ultimate What-If Analysis Toolkit Unveiling the killer features of Taipy that empower data professionals A glimpse into the future of Taipy and what to expect Live demo showcasing Taipy's powerful scenario feature This session will ignite your enthusiasm as we explore the game-changing potential of designing front-ends in Python. With Python skills already prevalent among data analysts, the possibilities are endless. Join this exciting journey as we unlock the full potential of what-if analysis with Taipy. false https://programme.europython.eu/europython-2023/talk/B3MU99/ https://programme.europython.eu/europython-2023/talk/B3MU99/feedback/ South Hall 2A Talk 2023-07-20T11:55:00+02:00 11:55 00:30 All major companies have huge amounts of (mostly PDF) documents that contain important - even critically important - information, that does no longer exist anywhere else in their data stores. Reports, once generated for shareholders and legal or financial authorities, may still be useful for developing longterm forecasts or triggering company management decisions. By definition, documents are intended for human perception, and as such contain unstructured data from an information technology perspective. Therefore, tools to extract PDF text content (mostly, but not only text) from millions of pages have become important vehicles to recreate structured information. This presentation talks about extraction "need for speed" in this Big Data scenario, the need for integration with OCR capabilities and presents an open-source toolset which combines both, top-of-the-class performance and maximum extraction detail. europython-2023-29425-high-volume-pdf-text-extraction-using-python-open-source-tools PyData: Data Engineering (2023) Harald Lieder en false https://programme.europython.eu/europython-2023/talk/ZPH9PC/ https://programme.europython.eu/europython-2023/talk/ZPH9PC/feedback/ South Hall 2A Talk 2023-07-20T12:30:00+02:00 12:30 00:30 [Python dunder methods](https://mathspp.com/blog/pydonts/dunder-methods) – like `__init__` – are sometimes referred to as “magic methods” but they are not! They are just regular methods! Functions that are associated with objects and that you can call with arguments. The only thing is... Python also calls those functions behind the scenes in certain situations! So, let us learn what that is all about. europython-2023-35781-how-dunder-methods-rule-python-under-the-hood Python Internals & Ecosystem (2023) Rodrigo Girão Serrão en In this talk aimed at beginners, we will see what “dunder methods” are and how they govern Python behind the scenes. We will understand, for example, why the funny-looking method `__init__` looks so funny and what its real purpose is. Then, we will understand that all of the Python syntax really is governed by dunder methods, and thus, if you want your own classes and objects to interact with the Python syntax, all you need to do is implement the appropriate dunder methods. For example, we will see how to use dunder methods to enable you to create a good string representation of your class, or how to define `len` on your own objects. Although the talk is aimed at beginners, the audience is expected to know how to use the keyword `class` to create their own classes. All materials can be accessed from [this GH repo](https://github.com/mathspp/talks). false https://programme.europython.eu/europython-2023/talk/D9HP7Z/ https://programme.europython.eu/europython-2023/talk/D9HP7Z/feedback/ South Hall 2A Talk 2023-07-20T14:00:00+02:00 14:00 00:30 pip install malware: it’s that easy. Almost all projects depend on external packages, but did you know how easy it can be to install something nasty instead of the dependency you want? I'll be showing this live, as I make malware and install it from PyPI onto my own computer during the talk! europython-2023-29432-pip-install-malware Security (2023) Max Kahan en You might remember classic typosquatting examples like goggle.com, but it’s now common to see malicious code hidden in spoofed or otherwise fraudulent PyPI packages or nested dependencies. Malware developers can also use techniques like starjacking to appear legitimate, so these unpleasant packages become even more difficult to spot. It’s estimated that over 3% of packages on PyPI could be using this technique. By the end of this talk, you’ll know how to protect yourself when installing and updating dependencies and you’ll leave with a checklist to follow to help you stay safe in future. false https://programme.europython.eu/europython-2023/talk/XEQPYB/ https://programme.europython.eu/europython-2023/talk/XEQPYB/feedback/ South Hall 2A Talk 2023-07-20T14:35:00+02:00 14:35 00:30 [PEP 458](https://peps.python.org/pep-0458/) uses cryptographic signing on [PyPI](https://pypi.org) to protect Python packages against attackers. The implementation of the PEP inspired the [Repository Service for TUF (RSTUF)](http://repository-service-tuf.readthedocs.io/), a project [accepted into the OpenSSF sandbox](https://github.com/ossf/tac/pull/137). We identified that the design could benefit other organizations and repositories looking to secure their software supply chains. In this talk we would answer the following questions: - How did the PEP 458 design help to start the Repository Service for TUF (RSTUF)? - How could RSTUF be used for PyPI with its millions of packages? - How can RSTUF be deployed by any organization at any scale without requiring TUF expertise? Additionally, in this talk, we would give an overview of PEP 458, how it works, and give a high-level overview of TUF. europython-2023-29395-pep-458-a-solution-not-only-for-pypi Security (2023) Kairo de AraujoMartin Vrachev en [PEP 458](https://peps.python.org/pep-0458/) was designed to protect [PyPI](https://pypi.org) against various possible attacks on PyPIs own content distribution network and its mirrors while giving administrators a mechanism to recover from a compromise if it happens using [The Update Framework (TUF)](http://theupdateframework.io/). Using [Repository Service for TUF (RSTUF)](http://repository-service-tuf.readthedocs.io/) is actually deploying TUF as a service based on PEP 458 design to solve a lot of common problems for repositories. It will help PyPI maintainers to integrate TUF using simple REST API calls without adding a large amount of code in the PyPI/Warehouse code base. In this talk, we will recap PEP 458 and TUF, and what they are good for. We will show how RSTUF works and demonstrate the integration with Warehouse. Additionally, we will share how other organizations could use RSTUF to protect their clients. false https://programme.europython.eu/europython-2023/talk/ETSMPK/ https://programme.europython.eu/europython-2023/talk/ETSMPK/feedback/ South Hall 2A Talk 2023-07-20T15:30:00+02:00 15:30 00:30 As a developer, you play a crucial role in the security of your projects. At the same time, it can be difficult to know if what you’re doing is enough. Luckily, you don’t have to be a security expert to contribute to the security of your projects. Instead, you can use industry standards as a guide for your approach to security. In this talk, I will introduce you to a framework that is especially accessible to developers, the [OWASP DevSecOps Maturity Model](https://owasp.org/www-project-devsecops-maturity-model/), and help you get started with a systematic approach to improving the security of your projects. europython-2023-29569-don-t-panic-a-developer-s-guide-to-security Security (2023) Sebastiaan Zeeff en One of the leading security principles today is that you should embrace security practices throughout your entire Software Development Lifecycle (SDLC), from design to deployment and maintenance. This means that you, as a developer, have a crucial part to play in keeping your projects secure. In my talk, I will show you how to do that by introducing you to the [OWASP DevSecOps Maturity Model (DSOMM)](https://owasp.org/www-project-devsecops-maturity-model/). This model, which is very accessible to anyone familiar with DevOps, allows you to evaluate and improve your security practices. As the model describes the entire Software Development Lifecycle, it also serves as a nice reference framework for industry-standard security practices. I will start by giving you a high-level overview of the model and the principles behind it. I will also compare the DevSecOps Maturity Model with its older sibling, the [OWASP Software Assurance Maturity Model (SAMM)](https://owasp.org/www-project-samm/). Since it’s important, I will end the first part by going into the difference between having a good security culture and [checkbox compliance](https://en.wiktionary.org/wiki/checkbox_compliance). Next, I will take you through the dimensions of the DevSecOps Maturity Model, with a focus on those dimensions that are especially relevant to developers. I will illustrate each dimension with concrete examples of security practices that you can implement yourself today. Finally, I will talk about the best way to start implementing these practices. This is crucial: For instance, if you suddenly introduce all the tools you can find, chances are that the only thing you’ll learn from the plethora of alerts you’ll get is how to ignore these tools. Since some of us also have to deal with corporate policies and a limited sphere of influence within an organization, I will end with some pointers on how to advocate good security practices from the bottom up. And, if this all feels a bit overwhelming, remember the big friendly letters in the title: [**Don’t Panic!**](https://en.wikipedia.org/wiki/The_Hitchhiker%27s_Guide_to_the_Galaxy) false https://programme.europython.eu/europython-2023/talk/BHXSQU/ https://programme.europython.eu/europython-2023/talk/BHXSQU/feedback/ South Hall 2A Sponsored 2023-07-20T16:05:00+02:00 16:05 00:45 Many of our sponsors are looking to hire talented people and EuroPython is the perfect place to reach out to them! In this session, our sponsors will each give a short presentation about their company and what they do with Python. You will meet and hear the exciting opportunities from JetBrains. Kraken Technologies, Microsoft, Optiver, Sentry, Temporal Technologies, Google Cloud, Numberly and Arm. Afterwards, you can approach them directly in their sponsor booth to carry on the conversation! europython-2023-33368-sponsor-highlight-recruitment-fair en false https://programme.europython.eu/europython-2023/talk/XYLWJH/ https://programme.europython.eu/europython-2023/talk/XYLWJH/feedback/ South Hall 2B Talk 2023-07-20T10:30:00+02:00 10:30 00:30 Neural networks have revolutionized AI, enabling machines to learn from data and make intelligent decisions. In this talk, we'll explore two popular architectures: Attention models and Diffusion models. First up, we'll discuss Attention models and how they've contributed to the success of large language models like ChatGPT. We'll explore how the Attention mechanism helps GPT focus on specific parts of a text sequence and how this mechanism has been applied to different tasks in natural language processing. Next, we'll dive into Diffusion models, a class of generative models that have shown remarkable performance in image synthesis. We'll explain how they work and their potential applications in the creative industry. This is a good talk for visual learners. I prepared schematic diagrams, which present main features of the nerual network architectures. By necessity, the diagrams are oversimplified, but I believe they will allow you to gain some insight into Transformers and Latent Diffusion models. europython-2023-29585-understanding-neural-network-architectures-with-attention-and-diffusion PyData: Deep Learning, NLP, CV (2023) Michał Karzyński en false https://programme.europython.eu/europython-2023/talk/ZCXMQK/ https://programme.europython.eu/europython-2023/talk/ZCXMQK/feedback/ South Hall 2B Talk 2023-07-20T11:20:00+02:00 11:20 00:30 Recently, most works focus on synthesizing independent images; While for real-world applications, it is common and necessary to generate a series of coherent images for story-telling. In this work, we mainly focus on story visualization and continuation tasks and propose AR-LDM, a latent diffusion model auto-regressively conditioned on history captions and generated images. To my best knowledge, this is the first work successfully leveraging diffusion models for coherent visual story synthesizing. europython-2023-29499-story-generation-using-stable-diffusion-in-python PyData: Deep Learning, NLP, CV (2023) Nilesh Arnaiya en In this talk, we will explore the use of stable diffusion and diffusion models in Python for generating original stories. We will first introduce the concept of stable diffusion and how it can be used to model the spread of information or ideas. We will then discuss how this can be applied to the task of story generation, and demonstrate how to use Python libraries such as Markovify and OpenAI ChatGPT API. false https://programme.europython.eu/europython-2023/talk/RGRQVQ/ https://programme.europython.eu/europython-2023/talk/RGRQVQ/feedback/ South Hall 2B Talk 2023-07-20T11:55:00+02:00 11:55 00:30 The emergence of ChatGPT has led to an exponential growth of prospects and implementations in the field of Natural Language Processing (NLP). Various teams were struck with FOMO (Fear of Missing Out) and hastened to incorporate Large Language Models (LLMs) into their products. By using OpenAI models (text-curie-001, davinci, gpt-3.5-turbo), we successfully integrated them into our production on March 2, granting our users the ability to receive text summaries in their email reports and comprehend the essence of any article within our application. Three weeks later, we trained our own large language model for the same purpose. This talk will delve into our journey, exploring the lessons and insights gleaned from our hands-on experience with these cutting-edge tools. europython-2023-29670-word-wranglers-news-navigators-taming-gpt-3-beast-for-media-monitoring PyData: Deep Learning, NLP, CV (2023) Petr Šimeček en While heaps of research focus on English texts, this talk will zoom in on using LLMs for smaller languages like Czech or Slovak. I'll share some hair-raising examples from our early days after deployment (trust me, when the LLM starts hallucinating about a local politician's resignation, your client won't be thrilled) and how we managed to tackle those challenges. I'll also chat about the quirks that come with non-English languages (more tokens, bigger models, ...) and dish about our experiments with other LLMs like OPT, BLOOM, and LLaMA. I will show how to fine-tune the general LLM to the Czech instruction set and demonstrate the danger of injecting false information. Finally, I will discuss possibilities of putting LLM to production. Established in 2015, Monitora Media burst onto the scene and rapidly rose to prominence in the realm of media analysis and monitoring across Central Europe. We've been shaking things up with innovations like real-time media monitoring and scrollable print titles, even scoring a spot on Deloitte's Technology Fast 50 for Central Europe in the past two years. We keep an eye on print and online publications, as well as TV and radio broadcasts, and podcast transcripts – we're talking over 350 programs, 9,000 websites, and 2,500 print titles! Python and Django hold a special place in our hearts. false https://programme.europython.eu/europython-2023/talk/SG3NQB/ https://programme.europython.eu/europython-2023/talk/SG3NQB/feedback/ South Hall 2B Talk 2023-07-20T12:30:00+02:00 12:30 00:30 Machines have become smarter than ever before. Recently, we have started using computers for solving problems beyond computations, and it might not be wrong to call them electronic creators. The future laptop might have a prompt based word application, replacing the current Word, where one has to type their thoughts and formulate an entire document from scratch. Similarly, we might see a prompt based Paint application, instead of the typical Paint program, that generates the paintings for us. In my opinion, AI-based applications are not in fiction anymore, and we may soon be using them on our computers. However, there is a possibilty that the Generative AI can be potentially harmful for society. We need to explore the ethical concerns, and how the AI can impact our society. In this talk, we will try to understand how Generative AI is becoming a part of our future and how we can use it in a responsible and ethical manner. europython-2023-29546-generative-ai-beyond-technicalities-an-ethical-perspective PyData: Ethics in AI (2023) Bhawna Singh en In the current rat race of building AI, the hype is being created to show that AI can take over the world and it can perform better in some aspects than humans. People are scared that they will not have their jobs anymore as they might get automated by GPT. There's also a belief that AI might develop sentience after ingesting so much data. This talk aims at addressing such issues. As a Researcher, I want to discuss the ground truth and share what's possible and what's not. Ultimately, the talk will leave the audience with an understanding of the architectures of AI and why we should adopt an ethical approach in developing and deploying these models. false https://programme.europython.eu/europython-2023/talk/YNHRBS/ https://programme.europython.eu/europython-2023/talk/YNHRBS/feedback/ South Hall 2B Talk 2023-07-20T14:00:00+02:00 14:00 00:30 Controllers deal with numbers all day long. They have to check a lot of data from different sources. Often the reports contain erroneous or missing data. Identifying outliers and suspicious data is time-consuming. This presentation will introduce a Small Data Problem-End2End workflow using statistical tools and machine learning to make controllers' jobs easier and help them be more productive. We will demonstrate how we used amongst others, - [scipy](https://scipy.org/) - [pandera](https://pandera.readthedocs.io/en/stable/) - [dirty cat](https://dirty-cat.github.io/stable/) - [nltk](https://www.nltk.org/) - [fastnumbers](https://pypi.org/project/fastnumbers/) to create a self-improving system to automate the screening of reports and report outliers in advance so that they can be eliminated more quickly. europython-2023-29033-solving-data-problems-in-management-accounting PyData: Data Engineering (2023) Alexander CS HendorfLucas-Raphael Müller en Controllers deal with numbers all day long. They have to check a lot of data from different sources. Often the reports contain erroneous or missing data. Identifying outliers and suspicious data is time-consuming. This presentation will introduce a Small Data Problem-End2End workflow using statistical tools and machine learning to make controllers' jobs easier and help them be more productive. It is a common business problem that the data provided is incorrect due to misunderstandings, manual input, cultural differences, typos, etc. and these errors can often be weeded out in short order. This talk will show how heuristic data validation can help to facilitate - in our specific use case controller - automated detection of inaccuracies, outliers or input errors. In our use case we have to deal with a lot of reports. Some of the reports contain hundreds of columns and are very individually structured. Defining data types and expectations for each individual report for each column would be too time-consuming. We are dealing with a technically manageable number of data sets, but too many to leave to human visual control alone. In our talk we will present strategies on how we have solved small data problems using heuristic and statistical methods. Questions to tackle: * Are None values ok or not, and if - why? * Is a value an outlier or a typo? * How much deviation is ok, or not? * How can historical data help and to what extent? * Which other external information can help to validate data? We will demonstrate how we used amongst others, - [scipy](https://scipy.org/) - [pandera](https://pandera.readthedocs.io/en/stable/) - [dirty cat](https://dirty-cat.github.io/stable/) - [nltk](https://www.nltk.org/) - [fastnumbers](https://pypi.org/project/fastnumbers/) to create a self-improving system to automate the screening of reports and report outliers in advance so that they can be eliminated more quickly. Audience: This presentation is intended for anyone interested in data quality management without heavy lifting. Especially small data problems. false https://programme.europython.eu/europython-2023/talk/DT9HXE/ https://programme.europython.eu/europython-2023/talk/DT9HXE/feedback/ South Hall 2B Talk 2023-07-20T14:35:00+02:00 14:35 00:30 This talk presents Appeal, a new library for command-line parsing in Python. Appeal avoids the cumbersome APIs and repetition endemic to the currently prevalent libraries in this space by leveraging Python's own function call interface. This talk will familiarize the audience with Appeal, its motivation, its approach, and its expressive power, and show them how to use Appeal in their own programs. europython-2023-29903-give-your-program-appeal Python Libraries (2023) Larry Hastings en Appeal is a new and different command-line parsing library. It leverages Python's powerful function call interface to define your command-line, thus avoiding the clumsy, wordy APIs and endless repetition associated with other libraries. With Appeal, you just write Python functions, and it does the rest! This talk will show you how to use Appeal, how it works internally, and will leave you ready to use Appeal with your own programs. false https://programme.europython.eu/europython-2023/talk/XRGTRX/ https://programme.europython.eu/europython-2023/talk/XRGTRX/feedback/ South Hall 2B Talk 2023-07-20T15:30:00+02:00 15:30 00:30 Are you tired of writing complicated code only to discover that Python has tools in its standard library that could have made your life easier? Join us for a tour of the standard library where we'll dive into less-known modules that do well-known things and well-known modules that do less-known things. This talk is tailored to beginners or anyone who wants to learn more about Python's standard library. europython-2023-29427-the-standard-library-tour Python Internals & Ecosystem (2023) Mia Bajić en The Standard Library Tour is designed to provide attendees with an understanding of Python's standard library less known features. Have you ever found yourself writing complex code only to discover that Python has tools available within its library that could have made your job easier? Then this talk is for you! The outline of the talk: * Basic information about the library * Well-known modules which do less-known things * `functools` less-known features: `@singledispatch`, `partial()`, `@cache` * `itertools` less-known features: `product()`, `filterfalse()`, `zip_longest()` * `collections` less-known features: `ChainMap`, `defaultdict` * Less-known modules which do well-known things * `doctest` for testing: `testmod()` * `Difflib` & `Filecmp` for comparison: `Difflib.SequenceMatcher`, `Filecmp.cmpfiles()` * `contextlib` for tasks involving the `with` statement: `@contextmanager`, `@asynccontextmanager` By attending this session, you'll gain a deeper understanding of Python's standard library and you'll discover the "unknown unknowns" - tools that you may not even know exist within Python's standard library. By becoming familiar with the library and all of its capabilities, you'll be better equipped to solve problems and build applications more efficiently, without reinventing the wheel. You'll also receive recommendations on where to find additional resources and information so you can continue learning and exploring Python's tools after the conference has ended. false https://programme.europython.eu/europython-2023/talk/VHWTVF/ https://programme.europython.eu/europython-2023/talk/VHWTVF/feedback/ South Hall 2B Talk 2023-07-20T16:05:00+02:00 16:05 00:30 Discover how coding conventions can enhance code quality, readability, maintainability, and reduce errors. Join us as we discuss the creation and implementation of coding conventions, and how to use linters for maintenance. europython-2023-29678-the-coding-conventions-that-makes-our-lives-easier Software Engineering & Architecture (2023) Çağıl Uluşahin Sönmez en Engineers review code as often as they write it and use a lot of tools to improve this process, such as linters and auto-formatters. One tool that is also very useful is coding conventions. It is a collection of references that can be used during code reviews while also serving as a valuable day-to-day reference and guide for the entire team. This talk will explore several different conventions from the open-source conventions repository, offering an in-depth exploration of how they improve the quality of the codebase and serve as a tool for knowledge transfer among engineering teams. The structure of the talk will follow: * What are coding conventions, and why do we use them? * How to establish your own coding conventions? * Examples of some of the most useful coding conventions and how they enhance code quality. * How to uphold your coding conventions with the help of linters? Attendees will leave with a comprehensive understanding of the concept of coding conventions and how to implement them within their own team. false https://programme.europython.eu/europython-2023/talk/ZFB73A/ https://programme.europython.eu/europython-2023/talk/ZFB73A/feedback/ North Hall Talk 2023-07-20T10:30:00+02:00 10:30 00:30 Distributed databases are widely used in modern applications for their high availability and scalability. Have you ever wondered how data integrity is maintained with the data across multiple nodes? One of the key components of achieving this is distributed consensus. Raft is a widely used consensus algorithm that provides a fault-tolerant and highly available system. In this talk, we will explore how to implement Raft consensus using the rqlite distributed database in python. europython-2023-29537-unlocking-the-power-of-raft-consensus-with-rqlite-using-python TBD - Multiple Tracks (2023) Tanya Sneh en Consensus is a fundamental problem in distributed systems, and it is critical for maintaining data consistency and availability in applications. In this talk, we will explore how to implement Raft consensus using rqlite, a distributed database that uses SQLite as its storage engine. We will begin with an overview of distributed databases and the need for consensus algorithms, followed by a deep dive into the key concepts of the Raft consensus algorithm. We will discuss how Raft ensures consistency and availability in a distributed system and explore its strengths and weaknesses compared to other consensus algorithms. We will then focus on rqlite, a powerful tool for building distributed databases with Raft consensus. We will cover its key features, including its SQL interface, fault tolerance, and scalability. We will also demonstrate how to use rqlite in Python applications to build fault-tolerant and highly available distributed systems. Attendees will gain a deeper understanding of the key concepts of distributed consensus, the benefits of using the Raft algorithm, and how to implement it using rqlite in python. No prior knowledge of consensus algorithms, Raft, and rqlite is required, but some familiarity with databases would be helpful. This talk is suitable for developers, database enthusiasts, and anyone interested in distributed systems and database design. false https://programme.europython.eu/europython-2023/talk/WUPCGU/ https://programme.europython.eu/europython-2023/talk/WUPCGU/feedback/ North Hall Talk 2023-07-20T11:20:00+02:00 11:20 00:30 Ritchie Vink is the Author of the new Polars DataFrame library. The library that is built for modern hardware. Polars is a query engine written in Rust that focusses on the DataFrame front-end. It is written from scratch in Rust designed to be fast, parallel and memory efficient. This talk we'll go through in the design of Polars and some of its design decisions. europython-2023-35631-what-polars-does-for-you PyData: Software Packages & Jupyter (2023) Ritchie Vink en Ritchie Vink is the Author of the new Polars DataFrame library. The library that is built for modern hardware. Polars is a query engine written in Rust that focusses on the DataFrame front-end. It is written from scratch in Rust designed to be fast, parallel and memory efficient. This talk we'll dive deeper the design of Polars. false https://programme.europython.eu/europython-2023/talk/TYTBKX/ https://programme.europython.eu/europython-2023/talk/TYTBKX/feedback/ North Hall Talk 2023-07-20T11:55:00+02:00 11:55 00:30 What if you don't want a Cat to be an Animal? What is the Liskov Substitution Principle? And what on earth is contravariance? Discover the answers to these questions and more, as we explore the foundations of generic types in Python. And by the end, you might even understand the weirder errors that Mypy sometimes throws your way. europython-2023-29258-learning-the-ropes-understanding-python-generics Software Engineering & Architecture (2023) David Seddon en Do you run a static type checker, such as Mypy, on your Python code? And have you ever been confused by the error messages? In Learning the Ropes, we'll explore how the Python's support for generics can unlock new patterns in your code. Along the way, we'll learn about some foundations of type theory which will give you a firmer understanding of what type safety really means. Suddenly those Mypy errors will make sense. Be prepared to think hard and learn fancy new terms with which you can dazzle your friends and relations! false https://programme.europython.eu/europython-2023/talk/W8J9MF/ https://programme.europython.eu/europython-2023/talk/W8J9MF/feedback/ North Hall Talk 2023-07-20T12:30:00+02:00 12:30 00:30 As Bloomberg’s infrastructure grows and evolves, the tools we use to manage it are becoming increasingly important. To streamline infrastructure management, our team set out to design a REST API and constituent CLI (Command Line Interface) that would comprise a single interface for both programmatic and human interaction with our infrastructure. Traditionally, building a CLI that is tightly coupled to an API requires maintaining a separate codebase, which is tedious and error-prone. Instead, we designed a CLI that dynamically generates commands based on the OpenAPI JSON documentation. However, since APIs are designed for computer interaction, we designed our API to include the information needed to implement a human-friendly CLI. Leveraging Python, FastAPI, and numerous other open source projects, we built a stable, extensible tool that greatly improves how we interact with our infrastructure. europython-2023-29387-designing-a-human-friendly-cli-for-api-driven-infrastructure Infrastructure: Cloud & Hardware (2023) Oliver Rew en In this talk, we will share our experience designing a resilient infrastructure API with a human-friendly CLI that does not need continued development, even as the API evolves. We will discuss some of the specific approaches we used to build a dynamically-updated CLI with human-friendly features: - Extending OpenAPI to communicate CLI intent - Using templating languages (Jinja) to convert the API’s response JSON into human readable output - Defining CLI command aliases to abstract long, verbose API endpoints - Embedding CLI help text in the API to generate well-documented commands - Other small enhancements and strategies that improve the CLI user’s quality-of-life. Furthermore, we will also discuss how we leveraged several open source projects and standards to accomplish our goals, including Python, FastAPI, OpenAPI, Jinja, OAuth2, Pydantic, prompt_toolkit, and more. false https://programme.europython.eu/europython-2023/talk/8S3VD9/ https://programme.europython.eu/europython-2023/talk/8S3VD9/feedback/ North Hall Talk 2023-07-20T14:00:00+02:00 14:00 00:30 Are you tired of struggling with memory management in Python? Do you want to take your skills to the next level and achieve maximum performance while minimising memory usage? Look no further, here is Zero-Copy in Python! Zero-copy is a technique in computer programming that allows data to be transferred between different parts of a program without being copied to intermediate buffers. In Python, this technique can be achieved using the memory view object, which provides a view into the memory of other objects. Learn how to efficiently manipulate large datasets and optimise your code with the help of this powerful tool. Whether you're working with sockets, objects or memory profiling, memory view is your key to faster and more efficient Python programming. europython-2023-29478-zero-copy-zen-boost-performance-with-memory-view TBD - Multiple Tracks (2023) Kesia Mary JoiesAby M Joseph en In today's data-driven world, efficient memory management is critical for achieving optimal performance in Python. Memory view and byte array provide a powerful combination of tools for managing bytes and memory in Python, enabling zero-copy interactions that can significantly improve performance and reduce memory usage. Memory view is a built-in Python class that provides a zero-copy interface to the memory of an object, allowing efficient manipulation of large data sets. Memory view objects can be used to share memory between different parts of a program without creating intermediate copies of the data, which can significantly improve the performance of Python code. This feature is particularly useful when working with large arrays, binary data, or network programming using sockets. Memory view can also be used in conjunction with the buffer protocol to work with objects in a zero-copy manner. Overall, memory view is a powerful tool for Python developers looking to optimise their code and improve performance. This talk will explore the technical aspects of memory view and byte array, providing real-world examples of how these tools can be used to achieve zero-copy interactions with bytes. Attendees will learn how to optimise their code by leveraging these tools, with a focus on achieving maximum performance while minimising memory usage. false https://programme.europython.eu/europython-2023/talk/9CUAPR/ https://programme.europython.eu/europython-2023/talk/9CUAPR/feedback/ North Hall Sponsored 2023-07-20T14:35:00+02:00 14:35 00:30 As developers, we learn early on that it’s important to focus on getting our code to work without unnecessarily pre-optimizing, but how do we learn to eventually optimize our code? What do we look for? How do you know when something is slow? How do you **do** something about it? In this talk, we’ll discuss why your application performance matters, how you can learn to identify what matters most to you, and how Sentry has you in mind so you can effectively spend time improving the performance of critical user flows in your application. europython-2023-33362-cultivating-a-performance-mindset Nar Saynorath en false Powerpoint Slides https://programme.europython.eu/europython-2023/talk/3GWJCA/ https://programme.europython.eu/europython-2023/talk/3GWJCA/feedback/ North Hall Talk 2023-07-20T15:30:00+02:00 15:30 00:30 How to get familiar with codebase you need to maintain with minimum suffering? How to leave codebase easier to deal with for your colleagues so they don’t have to suffer like you did? If you are experienced developer or a junior just starting your journey, inheriting codebase can be a very challenging task. Especially if the codebase is not quite up to your standards, or it’s just huge and complex beast. I will convey my experience and tips and tricks on inheriting code I acquired during 12 years of software development on new and old projects. The talk will provide guidelines to ease taking over code from somebody else, as well as remind developers of the importance that planning, preparation and documentation have in facilitating code change and project growth. europython-2023-29534-dive-into-codebase-like-a-pro Software Engineering & Architecture (2023) Luka Raljević en false https://programme.europython.eu/europython-2023/talk/U3SEG8/ https://programme.europython.eu/europython-2023/talk/U3SEG8/feedback/ North Hall Talk 2023-07-20T16:05:00+02:00 16:05 00:45 In this talk we will take you through a complete journey a website takes - from conception to running in production, the right way. What is the best setup for local development, how to then move to testing and production? An opinionated talk from two veterans. europython-2023-30057-from-idea-to-production DevOps (2023) Flavio PercocoHonza Král en We start with choosing the proper architecture, show you what is a good setup for local development, and finally we will deploy our code to production. The aim is to demystify the devops buzzword as well as show some practical examples that can be used by beginners as well as experienced developers. false https://programme.europython.eu/europython-2023/talk/XYHXYP/ https://programme.europython.eu/europython-2023/talk/XYHXYP/feedback/ Terrace 2A Talk 2023-07-20T10:30:00+02:00 10:30 00:45 Arm is everywhere technology matters: 250+ billion chips in everything from sensors to smartphones to servers. Due to its simplicity, versatility, and growth in popularity over the past decade Python is the most used language in the world. In this presentation I will show you what the status of Python is on Arm architecture on all major operating systems and how you could help to improve it further. europython-2023-29360-python-on-arm-architecture Python Internals & Ecosystem (2023) Diego Russo en I've recently joined the RCVM (runtimes, compilers and virtual machines) team in the Open Source Software group at Arm for a secondment of 6 months, looking at the status of Python and its ecosystem on Arm architecture. I engage with Arm's internal teams, external partners and the upstream community looking at potential gaps and how these can be fixed. During the presentation I will introduce the Arm architecture and explain the status of Python and its ecosystem on it. I will share my findings about potential gaps to be fixed and how we (as company, partners and community) can fix them to have a flawless Python experience on Arm. The high-level agenda for this talk is: * Introduction to Arm architecture and why this matters to you (5 min) * What it has been done to enable Python on Arm architecture (10 min) * This will likely involve activities from Arm, its partners and the upstream community * I'll try to cover all major operating systems * What gaps do we have today? (10 min) * This will be likely the result of my secondment * What's next? (5 min) * How you can help to get Python and its ecosystem even better on Arm architecture * Final remarks (5 min) false https://programme.europython.eu/europython-2023/talk/7KAKAG/ https://programme.europython.eu/europython-2023/talk/7KAKAG/feedback/ Terrace 2A Talk 2023-07-20T11:20:00+02:00 11:20 00:30 eBPF is a amazing technology that can run sandboxed programs in a privileged context such as the operating system kernel. But are eBPF programs limited to the operating system kernel? eBPF programs have fast access to resources like memory. These programs can access the memory of running Python applications very faster, allowing you to instrument Python processes with low overhead! In my presentation, I will show how Python's internal structure supports instrumentation through the use of eBPF. Following that, we'll experiment with eBPF and other modern techniques to instrumenting the Python applications. I'll explain explain why eBPF is more appropriate and efficient technology for instrumentation. By the end of the session, we will have developed an eBPF-based simple tracing tool for instrumenting Python applications. After this presentation, you will better understand how eBPF can help you in the instrumentation of Python applications. europython-2023-29849-instrumenting-cpython-with-ebpf Python Internals & Ecosystem (2023) Furkan Taha ÖNDER en false https://programme.europython.eu/europython-2023/talk/S3LKMH/ https://programme.europython.eu/europython-2023/talk/S3LKMH/feedback/ Terrace 2A Sponsored 2023-07-20T11:55:00+02:00 11:55 00:30 Come join this session to check out how Visual Studio Code along with GitHub, Codespaces, and Copilot can significantly improve the data science workflow and take your productivity to the next level. In this talk we will walk through several common Python data science scenarios, showcasing all the productive tooling VS Code has to offer along the way. As a sneak peek, we will be demoing a best-in-class Jupyter Notebooks experience with VS Code Notebooks, a revolutionary new data cleaning / preparation experience with Data Wrangler in VS Code, Copilot that helps you write code and fix issues faster, and more! europython-2023-33365-python-visual-studio-code-copilot-revolutionizing-the-way-you-do-data-science PyData: Software Packages & Jupyter (2023) Steve Dower en false https://programme.europython.eu/europython-2023/talk/TN3EXR/ https://programme.europython.eu/europython-2023/talk/TN3EXR/feedback/ Terrace 2A Talk 2023-07-20T12:30:00+02:00 12:30 00:30 Want to learn something new about yourself? This talk will showcase some approaches to get the best from behavioral tracking as well as silent wearables tracking. Where and how to get data with my experience regarding the quality (expectation management), what to do with the raw data (IDA + some knowledge needed), how to convert insights into actions. europython-2023-29069-quantify-self Career, Life, Health (2023) Alisa Dammer en This talk present my summed up experience in self-tracking of many years. I will show what can be detected using modern wearable devices (rings, watches, EEG helms, etc.), what should you be searching in your data (if searching for specific answer at all), what interesting findings can present themselves and what you can do about them to make your life better. My personal questions as a use-case would be: - Focus and Productivity - Nutrition (general health concerns like energy levels, resilience) - Happiness (mood, stress) - Overall health (energy levels, sleep, stress) false https://programme.europython.eu/europython-2023/talk/FRZHZG/ https://programme.europython.eu/europython-2023/talk/FRZHZG/feedback/ Terrace 2A Poster 2023-07-20T13:00:00+02:00 13:00 01:00 You _**don't**_ know comprehensions! Why are list comprehensions good? Because they are fast? Wrong! Because they are short? Wrong! This poster session will show why list comprehensions are an excellent Python tool. The poster session will: - teach you to convert loops to list comprehensions; - show how to write list comprehensions from scratch; and - give 10+ actionable tips and tricks for list comprehensions. The poster will also show the similarities between list comprehensions and: - set comprehensions; - dict comprehensions; and - generator expressions. europython-2023-35141-you-don-t-know-comprehensions Python Internals & Ecosystem (2023) Rodrigo Girão Serrão en false https://programme.europython.eu/europython-2023/talk/SWSLHC/ https://programme.europython.eu/europython-2023/talk/SWSLHC/feedback/ Terrace 2A Sponsored 2023-07-20T14:00:00+02:00 14:00 00:30 How do you implement Infrastructure-as-Code (IaC) in a non-cloud environment? europython-2023-33367-the-challenges-of-doing-infra-as-code-without-the-cloud Infrastructure: Cloud & Hardware (2023) Nicolas Demarchi en Optiver, a key player on major financial exchanges around the world, tackles this complex question head-on. As traditional trading floors have evolved into expansive data centres characterised by low-latency networks and high computing power, building and maintaining infrastructure in this environment presents challenges that can’t be solved with off-the-shelf tools. In this talk, you’ll discover more about the unique strategies and bespoke solutions that Optiver deploys to overcome these exciting challenges. false https://programme.europython.eu/europython-2023/talk/JHSMMJ/ https://programme.europython.eu/europython-2023/talk/JHSMMJ/feedback/ Terrace 2A Talk 2023-07-20T14:35:00+02:00 14:35 00:30 This talk introduces the concept of vector data cubes - multi-dimensional arrays where at least one dimension is composed of vector geometries - and its implementation in Python within a new library Xvec, built on top of Xarray, Shapely 2.0 and GeoPandas. europython-2023-29529-vector-data-cubes-as-a-bridge-between-raster-and-vector-worlds PyData: Software Packages & Jupyter (2023) Martin Fleischmann en Vector geospatial data, such as points, lines and polygons, are primarily stored in one-dimensional arrays; in Python, typically as a GeoPandas' GeoSeries column within a data frame. At the same time, raster data representing, among others, satellite imagery or digital terrain models (DTM) are multi-dimensional arrays with a number of dimensions being anywhere from 2 (e.g. DTM) to N (e.g. multi-spectral time series from Sentinel 2), in Python mostly captured as Xarray objects. The two, raster and vector, rarely meet, and if so, we either transform one to the other using rasterisation or vectorisation or link vector geometries to a raster index via a unique identifier. However, there is a space in between that would benefit from multi-dimensional arrays with support for vector geometry. This talk presents a concept of vector data cubes - multi-dimensional arrays where at least one dimension is composed of vector geometries - and its implementation in Python using Xarray, Shapely 2.0 and GeoPandas under the hood. Using the new Xvec package extending Xarray's abilities, we can assign an array of vector geometries as dimension coordinates and use the geospatial capabilities within the Xarray object. A typical use case can be a time series of a land cover proportion per region, where one dimension is composed of vector region boundaries, other as land use classes and a third one capturing time. While the same can be stored as a long-form data frame, it is not an efficient format due to a large amount of data replication. Using the vector data cube instead brings both efficiency and convenience as the included vector dimension can be directly used for indexing, plotting, and other operations that depend on the vector data and for which we would need to switch between Xarray and GeoPandas. false https://programme.europython.eu/europython-2023/talk/KT8QPL/ https://programme.europython.eu/europython-2023/talk/KT8QPL/feedback/ Terrace 2A Talk 2023-07-20T15:30:00+02:00 15:30 00:30 How to bring large legal document repositories into the public domain without releasing private data? The fundamental concepts behind document anonymization are entity recognition, masking type, and pseudoanonymization. Using python language and a collection of libraries such as spacy, pytorch, and others we can achieve good scores of anonymization. How is this applied within a flow containing AI models for NER? Once anonymized how to improve the result by doing more text mining with python based apps and human in the loop. Although it was approved in 2016, the application of the GDPR at the European level remains a challenge in banking, legal, and other contexts. This talk covers the process of transforming pdf and docx documents into xml, processing them using regexp and spacy/torch models, and how to parse these results using AntConc and Textacy. All the ideas will be supported with the real experience of the MAPA project a European project for anonymization finished in 2022. europython-2023-29313-private-data-anonymization-with-python-fundamentals PyData: Deep Learning, NLP, CV (2023) Abel Meneses AbadOscar L. Garcell en Based on the experience of more than 3 years anonymizing documents in different domains, the idea is to present the necessary steps in the anonymization process and how python tools are essential for it. It will include the presentation of a European project in the field of anonymization completed in 2022 whose data is available to the entire community and which is known as MAP (https://www.elrc-share.eu/repository/search/? q=MAP) The talk will focus its objectives on the importance of AI models to scale anonymization in environments with high volumes of documents, and how python technologies make possible a better performance of the solution and also of the team that develops it. The following frameworks will be mentioned in the presentation: Spacy, Pytorch, FastAPI, Textacy, Pytest and other base libraries. false https://programme.europython.eu/europython-2023/talk/3MDSQN/ https://programme.europython.eu/europython-2023/talk/3MDSQN/feedback/ Terrace 2A Talk 2023-07-20T16:05:00+02:00 16:05 00:45 Are you a data scientist or developer working in healthcare? Are you tired of dealing with proprietary data formats for biological and vital sign information? It's time to unlock the power of open data and make your research more impactful. In this talk, we'll explore how you can leverage Python analytics to manipulate and analyze complex datasets of patient information, including blood work, ECG, EEG, echocardiography, radiography, and more. We'll also dive into the world of open data formats, and show you how using these formats can make it easier to anonymize, convert, and collaborate on research. Don't miss this opportunity to learn how Python analytics and open data formats can help you unlock the insights hidden in your data and improve patient outcomes. europython-2023-29495-unlocking-healthcare-data-the-power-of-open-formats-in-python-data-science PyData: Data Engineering (2023) Stefano Cotta Ramusino en In this talk, we'll explore the power of open data formats for healthcare and how Python analytics, like NumPy, SciPy, Pandas and Matplotlib, can be used to analyze and unlock the insights hidden in biomedical datasets. We'll dive into the world of open data formats, including EDF for ECG and EEG, ISHNE for Holter, FASTA, FASTQ and SAM for biological sequence data, DICOM for radiology, and more. We'll also discuss the importance of adhering to open data format standards and avoiding proprietary extensions, which can limit collaboration and hinder progress in healthcare research. To help ensure compliance with these standards, we'll introduce a variety of Python libraries, like Biopython, MNE-Python, pydicom, EDFlib-Python and ISHNEHolterLib, that can be used to test output files and ensure they meet the required standard. Whether you're a data scientist, developer, or healthcare professional, this talk is for you. By leveraging the power of open data formats and Python analytics, we can improve patient outcomes and advance the field of healthcare research. Join us as we explore the exciting possibilities of open data formats and Python analytics in healthcare. false https://programme.europython.eu/europython-2023/talk/HUC9XE/ https://programme.europython.eu/europython-2023/talk/HUC9XE/feedback/ Terrace 2B Talk 2023-07-20T10:30:00+02:00 10:30 00:30 Looking for a job is already a job. How can you make sure that you are successful in the role of a Python Developer job-seeker? Join this talk to learn directly from an insider the tips & tricks about what technologies are in-demand, how to look for your next role, how to display your experience (or lack of) in your CV, how to prepare for interviews, and much more. europython-2023-29211-how-to-land-your-new-python-developer-job-a-recruiter-s-perspective Career, Life, Health (2023) Giordano Tuvo en Being a job-seeker is one of the most extenuating jobs ever. Everyone knows this, Recruiters included. This is why, after several years of experience working as a Recruiter and facing challenging times, it would be my pleasure to share my knowledge with the community. Together, we are going to tackle the steps and skills that are needed to secure a role in today's job market, with a focus on landing a job in the Python field. Come and then share your knowledge with other job seekers, we are in this all together! false GiordanoTuvo_EuroPython2023 https://programme.europython.eu/europython-2023/talk/U9SNQ7/ https://programme.europython.eu/europython-2023/talk/U9SNQ7/feedback/ Terrace 2B Talk 2023-07-20T11:20:00+02:00 11:20 00:30 Open source has widely grown to allow different tech career paths to enhance projects with their skills & provide jobs for those interested in working with open source. Open source contribution programs provide & build interested persons' capacity to become professionals. Active community participation helps enhance career growth. Outreachy is a paid and remote internship OS program that empowers, grows talents, and prepares them for career growth. Outreachy provides internships to people subject to systemic bias and impacted by underrepresentation in the technical industry where they are living. At the end of this session, beginners and persons on the intermediate level will have enough knowledge of how they can build a career in open source; experts will also get more insights on how they can contribute to the advancement of open source contribution by giving back to the community as a mentor helping new contributors understand the open source ecosystem and contribution. europython-2023-28934-career-building-through-open-source-community-participation Community & Diversity (2023) Omotola Eunice Omotayo en This session aims to empower attendees with different ways to contribute to open source and how the community behind open source can be a tool for their career development and growth. Community participation is the secret sauce to career growth. I will highlight how to use the community effectively, the skills members can gain, and how to best position oneself for professional career growth in a community. Open source contribution is one of the easiest ways to build and gain relevant skills needed to make a career. I will give insights on the what, why, and steps to achieve this. false https://programme.europython.eu/europython-2023/talk/BMYYTX/ https://programme.europython.eu/europython-2023/talk/BMYYTX/feedback/ Terrace 2B Talk 2023-07-20T11:55:00+02:00 11:55 00:30 Did you know that originally programming was a female-heavy field? How did we get to the stereotype of the antisocial programmer (and therefore male)? How the concept that good programmers appeared to have been “born, not made” is still affecting our tech industry and society. europython-2023-29565-breaking-the-stereotype-evolution-persistence-of-gender-bias-in-tech Community & Diversity (2023) Ester Beltrami en I will explore the early days of computing when **women were actually the dominant sex in programming**. Can you believe it?? **How did we get from this to the stereotype of the nerdy programmer obsessed with programming?** We will find out how this has changed and how gender bias has influenced the development of the tech industry as we know it today. I will also dig into the consequences of gender bias in the tech industry, including the negative impacts on innovation, profitability, and the overall well-being of the industry. The talk will conclude with practical steps and solutions that companies can take to create a more inclusive and diverse tech industry. The gender gap it’s an important issue that affects all of us. By taking action to address these biases, we can create a better future for everyone in the industry. false https://programme.europython.eu/europython-2023/talk/EAPRY9/ https://programme.europython.eu/europython-2023/talk/EAPRY9/feedback/ Terrace 2B Talk 2023-07-20T12:30:00+02:00 12:30 00:30 The [djangoproject.com](https://www.djangoproject.com) website is the _showcase_ of the **Django** project and is the result of **contributions** from many _people_. In this talk, we'll update you on its **development** and _learn_ how to contribute to it. europython-2023-29350-all-about-djangoproject-com Web (2023) Paolo Melchiorre en The [djangoproject.com](https://www.djangoproject.com) website is the _showcase_ of the **Django** project and _developers_ and _users_ have always looked for _updates_ on the project, _documentation_, and information from the **DSF** _(Django Software Foundation)_. As with its _source code_, the Django project website is also the result of **contributions** from many _people_ who voluntarily help to keep it updated and _improve_ it. This talk will show all the latest **updates**, ongoing **improvements**, and upcoming **developments** of the Django project website. Participants will be able to **learn** more about the Django project site, how it is maintained, and above all understand how to **help** improve it. false https://programme.europython.eu/europython-2023/talk/S8H88E/ https://programme.europython.eu/europython-2023/talk/S8H88E/feedback/ Terrace 2B Poster 2023-07-20T13:00:00+02:00 13:00 01:00 Many developers avoid using generators. For example, many well-known python libraries use lists instead of generators. The generators themselves are slower than normal list loops, but their use in code greatly increases the speed of the application. Let’s discover why. europython-2023-29260-what-are-you-yield-from Python Internals & Ecosystem (2023) Maxim Danilov en Many developers, avoid to use the generators in regular python code: It is hard to debug, it is not easy to profile, it is not obviously to refactor. it requires to use special algorithms. In this talk i speak about generator pipelines, one-line-generators, builtin-generators, custom generators with yield and yield from. I will show how to use generators and why we should use them. Also, we learn about situations where we can’t use generators and how to change our thinking to avoid such situations in the future. I give some hints and examples - how big python frameworks use lists instead of generators and therefore lose performance. At the end we can see how builtin zip function works in other world, where developers always use generators in own code. Let see what we can yield from this talk… false https://programme.europython.eu/europython-2023/talk/QRBSUK/ https://programme.europython.eu/europython-2023/talk/QRBSUK/feedback/ Terrace 2B Talk 2023-07-20T14:00:00+02:00 14:00 00:30 [Dirty Equals](https://github.com/samuelcolvin/dirty-equals) is a new python library by Samuel Colvin, the creator of Pydantic. It will transform how you write tests, especially for APIs. I made some contributions to it, which forever changed how I thought about `NotImplemented`. I thought it was a placeholder for unfinished work and unexpected use cases. I thought the language quirks it created in equality comparison were annoying. But in **DirtyEquals**, it’s a magic way to transform Python’s built in equality operator... And that changed how I think about language quirks, full stop. europython-2023-29131-a-magic-implementation-of-notimplemented Testing (2023) Alexander Darby en *Intro (5m)* I adore Pydantic. It's a fantastic library that creates classes which check types at Python runtime. In short, it turns type hints into static types. I had a crush on the code that did this. I thought it was so cool to trick Python into behaving this way. I wanted to learn how this library worked. But when I went to contribute to it, I saw it wasn't looking for contributions. So, I decided to look at his other projects in the hope I could learn something there. *What is Dirty Equals (10m)* This is how I discovered **DirtyEquals**. This library lets you write tests in a whole new way. With **DirtyEquals**., you get to (mis)use Python’s equality operator in way that speeds up testing. **DirtyEquals** lets you write assert statements that compare objects to custom types, This makes your tests more declarative and more readable. I’ll go over several examples in this section. *How Does It Work (10m)* You might be thinking, isn’t it strange that the Python equality operator can work in this way? Shouldn’t it return False, since the **DirtyEquals**. types are different to the types they’re compared to? This is where things get interesting. It turns out that if you write `x == y` in Python, three things happen: 1. First, Python looks at `x.__eq__` to see if x and y are the same. 2. If `y` is a new type, it returns `NotImplemented` because the `y`'s type isn’t part of Python’s built ins. So there isn’t an implementation for how Python checks the type for equality. 3. But - here’s the kooky bit - Python then checks `y.__eq__` ! So if we can hook into the `y.__eq__` part, we can write our own rules for the equality operator. There are so many things you can do mucking around with `.__eq__` and `.__ne__`, which is what I’ll cover in this section. *Conclusion (5m)* When it comes to coding, I think we should pursue our crushes. If there’s code that you find attractive, then see if you can contribute! As a result, I learnt things I would never have learnt any other way. In fact, the main thing I learnt was a completely different approach to coding. To me, mucking around with the `.__eq__` seemed like a terrible idea that would cause untold errors. But when I saw someone else do it so well, it seemed like a magic trick. I now no longer think of language quirks as problems. I consider them opportunities to perform magic tricks. false https://programme.europython.eu/europython-2023/talk/NYMGMF/ https://programme.europython.eu/europython-2023/talk/NYMGMF/feedback/ Terrace 2B Talk 2023-07-20T14:35:00+02:00 14:35 00:30 As our understanding of the Universe is expanding, the desire to model the physics that govern cosmic evolution is more evident than ever, driving the emergence of cosmological simulations that model the Universe from the beginning of time till present day. In combination with Machine Learning, they allow for an unprecedented capability; one can train AI models on simulations, where the evolution history of galaxies is available, that can in turn be applied on real galaxies. In this work, we propose the use of Python as a ML tool, through the popular library Tensorflow, to quantify the impact of different cosmological models on the derivation of the history of galaxies. Python accompanies us at every step of the way, from creating the datasets and training the probabilistic neural networks to the visualization of the results, as we attempt to shed light on the cosmic past of galaxies, surpassing the unshakeable reality that we can only observe them at a specific moment in time. europython-2023-30141-how-well-do-we-understand-our-universe-let-s-python-it-out PyData: Deep Learning, NLP, CV (2023) Eirini AngeloudiRegina Sarmiento en This talk is part of our research as a PhD students in the Institute of Astrophysics of the Canary Islands, studying the evolution and formation of galaxies. We would like to present how Python has helped us all the way providing an easy yet powerful ML framework (Tensorflow and tensorflow-probability) and great libraries for scientific processing and visualization (pandas, seaborn etc.). The key points of the talk will be: 1) Brief introduction to the formation and evolution of galaxies basics and cosmological simulations 2) Using simulation-based inference by training robust probabilistic convolutional neural network models across two cosmological simulations with a domain adaptation scheme 3) Building more complex neural network architectures with Python (e.g. Variational Autoencoders, Normalizing flows) false https://programme.europython.eu/europython-2023/talk/RAVZM9/ https://programme.europython.eu/europython-2023/talk/RAVZM9/feedback/ Terrace 2B Talk 2023-07-20T15:30:00+02:00 15:30 00:30 Whisper AI, a model from OpenAI, has been largely overlooked despite its impressive ability to accurately transcribe and translate human speech from audio. In this talk I will explore the architecture of the model and explain why it works so well. Additionally, I will live demo the model's capabilities in three languages, showing how you can use it on your own computer to generate English subtitles for a wide range of content. europython-2023-29383-whisper-ai-live-english-subtitles-for-96-languages PyData: Deep Learning, NLP, CV (2023) Mathias Arens en From this talk you will gain a basic understanding of OpenAI's Whisper AI, how it works, how it was trained, and how to run it and experiment with it yourself. I will demonstrate how you can use Whisper to generate real-time English subtitles for 97 spoken languages. Not only are the subtitles displayed with minimal delay, but this solution is also suitable for meetings with sensitive content as it can be run locally on your PC without relying on any third-party cloud services. I'll also be sharing what I learned about Python's threading and queueing modules, and how to use parallel processing to achieve real-time performance. false https://programme.europython.eu/europython-2023/talk/PKCL9Z/ https://programme.europython.eu/europython-2023/talk/PKCL9Z/feedback/ Terrace 2B Talk 2023-07-20T16:05:00+02:00 16:05 00:30 Right after the devastating earthquakes in Turkey, there has been a massive flow of tweets and posts from survivors and their relatives, calling for help. There was a need to extract the data, make it meaningful and open to public, so we have come up with afetharita.com. The machine learning part of the application is completely based on open-source tools in Python and I will go through the pipeline and the process. europython-2023-29081-responding-to-earthquakes-using-machine-learning-and-racing-through-time PyData: Deep Learning, NLP, CV (2023) Merve Noyan en On February 6, 2023, earthquakes measuring 7.7 and 7.6 hit South Eastern Turkey, affecting 10 cities and resulting in more than 42,000 deaths and 120,000 injured as of February 21. A few hours after the earthquake, a group of programmers started a Discord server to roll out an application called afetharita, literally meaning, disaster map. This application would serve search & rescue teams and volunteers to find survivors and bring them help. The need for such an app arose when survivors posted screenshots of texts with their addresses and what they needed (including rescue) on social media. Some survivors also tweeted what they needed so their relatives knew they were alive and that they need rescue. Needing to extract information from these tweets, we developed various applications to turn them into structured data and raced against time in developing and deploying these apps. The machine learning part of the application is completely based on open-source tools in Python and I will go through the pipeline and the process. false https://programme.europython.eu/europython-2023/talk/PQHEAS/ https://programme.europython.eu/europython-2023/talk/PQHEAS/feedback/ Open Space Open Space 2023-07-20T10:30:00+02:00 10:30 02:30 europython-2023-33483-reserved-for-eps-psf-pyo-session en false https://programme.europython.eu/europython-2023/talk/UD3GZD/ https://programme.europython.eu/europython-2023/talk/UD3GZD/feedback/ Open Space Panel 2023-07-20T15:30:00+02:00 15:30 01:00 The [EU Cyber Resilience Act (CRA)](https://digital-strategy.ec.europa.eu/en/library/cyber-resilience-act) may have a huge impact on the open-source community. There are concerns about how this framework would be applied to the open-source software contribution and distribution. If you would like to know more and voice out your concerns, join our sessions with leaders in the Python community and experts in the field. europython-2023-33482-1-cyber-resilience-act-panel en ## Agenda - 2:00 pm - 2:40 pm - CRA panel - 2:40 pm - 3:00 pm - CRA panel Q&A - 3:00 pm - 3:30 pm - Coffee break - 3:30 pm - 4:30 pm - CRA Unconference Discussion (at Open Space) --- ## CRA Panel We have invited leaders in the Python community and domain experts to discuss the current state of CRA, related regulations and the potential effect to open-source, especially in the Python community. Confirmed Panelists are: - Deb Nicholson - Executive Director at the Python Software Foundation - Jannis Leidel - Founder of the Python Packaging Authority and the PSF Board of Directors - Ciarán O'Riordan - Senior Policy Advisor of OpenForum Europe ## CRA panel Q&A After the panel, it is your turn to ask questions and voice out your concern regarding the CRA. Are you a contributor to open-source software and wonder who will be held accountable for the software that you contributed? Are you working for a company that publishes open-source software and wonder if that will affect the business model of your company? Are you using open-source software and wonder if the open-source ecosystem would be the same after the CRA has been put into action? Join us to discuss all these. ## CRA Unconference Discussion If you would like to discuss further about CRA and the related PLD (Product Liability Directive), and their potential effect in the open source community. We reserved a 1-hour session in the open space for unconference discussion. false https://programme.europython.eu/europython-2023/talk/F9UBUW/ https://programme.europython.eu/europython-2023/talk/F9UBUW/feedback/ PyCharm (Forum Hall) Announcements 2023-07-21T08:00:00+02:00 08:00 01:00 Welcome to EuroPython 2023! You can pick up your badges at any time during the week as long as we are open! If you want to avoid the morning rush on Wednesday, come on Monday and Tuesday! Queues will be sorted by your **first name** on your ticket. Your ticket can be located via your order confirmation email (from support@pretix.eu with the Subject: Your order: XXXX). If you ordered your ticket after we've sent badges for printing (after 10 July), go directly to the Info Desk (also referred as Debugging Desk) and a volunteer will help! europython-2023-35611-registration-welcome-forum-hall-foyer-1st-floor en false https://programme.europython.eu/europython-2023/talk/XACJPR/ https://programme.europython.eu/europython-2023/talk/XACJPR/feedback/ PyCharm (Forum Hall) Announcements 2023-07-21T09:00:00+02:00 09:00 00:15 europython-2023-34201-morning-announcement en false https://programme.europython.eu/europython-2023/talk/LWWPUS/ https://programme.europython.eu/europython-2023/talk/LWWPUS/feedback/ PyCharm (Forum Hall) Keynote 2023-07-21T09:15:00+02:00 09:15 00:45 Are you afraid of AI? Are you afraid of your own government? Are you just a great developer who practices decent devops and wants to know how you might wind up helping the people who answered "yes" to the previous two questions? I'll review the nature of intelligence, ethics, and EU digital regulation, then we can all talk about how coders can help make the planet work better on solving problems like sustainability and peace. europython-2023-33373-devops-vs-agi Joanna Bryson en false https://programme.europython.eu/europython-2023/talk/UNPKDU/ https://programme.europython.eu/europython-2023/talk/UNPKDU/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T10:30:00+02:00 10:30 00:45 Ever seen a code base where understanding a simple method meant jumping through tangled class hierarchies? We all have! And while "Favor composition over inheritance!" is almost as old as object-oriented programming, strictly avoiding all types of subclassing leads to verbose, un-Pythonic code. So, what to do? The discussion on composition vs. inheritance is so frustrating because far-reaching design decisions like this can only be made with the ecosystem in mind – and because there's more than one type of subclassing! Let's take a dogma-free stroll through the types of subclassing through a Pythonic lens and untangle some patterns and trade-offs together. By the end, you'll be more confident in deciding when subclassing will make your code more Pythonic and when composition will improve its clarity. europython-2023-29317-subclassing-composition-python-and-you Software Engineering & Architecture (2023) Hynek Schlawack en false https://programme.europython.eu/europython-2023/talk/DTXYKX/ https://programme.europython.eu/europython-2023/talk/DTXYKX/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T11:20:00+02:00 11:20 00:30 Magic happens every time you take your phone out of your pocket. Somehow, just by looking at the screen, your phone recognizes you (and only you) and magically unlocks. Have you ever stopped for a minute and thought to yourself - How does that even work? And maybe more importantly, how secure is it? In this session, we're going to understand how facial recognition works under the hood. We'll dive into some potential security problems, and we'll show you how we were able to break into a biometric database built on the Dlib-python-library by applying a sophisticated brute-force attack. The results will surprise you. europython-2023-28788-face-off-brute-force-attack-on-biometrical-databases Security (2023) Roy M Mezan en **Outline:** - Intro - The magic of Face ID [3 min] - Under the hood - How Deep Learning Face ID works [5 min] - Comparing faces - Exploring the Face-Space [4 min] - Recap - Tying it all together [2 min] - Exploitation - Weird behavior & Possible weakness? [6 min] - Shocking results! - [2 min] - The Attack - Our attack on a Biometrical database [6 min] - Summary [1 min] false https://programme.europython.eu/europython-2023/talk/TKPZSM/ https://programme.europython.eu/europython-2023/talk/TKPZSM/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T11:55:00+02:00 11:55 00:30 Many modules you use and love have a portion of their implementation written in other languages, and for that a Python extension need to be made. Python offers a C-API that allow people extending the language, and being a nice glue-language, C is also a bridge to many other languages as well. So if everything is simple, what's the deal with stability? Changes in the C-API might break the functionality in older versions, so PEP 387 saves the day with a policy for backward compatibility. Starting from Python 3.2, the Limited API was introduced, which defined a subset of Python's C-API that it's promised that if used, the code can be compiled in one version, and run in many others as well. Also, having a Stable ABI compatible wheel, allow you to only have one-wheel-per-OS, and not one-wheel-per-python-version, which can simplify your release process. This talk will introduce the Limited API concept, and provide the necessary information to include it in your project. europython-2023-29539-the-python-s-stability-promise Python Internals & Ecosystem (2023) Cristián Maureira-Fredes en false https://programme.europython.eu/europython-2023/talk/EWBEZZ/ https://programme.europython.eu/europython-2023/talk/EWBEZZ/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T12:30:00+02:00 12:30 00:30 Python 2 to Python 3 migration used the D-day approach which failed. We learnt from our mistake and we are introducing incompatible changes differently now. Document changes, provide a way to write code compatible with the old and the new way, tooling to ease the migration, design long term approach to reduce the need for incompatible changes. europython-2023-30109-introducing-incompatible-changes-in-python Python Internals & Ecosystem (2023) Victor Stinner en In the Python 2 era, it was decided to migrate at a D-Day: convert all your code base to Python 3. It didn't go as well as expected. We learnt lessons from this mistake. Incompatible changes are now introduced differently in Python. Today, changes start with a deprecation warning for at least two Python releases before removing old functions. We think about how to write a single code base working on the old and new Python versions. More and more often, instructions to migrate existing code are provided, or even automated tools. Changes breaking too many projects are reverted when there is not enough time to update enough projects. Code search helps detecting affected projects, notify them, and maybe also propose changes to prepare their code. In the future, Python is working on a stable ABI to be able to build C extensions once and use them on many Python versions. The HPy project is an interesting candidate for this goal. More and more projects are being tested on the Python version currently under development (Python 3.12). false https://programme.europython.eu/europython-2023/talk/YZSTKK/ https://programme.europython.eu/europython-2023/talk/YZSTKK/feedback/ PyCharm (Forum Hall) Panel 2023-07-21T14:00:00+02:00 14:00 01:00 Did you know that Python conferences are primarily organized by the community? Go backstage and join us at the Python Join us for an engaging and insightful discussion as we bring together a group of passionate Python conference organizers from the community. Discover the vibrant ecosystem behind Python conferences and gain valuable insights into their experiences, motivations, and learnings. Whether you are an aspiring organizer, a Python enthusiast, or simply curious about the inner workings of community-driven events, this panel promises to provide a wealth of knowledge and inspiration. Don't miss the opportunity to hear firsthand from the dedicated individuals who make Python conferences an incredible experience for all! europython-2023-33375-python-organizers-panel-exploring-community-driven-python-conferences Alexander CS HendorfAlessia MarcoliniJimena BermúdezBára DrbohlavováHonza JavorekTim (文昌) HsuDavid Vaz en Did you know that Python conferences are primarily organized by the community? Go backstage and join us at the Python Organizers' Panel. Join us for an engaging and insightful discussion as we bring together a group of passionate Python conference organizers from the community. Discover the vibrant ecosystem behind Python conferences and gain valuable insights into their experiences, motivations, and learnings. In this panel, we aim to shed light on the efforts and dedication of the individuals who selflessly devote their time and energy to create enriching events for the Python community. You will get a glance behind the scenes and get a better grasp on why community-run conferences are so authentic, inclusive and diverse.. Our panelists, seasoned organizers of Python conferences, will share their unique perspectives, recounting their journeys and the challenges and fun anecdotes planning and executing successful events. During the discussion, we will explore a wide range of topics, including: 1. Behind the Scenes: Gain a behind-the-scenes understanding of what it takes to organize a Python conference. 2. Community Engagement: Discover how Python conferences foster a sense of community and bring together Python enthusiasts from diverse backgrounds. Explore the ways in which organizers encourage participation, inclusivity, and collaboration. 3. Motivations and Inspirations: Hear the personal stories of our panelists as they share what drives their passion for organizing Python conferences. Learn about their motivations, inspirations, and the impact they hope to make in the Python community. 4. Challenges, Lessons Learned and Personal Growth: Delve into the challenges faced by organizers and the lessons they have learned along the way. Gain valuable insights into how they tackle obstacles, adapt to changing circumstances, and continually improve the conference experience. Furthermore, hear about takeaways organizers have for their professional and personal life. Whether you are an aspiring organizer, a Python enthusiast, or simply curious about the inner workings of community-driven events, this panel promises to provide a wealth of knowledge and inspiration. Don't miss the opportunity to hear firsthand from the dedicated individuals who make Python conferences an incredible experience for all! false https://programme.europython.eu/europython-2023/talk/STLLDQ/ https://programme.europython.eu/europython-2023/talk/STLLDQ/feedback/ PyCharm (Forum Hall) Sponsored 2023-07-21T15:30:00+02:00 15:30 00:30 Django and Python make fullstack and API web projects a breeze. But as Python has matured, significant tooling has risen to improve the development experience (DX). Can you use this tooling, in a modern editor and IDE, to stay in the flow and make your development…joyful? In this session we’ll put PyCharm to work, at helping us work. Navigation, refactoring, autocomplete – the usual suspects. We’ll also see “test-first” development to stay in the IDE, plus how this can apply to frontends. europython-2023-33366-power-django-with-pycharm Paul Everitt en false https://programme.europython.eu/europython-2023/talk/GKHPZB/ https://programme.europython.eu/europython-2023/talk/GKHPZB/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T16:05:00+02:00 16:05 00:30 Cython started as a language designed to write extension modules, and has long become the most widely used static compiler for Python, bringing C and C++ data types into the language. Use it to talk to existing C/C++ code or to bring your Python code up to C speed. europython-2023-35744-cython-3-python-at-the-speed-of-c Python Internals & Ecosystem (2023) Stefan Behnel en Cython has come a long way from its beginnings as Pyrex in 2002 up to the latest stable major release: Cython 3.0. It started as a language designed to write extension modules, and it became the most widely used static compiler for Python, bringing C and C++ data types into the language. This talk will present new features built into the language, from static C types in the modern Python typing syntax to automatic ufunc generation, that make writing lightning fast Python code easy and pythonic. false https://programme.europython.eu/europython-2023/talk/AYGCLM/ https://programme.europython.eu/europython-2023/talk/AYGCLM/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T16:45:00+02:00 16:45 00:45 Enjoy Friday's lightning talks, hosted by Mia Bajić ⬇️ - **Fusion Engine, Custom Game Engine Using Python** — Dima Marhitych - **What is the PSF? ... and Can We Be Friends?** — Deb Nicholson - **Testing Files Like a Pro** — Artur Barseghyan - **Kata - Discipline & Motivation** — Sena Sahin - **Foxdot** — This Green Guy (definitely not Moisés Guimarães) - **WIKI CRAWL - Yet Another Crawler** — Julian Maurin - **Python in Your Language** — Cristián Maureira-Fredes - **Artis** — Gabriel Jover - **Fedora Loves Python** — Miro Hrončok - __F**k it - How to Fix Production Code in 5 Minutes__ — Sebastien Crocquevieille - **Django Girls** — Çağıl Uluşahin Sönmez - **AI Game Tournament Awards** — Neil Vaytet europython-2023-34205-lightning-talks-friday en false https://programme.europython.eu/europython-2023/talk/P7CVWV/ https://programme.europython.eu/europython-2023/talk/P7CVWV/feedback/ PyCharm (Forum Hall) Talk 2023-07-21T17:30:00+02:00 17:30 00:20 europython-2023-34206-sprint-orientation en false https://programme.europython.eu/europython-2023/talk/SURAC3/ https://programme.europython.eu/europython-2023/talk/SURAC3/feedback/ PyCharm (Forum Hall) Announcements 2023-07-21T17:50:00+02:00 17:50 00:30 europython-2023-34207-closing-session en false https://programme.europython.eu/europython-2023/talk/ZUPSUD/ https://programme.europython.eu/europython-2023/talk/ZUPSUD/feedback/ South Hall 2A Talk 2023-07-21T10:30:00+02:00 10:30 00:30 For millennia, humans have known things. Pretty quickly, we started writing them down; our brains aren't very good at storing all the things we know reliably, and we needed something more durable. A long time ago, this meant clay tablets with cuneiform on them, and things have only got more complicated from there. Nowadays, we try to store data so that computers can understand it too, and that's given us a bewildering array of options - portable hard drives, magnetic tape storage and so much more. In this talk, we'll take a look at the history of data storage, and discuss why some methods have worked better than others. We'll talk about why writing things down for humans is different than doing it for computers, and why it's difficult to do both at the same time (this is what code is). Finally, we'll look at today's state-of-the-art for keeping data safe, and discuss what the future might hold. This talk has no prerequisites, although a fondness for weird facts will help! europython-2023-29742-a-brief-history-of-data-storage ~ None of these topics (2023) Eli Holderness en false https://programme.europython.eu/europython-2023/talk/UAEJZX/ https://programme.europython.eu/europython-2023/talk/UAEJZX/feedback/ South Hall 2A Talk 2023-07-21T11:20:00+02:00 11:20 00:30 The Django Admin Panel is a complex and bad-documented tool in the Django that can greatly speed up development if you start to understand it. “Isn’t it easier for us to write our Backend?” I will answer: “No, it’s not easier!”. 8 years of insights and discoveries in my Talk. Here i want talk about multiple admin sites, ModelAdmins possibilities, object state versioning and app configs as completely forgotten hidden power. europython-2023-29259-ultimative-session-about-hidden-gems-of-django-admin Python Libraries (2023) Maxim Danilov en The following questions should be in this Talk: 1. Review of ideas Django.contrib.admin module. 2. Django admin panel as it could be. 3. Django admin sites multiplication. 4. How to remove the legacy of older versions of Django im admin panel 5. Undocumented Django.contrib.admin features. 6. Using Django Admin Panel for third-party Backend implementations. I have presented many talks about Django Contrib Admin on PyCon RU, PyCon DE, Django Con EU, Django Con US. Here should be ultimative session about important parts and Vulnerabilities of this Library. This talk for advanced and experienced developers. false https://programme.europython.eu/europython-2023/talk/GY9LZC/ https://programme.europython.eu/europython-2023/talk/GY9LZC/feedback/ South Hall 2A Talk 2023-07-21T11:55:00+02:00 11:55 00:30 How can you scale Python to run at petabyte scale, with the reliability needed to trade billions of dollars? With ArcticDB we have been doing exactly that for the last four years, by leveraging interoperability between Python and high-performance C++, with a detailed understanding of the data structures inside Python and a few extra tricks up our sleeves. Come take a peek under Python's bonnet and learn how to hotwire a few things along the way. europython-2023-29392-python-interoperability-building-a-python-first-petabyte-scale-database Software Engineering & Architecture (2023) William Dealtry en This talk aims to introduce experienced Pythonistas to the workings of Python's C API and provide you with the means to get started with building Python modules, particularly in modern C++. It's now much easier than you think to write your first Python extension, and despite its reputation for gnarly syntax and lack of memory safety, features that have been gradually added to the C++ language over the last decade such as tuple return types with structured bindings and automatic type deduction, mean that your C++ can be more Pythonic than you might think. Since one of the most common reasons for writing an extension module is to leverage optimized machine code and multi-threading to handle really big data, we'll look at how we avoid shooting ourselves in the performance foot at the boundary between native code and Python. In this talk we will lay out the potential pitfalls of interacting with the Python C API, share some of the hard-won experience we gained in engineering ArcticDB and running it at petabyte scale for critical Python trading applications. We'll also let you in on some tricks for implementing zero-copy data interchange, managing memory ownership and lifetimes, getting the most out of multi-threading through sensitive handling of the Global Interpreter Lock, and interacting with Pandas. Of course, nothing stays the same forever. The Python data landscape is changing rapidly and with the advent of Pandas 2.0, the old workhorse NumPy is gradually being supplanted by Apache Arrow, a project that has interoperability at the core of its design. Some things will get easier, some problems will remain. We'll examine the landscape ahead and share vital information to help you future-proof your development both inside and alongside Python. false https://programme.europython.eu/europython-2023/talk/WB8ZWV/ https://programme.europython.eu/europython-2023/talk/WB8ZWV/feedback/ South Hall 2A Talk 2023-07-21T12:30:00+02:00 12:30 00:30 This talk is meant to be an hitchhickers guide to **Dungeons and Dragons** (`D&D`) _for programmers_. We will leverage on our wit and intelligence to explore a very perilious dungeon 🧙 , where a venomous dragon is hiding in the shadows 🐉 . Thanks to a magical potion in an ancient flask, our wizardly skills have been enhanced with Pythonic capabilities 🐍 making us the most powerful and geeky magician of the realm. These new acquired power revealed _unprecedented strategies_ (i.e. algorithms 🙃) that will guide us through the maze avoiding all the traps and pitfalls ⚔️, and will help us maximising the power of our _fire magic_ ☄️ to finally slay the dragon. If you would like to know more about this new Pythonic spell, and the secrets it unveiled, or if you're simply interested in **new graph algorithms** that can run balzingly _fast_ maximising your CPU capabilities, **this is the talk for you!** europython-2023-29660-hitchhickers-guide-to-d-d PyData: Software Packages & Jupyter (2023) Valerio Maggio en I am playing D&D since I was 13, and that is indeed a fantastic game for so many reasons. Even more fantastic if you could combine your geeky programming skills to it, whenever you have to explore hidden dungeons. In facts, **graphs** are the most versatile, and fascinating data abstraction that could help us handling these challenges in a very programmatic way. In Python we would have many solutions to work with Graph problems: from `scipy.sparse` to `networkx`. However, none of these solutions are generally known to be fast and efficient, and this can represent a huge impediment when the size of the graph in question (in terms of nodes, and edges) increases. But _What if_ **graph** algorithms could be expressed as **linear algebraic** operations ? And _what if_ this _translation_ would make graph algorithms super efficient so that this would represent a viable and scalable alternative for high-performance graph analytics ? And _what if_ we could leverage on these new and blanzingly fast algiorithms, while still using the **same** libraries (and abstractions) we would normally use with `networkx`? In this talk, we will introduce [`python-graphblas`](https://github.com/python-graphblas/python-graphblas), i.e. the official Python API to [GraphBLAS](https://graphblas.org/): a powerful framework for creating graph algorithms expressed as linear algebra sparse matrix operations. We will explore two practical examples (working on our D&D use case) showcasing performance, and how `python-graphblas` with [`graphblas-algorithms`](https://github.com/python-graphblas/graphblas-algorithms) integrate with `networkX`. false https://programme.europython.eu/europython-2023/talk/3XQWYC/ https://programme.europython.eu/europython-2023/talk/3XQWYC/feedback/ South Hall 2A Talk 2023-07-21T14:00:00+02:00 14:00 00:30 The NVDA screen reader is a Python application packaged with Py2exe, along with C++ extensions for low-level system access and improved performance. Its functionality can be expanded through addons that are also written in Python, which makes the ability to debug both the core and addon code highly desirable. However, debugging code within an embedded or packaged Python environment can be quite challenging, especially if you are a visually impaired programmer trying to debug your own screen reader, since hitting a breakpoint will freeze the tool you rely on for computer access! In this presentation, I will demonstrate how I addressed this challenge by leveraging Microsoft's debugpy library for remote debugging. I will showcase how this technique can be used to debug Python applications running within an embedded Python environment, regardless of the host language. Additionally, I will explore its applicability in debugging applications running on different operating systems or environments than the one where you prefer to use your debugging IDE. europython-2023-30146-what-a-screen-reader-can-teach-you-about-remote-python-debugging ~ None of these topics (2023) Ramón Corominas en false https://programme.europython.eu/europython-2023/talk/NYEBMZ/ https://programme.europython.eu/europython-2023/talk/NYEBMZ/feedback/ South Hall 2A Talk 2023-07-21T15:30:00+02:00 15:30 00:30 Bring your GraphQL APIs to life with real-time data using Strawberry! 🌟 In this talk, we'll dive into GraphQL Subscriptions and explore how to leverage WebSockets for interactive, real-time updates. Say goodbye to constant polling and hello to efficient, seamless communication! Key insights: - Understanding GraphQL Subscriptions and their role in real-time data delivery. - Setting up WebSocket connections and integrating them with your GraphQL server using Strawberry. - Designing subscription schemas and handling server-side events for seamless updates. - Enhancing client-side experiences with real-time data and updates. europython-2023-30070-graphql-subscriptions-real-time-data-with-websockets-and-strawberry Web (2023) Patrick Arminio en GraphQL Subscriptions offer a powerful solution to deliver real-time data efficiently, without the need for constant polling. In this talk, we'll explore the power of GraphQL Subscriptions using WebSockets and Strawberry, empowering you to build dynamic, real-time applications with ease. During this session, we'll cover: 1. An introduction to GraphQL Subscriptions: We'll discuss the concept of GraphQL Subscriptions, their role in real-time data delivery, and how they differ from traditional polling techniques. You'll gain a deep understanding of their importance in creating modern, responsive applications. 2. Setting up WebSockets with GraphQL and Strawberry: We'll guide you through the process of integrating WebSocket connections with your GraphQL server using the Strawberry library. Learn how to establish and manage secure, real-time communication channels between your server and clients. 3. Designing and implementing subscription schemas: We'll walk you through the process of designing and implementing subscription schemas using Strawberry, allowing you to define the structure and behavior of real-time updates. Learn how to handle server-side events and ensure seamless updates for clients. 4. Enhancing client-side experiences: Discover how to leverage real-time data and updates in your client-side applications to create engaging and interactive experiences for users. We'll share best practices for handling GraphQL Subscriptions on the client-side, enabling you to build dynamic, real-time applications that delight your users. By the end of this talk, you'll be well-equipped to harness the power of GraphQL Subscriptions using WebSockets and Strawberry, enabling you to create responsive, real-time applications! false https://programme.europython.eu/europython-2023/talk/DA3GWB/ https://programme.europython.eu/europython-2023/talk/DA3GWB/feedback/ South Hall 2A Talk 2023-07-21T16:05:00+02:00 16:05 00:30 Systems built with microservices tend to become complex over time. There are several approaches that encapsulate complex distributed system layouts with an API Gateway, or backends for frontends. Having a GraphQL gateway is one of the available options. This method of delivering client-facing APIs has become the standard with modern single-page applications. europython-2023-28778-graphql-as-an-umbrella-for-microservices Software Engineering & Architecture (2023) Artur Smęt en During this talk you will: * Discover the basics of GraphQL as the communication layer and it's core differences from REST approach * See the real life example of how my team used [Ariadne](https://ariadnegraphql.org/) - an open-source python GraphQL server, to abstract the complexity of a large-scale, microservice-oriented system * Learn about some common mistakes, caveats, and outtakes from taking such an approach * Discover how deploying GraphQL as an API gateway speeds up the development process, makes the engineering team more productive and allows both, front-end and back-end engineers to shape the APIs together false https://programme.europython.eu/europython-2023/talk/URF3Z9/ https://programme.europython.eu/europython-2023/talk/URF3Z9/feedback/ South Hall 2B Talk 2023-07-21T10:30:00+02:00 10:30 00:30 I will introduce the concept of data unit tests and why they are important in the workflow of data scientists when building data products. In this talk, you will learn a new tool you can use to ensure the quality of the products you build. europython-2023-29571-test-your-data-like-you-test-your-code PyData: Data Engineering (2023) Theodore Meynard en When data scientists build data products, they usually need to combine multiple data sources to train their models and then serve predictions. Making sure that the code and the data will be as expected throughout the full lifetime of the project is complex. To ensure the quality of the code, it is a best practice in software engineering to use automatic testing, this has a large corpus of support material. However, ensuring the quality of the data input and output holistically is not yet as well covered. In this talk, I will explain the concept of data unit tests and why they are important. Then I will present an overview of the current libraries helping to build data unit tests. Finally, I will explain how we integrated it into our workflow at GetYourGuide. false https://programme.europython.eu/europython-2023/talk/MD3PX3/ https://programme.europython.eu/europython-2023/talk/MD3PX3/feedback/ South Hall 2B Talk 2023-07-21T11:20:00+02:00 11:20 00:30 Do you need to transform, optimize and scale your data workflow? In this talk, we’ll review use cases, and you’ll learn how to dynamically generate thousands of DAGs (Directed Acyclic Graphs) with Airflow. europython-2023-29381-too-big-for-dag-factories PyData: Data Engineering (2023) Calvin Hendryx-Parker en You’re working on a project that needs to aggregate petabytes of data, and it doesn’t make sense to manually hard-code thousands of tables, DAGs (Directed Acyclic Graphs) and pipelines. How can you transform, optimize and scale your data workflow? Developers around the world (especially those who love Python) are using Apache Airflow — a platform created by the community to programmatically author, schedule and monitor workflows without limiting the scope of your pipelines. In this talk, we’ll review use cases, and you’ll learn best practices for how to: - use Airflow to transfer data, manage your infrastructure and more; - implement Airflow in practical use cases, including as a: - workflow controller for ETL pipelines loading big data; - scheduler for a manufacturing process; and/or - batch process coordinator for any type of enterprise; - scale and dynamically generate thousands of DAGs that come from JSON configuration files; - automate the release of both the DAGs and infrastructure updates via a CI/CD pipeline; - run all tasks simultaneously using Airflow. Both beginner and intermediate developers will benefit from this talk, and it is ideal for developers wanting to learn how to use Airflow for managing big data. Beginners will learn about dynamic DAG factories, and intermediate developers will learn how to scale DAG factories to thousands of DAGS — which is something Airflow can’t do out of the box. After this talk and live demo, people will learn best practices (including access to a code repo) that will allow them to scale to thousands of DAGs and spend more time having fun with big data. false https://programme.europython.eu/europython-2023/talk/DQ9RA9/ https://programme.europython.eu/europython-2023/talk/DQ9RA9/feedback/ South Hall 2B Talk 2023-07-21T11:55:00+02:00 11:55 00:30 [**Apache Airflow**](https://github.com/apache/airflow) is an Open Source workflow orchestrator. It is a python library that allows you to automate complex code and integrate it with a plethora of Data Sources. It is provided with an integrated UI and API for both your human and programmatic needs. After 5 years of running Airflow in production, I hope to share some insights on the technology. The strengths and weaknesses, recommended features and more dangerous ones, and similar considerations on the UI. I'll also be talking about how **you** can make your own *Operators* in Airflow. Come take a deeper dive into the same solution used by Airbnb, Slack, Walmart and many more to efficiently run their data pipelines. europython-2023-28976-orchestrating-python-workflows-in-apache-airflow Python Libraries (2023) Sebastien Crocquevieille en false https://programme.europython.eu/europython-2023/talk/TZLHXN/ https://programme.europython.eu/europython-2023/talk/TZLHXN/feedback/ South Hall 2B Talk 2023-07-21T12:30:00+02:00 12:30 00:30 Inspired by Xarray, Scipp ([scipp.github.io](https://scipp.github.io)) enriches raw NumPy-like multi-dimensional data arrays by adding named dimensions and associated coordinates. For an even more intuitive and less error-prone user experience, Scipp adds physical units to arrays and their coordinates. Scipp data arrays additionally support a dictionary of masks, as well as histogram bin-edge coordinates. One of Scipp's key features is the possibility of using multi-dimensional non-destructive binning to sort record-based "tabular"/"event" data into arrays of bins. This provides fast and flexible binning, rebinning, and filtering operations, all while preserving the original individual records. Scipp ships with data display and visualization features for Jupyter notebooks, including a powerful plotting interface. Named Plopp, this tool uses a graph of connected nodes to provide interactivity between multiple plots and widgets, requiring only a few lines of code from the user. europython-2023-29205-scipp-multi-dimensional-arrays-with-labeled-dimensions-and-physical-units PyData: Software Packages & Jupyter (2023) Neil Vaytet en This presentation will be in the form of a live demo of the Scipp package in Jupyter. Scipp is an open-source project developed by the [European Spallation Source](https://europeanspallationsource.se/) under the BSD-3 licence. It is a Python library built around a C++ core, which uses TBB for multi-threading, providing good out-of-the-box performance. It is installable on Linux, Mac and Windows via `pip` and `conda`, and the documentation is hosted at https://scipp.github.io . The source code can be found at https://github.com/scipp . Co-authors (but not co-speakers): Simon Heybrock, Jan-Lukas Wynen, Sunyoung Yoo. false Jupyter notebook used for the presentation https://programme.europython.eu/europython-2023/talk/KFMCSK/ https://programme.europython.eu/europython-2023/talk/KFMCSK/feedback/ South Hall 2B Talk 2023-07-21T14:00:00+02:00 14:00 00:30 What is the European digital identity? How can you access digital public services from another EU country? Why is it so hard to create an European ecosystem of digital services? Does the EU support open source? This (opinionated) talk will present the current State of the digital services in the EU. Will summarize the normative and technical challenges, and their impacts on the resulting platforms in terms of UX, cybersecurity and maintainability. europython-2023-29995-the-digital-state-of-the-european-union Ethics, Philosophy & Politics (2023) Roberto Polli en European Union members started many years ago to plan common infrastructures in order to provide shared digital services to EU citizens. Some of them are consolidated, like the visa and the VAT information system, others are going to be revised - like the eID. Many new services are under development. The cornerstone of these services is the "Once Only Principle": citizens provide diverse data only once in contact with public administrations, while public administration bodies take actions to internally share and reuse these data – even across borders. After a brief presentation of some existing EU services (e.g. participate to an EC consultation authenticating with your eID, [VAT information system API](https://ec.europa.eu/taxation_customs/vies/#/vat-validation), the [EU data portal](https://data.europa.eu/en) , ..) the talk will cover: - the four categories of challenges: legal -> organizational -> semantic -> technical, and the importance of addressing them **in order**; - how shifting-right challenges from the legal and organizationa level down to the technical one affects the UX and the cybersecurity of the resulting platforms; - challenges in procurement. Finally, a focus on the technical level: - the role that the EU can play to support open source and open standards. false https://programme.europython.eu/europython-2023/talk/WNSZ9R/ https://programme.europython.eu/europython-2023/talk/WNSZ9R/feedback/ South Hall 2B Talk 2023-07-21T14:35:00+02:00 14:35 00:30 With the risk of losing access to information, Python has been used to create means for society to continue having the right to know what government officials are doing in Brazil. This lecture aims to show how the difficulty of accessing Brazilian government information has been combated by creating tools that use Python and how the language has been a useful tool for those who seek to leave society in the light of information. europython-2023-29613-how-python-can-help-monitor-governments Ethics, Philosophy & Politics (2023) Judite CyprestePatricia Bongiovanni Catandi en With the imminent risk of the collapse of democracies and the constant attacks on journalism, access to information becomes increasingly difficult. As a result, civil society and journalists have been looking for ways to ensure that society is not left in the dark and that government monitoring continues. With the popularization of Python in several professional areas, the language has become increasingly present in the fight for a more open government in Brazil, whether in the construction of monitoring tools or in the analysis of data from a government agency. Initiatives by government entities are also helping to enable transparency. In this talk we will see examples of the use of Python to monitor the Brazilian government and how the language was fundamental for Brazilian society not to be left in the dark by misinformation. The idea is to show examples of civic uses that the programming language is gaining in the fight for transparency in Brazil. false https://programme.europython.eu/europython-2023/talk/BHWTKF/ https://programme.europython.eu/europython-2023/talk/BHWTKF/feedback/ South Hall 2B Talk 2023-07-21T15:30:00+02:00 15:30 00:30 Computer pRogramming, Technology, Bit-coinism Success, Climate Change and Billionaires are all associated with one another. This talk will describe how a cohort of 299+ young people (aged 11-14) were introduced to Python Programming, at the same time, for the very first time. And in this talk, I would like to share with a great secret in that I have actually learnt more from the young students than they learnt from me. This talk is about how these young people have opened my eyes, mind and heart about alternative ways of looking at and appreciating:- The humble IF statement; the under-rated FOR loop, the dry Return Statement, the functional Maths & Random modules, etc. as if one were an artist. We will talk about the renewed delight of looking at these things from fresh pairs of eyes and how we can take these new learnings forward. europython-2023-29555-what-my-300-fantastic-young-students-taught-me-about-python Education, Teaching & Training (2023) Lilian en Computer pRogramming, Technology, Bit-coinism Success, Climate Change and Billionaires are all associated with one another. This talk will describe how a cohort of 299+ young people (aged 11-14) were introduced to Python Programming, at the same time, for the very first time. And in this talk, I would like to share with a great secret in that I have actually learnt more from the young students than they learnt from me. This talk is about how these young people have opened my eyes, mind and heart about alternative ways of looking at and appreciating:- The humble IF statement; the under-rated FOR loop, the dry Return Statement, the functional Maths & Random modules, etc. as if one were an artist. We will talk about the renewed delight of looking at these things from fresh pairs of eyes and how we can take these new learnings forward. false Slides of the Talk Slides of the Talk https://programme.europython.eu/europython-2023/talk/3TUMQT/ https://programme.europython.eu/europython-2023/talk/3TUMQT/feedback/ South Hall 2B Talk 2023-07-21T16:05:00+02:00 16:05 00:30 We will explore the latest research on how children gain programming knowledge, how to keep them interested and excited, and how this might inform the way we support adult newcomers to programming. Practical advice and suggestions for activities will be given to attendees. europython-2023-30063-teaching-children-python-what-works Education, Teaching & Training (2023) Mykalin Jones en Have you ever tried to teach your kids programming? Do you have friends trying to learn as an adult? Have you ever wondered if you would have been better off learning to code earlier in life? The push for more people to learn to code has caused an explosion in the educational industry. Boot camps and certification programs of dramatically varying quality have emerged in nearly every corner of the world. These programs are often accompanied by lofty claims and promises. Children have been no exception to this, as more and more companies attempt to capitalize on the claim that children should start learning early because it's "like learning a language". However, research suggests that this might not be the most solid argument. We will be exploring: -What benefits are there in teaching them early? -How do children acquire programming knowledge? -How does our language around the concepts affect their understanding? -How do we keep their interest? -Can the answer to these questions inform how we teach adults coming in from non-STEM fields? This talk will focus on these questions by presenting the current data we have, in conjunction with anecdotal evidence from sessions with children and adults who code in python. false https://programme.europython.eu/europython-2023/talk/HN3EDM/ https://programme.europython.eu/europython-2023/talk/HN3EDM/feedback/ North Hall Talk 2023-07-21T10:30:00+02:00 10:30 00:45 There are two hard problems in programming: naming things and cache invalidation. I'll cover the latter, in a microservice-based system. Given a fairly standard setup with API Gateway and a backend service with its own database, I'll show how to implement cache that allows us to avoid database queries without modifying API client. The whole talk is based on live coding. europython-2023-29790-caching-in-microservices Web (2023) Michał Lowas-Rzechonek en In the talk I will go through the implementation of both sides of an ETag cache. First part will be a ASGI middleware (using FastAPI as an example) that captures resources returned by REST endpoints and creates ETags for them. The middleware will also allow views to affect cache key construction, so that the mechanism can be made aware of e.g. custom headers. This middleware will be installed in the "backend" service. On the "backend" side, I will also show how to invalidate the cache when data used to create a given resource is modified. The second part is an extension of aiohttp's ClientSession that stores ETagged response bodies. This will be installed inside the API Gateway, allowing external clients to utilize the cache without even knowing about it. Finally, I'll mention how to make it usable in a distributed system, by implementing a simple content-based pubsub mechanism. false https://programme.europython.eu/europython-2023/talk/E9QUAW/ https://programme.europython.eu/europython-2023/talk/E9QUAW/feedback/ North Hall Talk 2023-07-21T11:20:00+02:00 11:20 00:30 HTTPX is a fully featured HTTP client for Python 3, which provides sync and async APIs, and support for both HTTP/1.1 and HTTP/2. It also includes a built-in command-line client. We'll be taking a look at the architecture of the client, learning from the design decisions behind it, and gaining a better understanding of HTTP along the way. europython-2023-29691-designing-an-http-client Web (2023) Tom Christie en Some of the aspects we'll be taking a look at include: * Layered designs. How to design for separation of responsibilities. Why it matters, and the benefits it provides. * What are you saying? From the bytes on the wire, though SSL, content encoding, compression, media and text encodings. * Connection pooling in HTTP. * Building packages that support both sync and async concurrency models. * HTTP/1.1, HTTP/2, and HTTP/3. * Supporting more complex requirements. Handling WebSockets and other protocol upgrades. * Keeping it clean. Managing resource lifespans. false https://programme.europython.eu/europython-2023/talk/MRLACS/ https://programme.europython.eu/europython-2023/talk/MRLACS/feedback/ North Hall Talk 2023-07-21T11:55:00+02:00 11:55 00:30 Is your FastAPI really fast? Did you benchmark it, or you just have faith? On this talk, Marcelo will give tips to improve the performance of your FastAPI application, and you’ll see how impactful those changes can be. europython-2023-29618-performance-tips-by-the-fastapi-expert Web (2023) Marcelo Trylesinski en We’ll go through FastAPI common mistakes regarding performance, and how to make improvements. We’ll make a small study about how those improvements can impact on your applications, and you’ll find out that even small details can make a tremendous impact. As part of the study, we'll talk about points like encoding and decoding your data, the event loop, specific details about validation, and so on. false https://programme.europython.eu/europython-2023/talk/VCGQWF/ https://programme.europython.eu/europython-2023/talk/VCGQWF/feedback/ North Hall Talk 2023-07-21T12:30:00+02:00 12:30 00:30 In this talk proposal, we will discuss how to detect the chain of fraudulent transactions and help the investigation agencies by providing useful insights to fight money laundering with the help of Python programming language and packages. europython-2023-30102-fighting-money-laundering-with-python-and-open-source-software TBD - Multiple Tracks (2023) Gajendra Deshpande en In this talk proposal, we will discuss the chain of fraudulent transactions and help the investigation agencies to fight money laundering with the help of Python programming language and packages. The working of the proposed solution is described below Step 1: The investigation officer obtains data of suspicious accounts across banks. Step 2: Using Benford’s Law the accounts data will be checked for possible fraud and marked for further analytics. Step 3: The account details will also be matched with Politically Exposed Persons(PEP), Relatives and Close Associates (RCA), and Sanctions Data. If a match is found then it increases the probability of possible money laundering. Step 4: Generate graphs showing the links between transactions of different bank accounts for step 2 and step 3. Step 5: Apply Graph Machine Learning techniques and graph algorithms to identify the fraudulent chains between depositor and receiver accounts. Step 6: Find a correlation between transactions and bank accounts to form a fraudulent chain. Step 7: Generate results in the form of reports and interactive visualizations Step 8: Verify the result for genuineness and false positive rate. Step 9: Keep track of all the activities and tasks executed from steps 2 through 8. Step 10: Generate a report for step 9 in a human-readable and understandable form. The application has been developed using Scipy, numpy, pandas, matplotlib, NetworkX, Altair, scikit-learn, and Dash packages. The participants will learn about a new use case of python in crime investigation. false https://programme.europython.eu/europython-2023/talk/ATGCBX/ https://programme.europython.eu/europython-2023/talk/ATGCBX/feedback/ North Hall Talk 2023-07-21T14:00:00+02:00 14:00 00:30 A crucial element of architecting a software application for scale is the collaboration of domain experts and developers. For that to happen, the application must separate the domain layer— where elements that represent the real world reside—from the infrastructure layer—where these elements are translated into precise software processes. Within the Fintech team at Kiwi.com, we are rearchitecting a critical service to accept more payment providers. As part of this refactor, we are adopting the Unit of Work pattern to disentangle domain entities from the database processes that represent them. This way, domain experts can share their knowledge with developers more easily, and developers can find opportunities for optimization without the involvement of domain experts in the process. Attendees will gain a solid understanding of how to implement the UoW pattern in their Python applications, how it fits into the broader context of DDD, and how to prepare their code for future growth. europython-2023-29664-working-in-units-how-to-decouple-the-database-and-domain-layers-in-python Software Engineering & Architecture (2023) Alvaro Duran en As developers modelling a domain into a software product, how can we make the most of the insights that we receive from domain experts? Crucially, a system that reads similar to how domain experts talk and think about their area of expertise enables the team to look at the codebase as a whole, and not as a mix of modules. But in order to do that, the system must be designed in such a way that what’s relevant to the domain takes a centre stage, and implementation details stay in the background. In order to do that, we can layer the codebase so that the domain—where elements that represent the concepts and interactions that domain experts talk about— is clearly delineated from the infrastructure—where these elements find a way to be implemented in purely software engineering terms. At Kiwi.com, we are redesigning one of our most critical services in order to expand the number of payment providers that we are integrating with, enabling us to serve a bigger and more diverse pool of customers. As part of this redesign, we are making use of the Unit of Work pattern, with which the interaction between domain entities gets abstracted from the specifics of the database in which those interactions are recorded. Much has been said about the use of abstracting elementary domain objects into a clean data model, but it is the very interaction between those objects where, in practice, the delineation between the domain and the infrastructure layer collapses. In this talk, we will cover the limitations of ORMs as a way to abstract the database details from the rest of the application, and will introduce the Unit of Work pattern to address those limitations. By means of real-world examples, the attendees will learn the advantages and trade-offs that the UoW pattern was designed to overcome, and will come away with practical use cases in which this pattern makes applications cleaner and more future-proof. The outline of the talk is the following: 1. Introduction, or “ORMs are the Vietnam of Computer Science” (5min) a. Impedance mismatch - Code and Database b. Impedance between Domain and Code c. Domain Driven Design 2. Understanding the Unit of Work pattern (5min) a. Definition and purpose b. Trade-offs 3. Advantages of UoW (5min) a. Isolation of data access from business logic b. Polyglot persistence 4. UoW in the wild (10min) false https://programme.europython.eu/europython-2023/talk/N7DVSG/ https://programme.europython.eu/europython-2023/talk/N7DVSG/feedback/ North Hall Talk 2023-07-21T14:35:00+02:00 14:35 00:30 Pytorch is one of the most popular machine learning frameworks, and its latest iteration (PyTorch 2.0) landed just a couple of days back. Among other things, PyTorch 2.0 offers faster performance with a fully backward-compatible API that guarantees the development ergonomics that PyTorch is known for. In this talk, we will examine how practitioners (researchers and engineers) can benefit from optimizations provided by PyTorch 2.0 and what other improvements are on the horizon. europython-2023-29623-pytorch-2-0-why-should-you-care TBD - Multiple Tracks (2023) Shagun Sodhani en In this talk, we will talk about the following: (i) Performance benefits provided by PyTorch 2.0, even without changing even a single line of code. (ii) How to leverage the best of PyTorch 2.0, sometimes by changing just a single line of code. (iii) A quick overview of "behind-the-scenes" technologies underpinning PyTorch 2.0 - TorchDynamo, AOTAutograd, PrimTorch, and TorchInductor. (iv) API improvements to PyTorch 2.0 that makes the user experience even more ergonomic. false https://programme.europython.eu/europython-2023/talk/3TWGAB/ https://programme.europython.eu/europython-2023/talk/3TWGAB/feedback/ North Hall Talk 2023-07-21T15:30:00+02:00 15:30 00:30 - Are prices of short-term rental apartments in your region similar? How similar are they, and at which distance do they tend to be correlated? - Do you have access to a few air pollution measurements but must provide a smooth map over the whole area? - Is your machine learning model based on remote sensing data from Earth Observation satellites, and do you want to include data sampled on Earth? - Do you work with county-level socio-economic factors, but you want to get insights at a finer scale? `if any(answer)`, then come and see what we can do with the `pyinterpolate` package designed exactly for spatial interpolation! europython-2023-30123-we-can-get-more-from-spatial-gis-and-public-domain-datasets PyData: Machine Learning, Stats (2023) SzymonMolinski en The talk introduces spatial interpolation in Python at the intermediate/advanced level. You should know Python basics and the statistical concepts of variance and correlation to understand the presentation. Spatial interpolation is the new kid on the block, and in the future, with IoT devices everywhere, it will gain much more weight (along with its relative - time-series modeling). Heavily based on statistics, it falls into a single concept: *Everything is related to everything else, but near things are more connected than distant things*. (**W. Tobler**). The presentation will focus on one concept and two techniques: - the concept of spatial correlation (the example from the leisure & tourism market), - the point kriging technique used to interpolate values at unseen locations (weather readings enhancement), - the Poisson Kriging Area-to-Point technique for preparation of the input from regional statistics that fit into satellite-based observations (cancer rates in U.S. counties). Techniques for spatial data interpolation are used by: - mining industry, - agriculture & forestry, - defense & security, - retail, - public health, - administration, urban planning, water management, - weather forecasting, - and everywhere where we sample events distributed over an area or analyze regional statistics. Why should we bother from the business perspective? We have various ML models, and house-price prediction is a topic of many tutorials. There are a few reasons: with spatial interpolation, we get knowledge about spatial dependencies between our samples, we get uncertainty measures, and we may perform analysis on a relatively small sample (> 50 samples) that won't work with the ML pipeline. We may even link geostatistical models within complex machine-learning pipelines. And finally, we may save a lot of money on sampling. false https://programme.europython.eu/europython-2023/talk/MMQTLC/ https://programme.europython.eu/europython-2023/talk/MMQTLC/feedback/ North Hall Talk 2023-07-21T16:05:00+02:00 16:05 00:30 Python offers us the ability to customize how it starts up. In some cases arbitrary python code can get executed before the first line of your module is reached. This is necessary for some of its dynamic nature, like virtualenvs but can also be harnessed to make the interpreter experience truly personal. europython-2023-29445-site-unseen-hidden-python-customization TBD - Multiple Tracks (2023) Jeremiah Paige en Python does a lot of work to customize itself when starting up. It also provides hooks for even more customization from users and packages during startup. Some of these are on by default while others must be enabled. Learn how to take advantage of Python's startup to craft a custom interpreter. Python has a dizzying array of environment variables, many of which are used for startup tuning. The list has grown so long that recent Python versions have split the description of these variables into their own help (--help-env). It is valuable to a Pythonista to know about all of these, but this talk will show you how to use a subset to personalize the Python runtime environment to your development needs and preferences. As powerful as this customization is, much of it is possible through arbitrary code execution or otherwise manipulating the expected behavior of lookups. Since many of these behaviors happen automatically, it is important to know how to disable them for many reasons: security, reproducibility, and speed among them. false https://programme.europython.eu/europython-2023/talk/TJW3YZ/ https://programme.europython.eu/europython-2023/talk/TJW3YZ/feedback/ Terrace 2A Talk 2023-07-21T10:30:00+02:00 10:30 00:30 The topic aims to introduce participants to the latest from Python in version 3.11, released in early October 2022, which includes: • Speed improvements; • Standard Libraries Improvements; • Self type; • Exception Notes; • Better Error Messages; • Improved Type Variables; • Variadic generics; • Marking individual TypedDict items as required or potentially missing; • Arbitrary literal string type; • Data class transforms; • TOML read-only support in stdlib; • Exception Groups; • Negative Zero Formatting. europython-2023-29584-python-3-11-what-s-new Python Internals & Ecosystem (2023) Dilyan Grigorov en My presentation aims to consider the most interesting new features of Python 3.11 which have been discussed among the software engineers since the official release of the new version of the language. Then real practical examples will be taken into account and implemented for real solutions of problems. false https://programme.europython.eu/europython-2023/talk/K9VPWE/ https://programme.europython.eu/europython-2023/talk/K9VPWE/feedback/ Terrace 2A Talk 2023-07-21T11:20:00+02:00 11:20 00:30 With the release of Python 3.11 in October 2022, PEP 654 "Exception Groups and except" was accepted, and asyncio.TaskGroup() was added. This enhancement of exception and cancellation handling has allowed asyncio to evolve more flexibly, addressing the existing issues with asyncio APIs, such as insufficient cancellation and exception handling in asyncio.gather. In this talk, I would like to discuss the problems of existing asyncio APIs and how the newly introduced asyncio.TaskGroup() solves these issues. Attendees will learn about the improved way of handling exceptions and cancellations using asyncio.TaskGroup(), enabling them to write more efficient and robust asynchronous code with Python 3.11. europython-2023-29484-asyncio-evolved-enhanced-exception-handling-with-taskgroup-in-python-3-11 Software Engineering & Architecture (2023) Junya Fukuda en ### Description In Python 3.11, asyncio.TaskGroup() and asyncio timeout context managers were added. Additionally, get_event_loop() was deprecated in 3.10, and loop objects were further obscured, making the already less intimidating asyncio even less scary. I will discuss the basic usage of asyncio in Python 3.11, which has become simpler and more flexible, focusing on exception and cancellation handling. I hope that this will be helpful for those who choose asyncio when writing web applications using ASGI frameworks or Python scripts where asynchronous I/O is useful. ### By the end of this talk, attendees will be able to: * Understand the limitations of the existing asyncio APIs, specifically regarding cancellation and exception handling in asyncio.gather. * Learn how Python 3.11's asyncio.TaskGroup() overcomes these limitations and improves exception and cancellation handling. * Apply the new asyncio.TaskGroup() features in their asynchronous programming to build more resilient and efficient applications. ### Planned Outline * Overview of asyncio.taskgroup (5 min) * New "except*" syntax * PEP 654 Exception Groups and except * Capturing concurrent exceptions(10 min) * Using asyncio.gather() / asyncio.TaskGroup() * Cancelling tasks on exception(10 min) * Using asyncio.gather() / asyncio.TaskGroup() * Writing "predictable" and "safe" asyncio code(5 min) * Introducing the new standard "Hello-ish world" example false https://programme.europython.eu/europython-2023/talk/BEVEFH/ https://programme.europython.eu/europython-2023/talk/BEVEFH/feedback/ Terrace 2A Talk 2023-07-21T11:55:00+02:00 11:55 00:30 Event-Driven Architectures (EDAs) target a real need in today's application landscape, as systems grow more complex or need to scale organically. The talk will introduce the architecture and provide insights into different components which can be managed, connected and implemented with Python. europython-2023-29305-diving-into-event-driven-architectures-with-python Software Engineering & Architecture (2023) Marc-André Lemburg en Event-driven architectures (EDAs) and AsyncAPI are being pushed at the moment as the new big thing after REST/OpenAPI and GraphQL. Indeed, EDAs target a real need in today's application landscape, as systems grow more complex or need to scale both vertically and horizontally. Python can help build such architectures by leveraging existing event bus/queue systems or by providing the needed async interfaces directly. The talk will introduce the architecture and terminology around it, such as AsyncAPI, as well as provide insights into different components which can be managed, connected and implemented with Python. It is also meant to spark some more interest in getting Python into a more prominent position within the AsyncAPI community, where Node and Java still dominate. Resources: - https://en.wikipedia.org/wiki/Event-driven_architecture - https://www.asyncapi.com/ false https://programme.europython.eu/europython-2023/talk/DE3XED/ https://programme.europython.eu/europython-2023/talk/DE3XED/feedback/ Terrace 2A Sponsored 2023-07-21T12:30:00+02:00 12:30 00:30 Must-have tools for running GraphQL in production Gear up for a groundbreaking transformation of your GraphQL prowess! Join us for an engaging and informative session as we unveil a set of indispensable tools and practices that will take your GraphQL APIs to new heights in production environments. europython-2023-33363-best-practices-for-graphql-api-development Web (2023) Ahter Sonmez en In this talk, we'll tackle the toughest challenges head-on. From conquering query depth limits and query complexity constraints to mastering authorization checks, role-based access control (RBAC), we've got the insider GraphQL knowledge you need. As we plunge into the depths of GraphQL sorcery (where Krakens live) you'll uncover the secrets to unleashing lightning-fast pagination, implementing intelligent rate-limiting, and harnessing a treasure trove of indispensable monitoring tools. Don't miss out on this opportunity to supercharge your GraphQL API skills. By embracing these must-have tools and practices, you'll confidently navigate production environments, delivering outstanding user experiences and leaving your stakeholders in awe. false https://programme.europython.eu/europython-2023/talk/MAGZUV/ https://programme.europython.eu/europython-2023/talk/MAGZUV/feedback/ Terrace 2A Poster 2023-07-21T13:00:00+02:00 13:00 01:00 There are two values that everyone agrees with: Judicial Truth (criminals should be prosecuted, but innocent people left free), and Privacy (others shouldn't know unnecessarily about my private life). But these two values are constantly put in opposition, e.g. videosurveillance helps gather evidence of crime, but it endangers our legitimate rights as citizens. That's why we launched the WitnessAngel initiative, a research effort to invent new concepts and technologies able to reconcile Judicial Truth and Privacy. With algorithms like Flightbox, with ideas like VideoTestimony and Familiar, and with the open-source code we provide, we work with associations and enterprises to eventually put life-changing solutions into the hands of the general public. So that countless victims of rape, abuse, bullying, stop facing the usual brick wall: "it's your word against theirs". europython-2023-28838-how-python-can-help-victims-of-violence Ethics, Philosophy & Politics (2023) Pascal Chambon en This poster will summarize the concepts, technological blocks, frequently asked questions, and challenges still to be tackled by the WitnessAngel project. It will provide an overview of our roadmaps, and of how people can contribute to this effort, so that one day #metoo and other global scandals become a thing of the past. false A comic strip to show our concepts https://programme.europython.eu/europython-2023/talk/8M8UCT/ https://programme.europython.eu/europython-2023/talk/8M8UCT/feedback/ Terrace 2A Talk 2023-07-21T14:00:00+02:00 14:00 00:30 Apache Kafka® is the de facto standard in the data streaming world for sending messages from multiple producers to multiple consumers, in a fast, reliable and scalable manner. Come and learn the basic concepts and how to use it, by modelling a traditional British fish and chips shop! europython-2023-29356-fish-and-chips-and-apache-kafka Infrastructure: Cloud & Hardware (2023) Tibs en Handling large numbers of events is an increasing challenge in our cloud centric world. For instance, in the IoT (Internet of Things) industry, devices are all busy announcing their current state, which we want to manage and report on, and meanwhile we want to send firmware and other updates back to specific groups of devices. Traditional messaging solutions don't scale well for this type of problem. We want to guarantee not to lose events, to handle high volumes in a timely manner, and to be able to distribute message reception or production across multiple consumers or producers (compare to sharding for database reads). As it turns out, there is a good solution available: Apache Kafka® - it provides all the capabilities we are looking for. In this talk, rather than considering some imaginary IoT scenario, I'm going to look at how one might use Kafka to model the events required to run a traditional British fish and chip shop: ordering (plaice and chips for me, please), food preparation, accounting and so on. I'll demonstrate handling of multiple producers and consumers, automatic routing of events as new consumers are added, persistence, which allows a new consumer to start consuming events from the past, and more. Find the slides and demos on [Aiven Labs](https://github.com/Aiven-Labs/fish-and-chips-and-kafka) false https://programme.europython.eu/europython-2023/talk/UPEWP3/ https://programme.europython.eu/europython-2023/talk/UPEWP3/feedback/ Terrace 2A Talk 2023-07-21T14:35:00+02:00 14:35 00:30 At LocalStack, we are building a platform that enables development and testing of cloud applications on your local machine. The core is an [open source AWS emulator](https://github.com/localstack/localstack) that is primarily written in Python. It is among the top Python projects on GitHub, and has seen a massive uptake in contributions over the past two years. Many Python software developers and architects will relate to the struggles of maintaining a large and complex Python codebase, while keeping developer teams productive. In this talk, we'll explore how we at LocalStack tackle these as we re-create AWS for local development. We'll explain our approaches to automating around AWS specifications, building a highly modular and pluggable system to make it easy for teams to integrate their components, the software patterns we use to keep devs productive, as well as our approach to automated contract testing using pytest. europython-2023-29558-how-localstack-is-recreating-aws-with-python Software Engineering & Architecture (2023) Thomas Rausch en This talk aims to provide a broad overview of LocalStack and its implementation, and at the same time provide listeners with relatable insights from our experience in architecting, developing, and maintaining a large, complex Python code base. The outline is roughly as follows: - Intro: What's LocalStack, who am I, what problems are we solving? - Software patterns we use, and how they are implemented in Python. These include: - A web framework based on WSGI/Werkzeug that implements the chain-of-responsibility pattern: I'll explain how this pattern is similar to WSGI middleware, and demonstrate how it allows us to plug in different types of functionality into the HTTP request processing, when this pattern is beneficial (compared to traditional web frameworks: much more flexible), and what the drawbacks are (hard to debug!) - Other patterns found in the code base: Visitor, Adapter, Proxy, Singleton - Monkey patching: I will briefly explain how monkey patching works, how it helps us move fast, but also how it can hurt (with real examples of when things blew up in our face), but why the trade-off leans towards using monkey patching. - Dynamic code loading: We built an open source framework called Plux that builds a higher-level plugin mechanism around Python entrypoints. will explain both the benefits (super flexible, allows clean code organization) and the drawbacks (pretty hard at times to figure out what's going on) of dynamic code loading. - Strategies we use to maintain parity with AWS: People are usually skeptical that an idea like LocalStack can even work. - We automate a lot around the AWS specs, for example we get weekly PRs when service APIs change. I'll demonstrate how we do server-side code generation from the AWS specs, and how that helps us. - Snapshot testing: We have built our own contract testing framework around pytest. We use that to write contract tests against AWS, that we then run against LocalStack to ensure parity. I'll go into a bit of details of the challenges with this approach, but also how we couldn't work without it. - Wrap up and conclusion: I will tie together all the presented solutions and summarize how they help us solve the challenges. After this, the audience should have a deeper appreciation for how Python helps build something like LocalStack. I'll conclude by pointing out some of the overarching themes in this talk (like the tradeoffs between introducing certain patterns on maintainability). false https://programme.europython.eu/europython-2023/talk/79HLM8/ https://programme.europython.eu/europython-2023/talk/79HLM8/feedback/ Terrace 2A Talk 2023-07-21T15:30:00+02:00 15:30 00:30 Beautiful is better than ugly. The frontier of AI Language Models awaits exploration. We, Pythonistas, face choices on how to use these tools. Advanced models like GPT-4, BARD, and LLaMa generate human-like responses. The nature of Language Models is fear, But tools like TransformerLens show The Way. Understanding The Model is possible. The nature of Language Models is excitement. Using them out of the box is one option. Prompt engineering is another. ChatGPT plugins and LangChain offer a third choice. Fine-tuning them presents a fourth. Training them from scratch is the fifth option. Not using them at all is the final option. It may be safer. The output for one LM is the prompt for another. While openai is an excellent library, and LangChain composes language models and utilities. GPT's plugin system also composes language models and utilities, and There should be one-- and preferably only one --obvious way to do it. europython-2023-30085-language-model-zen PyData: Ethics in AI (2023) Jamie Coombes en This talk explores the complex frontier of Language Modeling, recognizing the importance of mitigating risks and ethical considerations while exploring opportunities and challenges. It provides practical examples using OpenAI, LangChain, and GPT's plugin system to showcase the different ways to use these powerful tools. The Capability in AI focus is provided by the comparison between LangChain and the GPT Plugin System. The Ethics in AI focus is provided by demonstrating the TransformerLens library. TransformerLens allows surgeon-like analysis of language model internals. This mechanistic Interpretability library created by the London-based Researcher, Neel Nanda, This talk will compare the abundant code-quality linting and tooling available for static and dynamic analysis of code, to the comparatively weaker MLOps ecosystem, and the almost non-existent MLSafetyOps (Mechanistic Interpretability) ecosystem. This talk will propose a greater focus on open-source interpretability tooling. false https://programme.europython.eu/europython-2023/talk/KPHVEL/ https://programme.europython.eu/europython-2023/talk/KPHVEL/feedback/ Terrace 2A Talk 2023-07-21T16:05:00+02:00 16:05 00:30 Music streaming services like Spotify and youtube are famous for their recommendation systems and each service takes a unique approach to recommending and personalize content. While most users are happy with the recommendations provided, there are a section of users who are curious how and why a certain track is recommended. Complex recommendation systems take various factors like track metadata, user metadata, and play counts along with the track content itself. Inspired by Andrej Karpathy to build an own GPT, we have to use Language Models to build our own music recommendation system. europython-2023-29324-language-models-for-music-recommendation PyData: Deep Learning, NLP, CV (2023) Nischal Harohalli PadmanabhaRaghotham Sripadraj en Music streaming services like spotify and youtube are famous for their recommendation systems and each service takes a unique approach to recommend and personalize content. While most users are happy with the recommendations provided, there are a section of users who are curious how and why a certain track is recommended. Complex recommendation systems take various factors like track metadata, user metadata, play counts along with the track content itself. As music aficionados who love techno, trance, deep house and classical genres, we want to understand the following questions: 1. Can we analyze the signals from the song track and identify the different instruments used? 2. How can we create embeddings of all the tracks and index these for further analysis? 3. How do we create a simple User interface to pick a song track, retrieve relevant embeddings from a section of the track and get recommendations based on just the music content. 4. As a side effect, can I retrieve similar sections of music across various tracks. 5. Using audio LMs, can we generate high quality music based of the embeddings? false https://programme.europython.eu/europython-2023/talk/G9NKUY/ https://programme.europython.eu/europython-2023/talk/G9NKUY/feedback/ Terrace 2B Talk 2023-07-21T10:30:00+02:00 10:30 00:30 Django is a framework that's been around for more than 15 years, which makes for enough legacy projects to deal with. In this talk we'll show practical tips and tricks for how to get Django from legacy to latest & greatest. europython-2023-29015-upgrading-django-from-legacy-to-latest Web (2023) Radoslav GeorgievKamen Kotsev en As developers, we love working with the latest version of our favorite tools & frameworks. But sometimes, we have to deal with legacy projects & since Django has been around for more than 15 years - there are plenty of legacy Django projects to work with. We either inherit one, or, somehow, we start with good intentions, but things deteriorate and we end up running Django that’s 2 or 3 major versions behind. No matter how we end up in that legacy situation, we usually have 2 choices: 1. Stay within the boundaries of the existing project. 2. Try upgrading Django & the rest of the dependencies. This talk will cover point 2, giving practical advice, derived from experience of migrating large legacy Django projects from versions 1 & 2, all the way to latest & greatest. We will approach the problem in a structured way, going through different scenarios and showing practical steps, tips & tricks, so a human can deal with the challenges of upgrading a legacy Django project. We will talk about starting from scratch vs. gradually upgrading. The talk will cover the following topics: 1. We will start with the most important question - How reckless can we be? - Is this in production? - Is this mission critical? - Is backwards compatibility important? - Are there tests? Automated? Test cases? Documentation? - Are we building from scratch or are we gradually upgrading? 2. Next, we will go through various scenarios. - We are dealing with Django 2. What now? - We are dealing with Django 1 & Python 2. What now? - There are core dependencies that are no longer supported. What now? 3. Finally, after we managed to get to Django 4, we will talk about how not to end up in the same situation again. The end goal of the talk is to show that keeping up to date is possible, even if we start with a big legacy project. The talk should serve as inspiration & example for those, who want to push their legacy Django projects forward. false https://programme.europython.eu/europython-2023/talk/J3PUYZ/ https://programme.europython.eu/europython-2023/talk/J3PUYZ/feedback/ Terrace 2B Talk 2023-07-21T11:20:00+02:00 11:20 00:30 Pendulum is a Python package for working with dates, times, and timezones. It offers a simple and intuitive API for common date/time operations and provides advanced functionality for dealing with more complex scenarios. Some of the interesting points of Pendulum include support for leap years, time zones, and daylight saving time, as well as a fluent API for creating and modifying dates and times. One of the standout features of Pendulum is its support for time zones. The library comes with a comprehensive list of time zones, and it can automatically adjust dates and times to the local time zone of a given location. Additionally, Pendulum can handle time zone conversions with ease, making it easy to work with date/time data across different time zones. Pendulum also provides a powerful API for creating and modifying dates and times. With its fluent interface, developers can create and manipulate dates and times using a natural, human-readable syntax. europython-2023-29687-time-made-easy-simplify-date-and-time-handling-with-python-s-pendulum TBD - Multiple Tracks (2023) Abhinand CJothir Adithyan en Pendulum is a Python library designed to simplify the handling of dates, times, and time zones. It offers an easy-to-use API that allows developers to perform common date/time operations with ease, while also providing advanced functionality for more complex scenarios. With its support for time zones, leap years, and daylight saving time, Pendulum is a comprehensive solution for managing date/time data in Python. Its fluent interface and intuitive syntax make it easy to create and manipulate dates and times in a natural way, while its robust documentation and helpful community make it easy to get started with the library. Whether you're building a simple date calculator or a complex scheduling application, Pendulum can help you work with time-related data more efficiently and effectively. false https://programme.europython.eu/europython-2023/talk/UWKSPN/ https://programme.europython.eu/europython-2023/talk/UWKSPN/feedback/ Terrace 2B Talk 2023-07-21T11:55:00+02:00 11:55 00:30 HTMX has been quite popular lately in the Django circles and has demonstrated how powerful it can be with vanilla Django. But... have you thought about HTMX paired with Django REST Framework and more specifically paired with DRF's flexible renderer system? europython-2023-29640-leveraging-the-power-of-django-rest-framework-s-renderers-with-htmx Web (2023) Emma Delescolle en Django is most known for its admin. Ironically it is also one of the less Django-like parts of Django and one with many dimensions that make it harder to extend and fully customize. That's probably why, for several years, people have been trying to find alternatives to Django admin, packages that have had variables amounts of success like Django Grappelli, Django Admin2 or Django Admin Bootstrap. One of these attempts is actually part of a very popular Django package, it's the Admin Renderer from Django REST Framework. Although it is quite powerful, I'm not sure it really ever caught on in the Django community. But the Admin renderer is not the only renderer packaged with DRF, most of us are likely familiar with the Browsable API renderer and some of us have probably heard of the Template HTML renderer. Before diving into the renderer itself, we will do a quick round-up of the capabilities DRF offers, both out-of-the box and also with a few extra addons and compare that to what Django Admin offers. Finally we will look at the mechanics of DRF renderers and how, coupled with HTMX, the Template HTML renderer can bring dynamicity to an admin-like, feature-rich, CRUD interface born of Django REST Framework. It will be up to you to decide... Is Django REST Framework going to be the basis of the admin of your next Django project??? false https://programme.europython.eu/europython-2023/talk/BRY8JS/ https://programme.europython.eu/europython-2023/talk/BRY8JS/feedback/ Terrace 2B Talk 2023-07-21T12:30:00+02:00 12:30 00:30 Learn to secure your Django apps by attacking (and then securing) Pygoat - An intentionally vulnerable Python Django application. Explore the OWASP top 10 vulnerabilities and understand how to mitigate them from Django apps. europython-2023-30066-pygoat-learn-django-security-the-hard-way TBD - Multiple Tracks (2023) Adarsh DivakaranThameem Karakkoth en Pygoat is an intentionally vulnerable Python Django application that can be used to learn to secure our Django apps. In this talk, we will attack a deployed Pygoat application, identify the underlying security issues in our code, and then secure it. We will learn about common security vulnerabilities (OWASP Top 10) in Django apps and how to fix them so that we can keep our applications safe from attackers. false https://programme.europython.eu/europython-2023/talk/BSZFSA/ https://programme.europython.eu/europython-2023/talk/BSZFSA/feedback/ Terrace 2B Poster 2023-07-21T13:00:00+02:00 13:00 01:00 code.kiwi.com community has been running Python Weekend — an educational community project — since 2016. Over the past 7 years we helped hundreds of Python developers complete the program accelerating their careers, traveled to 10+ cities all over Europe and collaborated with numerous local Python communities to make it happen. At first glance, Python Weekend is a 2.5-day supervised coding event for Junior+ Python devs, where participants build the prototype of core Kiwi.com technology, while getting support from a group of experienced engineers, for free. But there’s so much more to this. At this poster session, we will share how to run an educational Python project so the community, business and local tech scene would benefit. We will show how to shape the culture of connecting real-business challenges and junior talent. We will see how dev edu projects can impact the culture of mentorship and present feedback of mentees from all over the world to share their experience. europython-2023-30124-we-are-python-weekend Education, Teaching & Training (2023) Alena OsipovaAndrej ZaujecLukáš Kubiš en I think We are Python Weekend talk can be also presented as a poster session. We plan - million of stories - inspiration for everyone who wants to run their own Python project for the community - a lot of photos and feedback from the folks who have been part of the project - from a CS student, graphic designer, ex-WizzAir pilot, and more amazing people of Python Weekend. false https://programme.europython.eu/europython-2023/talk/HSRTCT/ https://programme.europython.eu/europython-2023/talk/HSRTCT/feedback/ Terrace 2B Talk 2023-07-21T14:00:00+02:00 14:00 00:30 This talk will introduce dbt and demonstrate how to leverage Python to unlock its full potential. Attendees will learn best practices for working with dbt, how to integrate it with other tools in their data stack, and how to use Python packages like fal to perform complex data analysis. With real-world examples and use cases, this talk will equip attendees with the tools to build a modern, scalable, and maintainable data infrastructure. europython-2023-29462-unleashing-the-power-of-dbt-and-python-for-modern-data-stack PyData: Software Packages & Jupyter (2023) Meder Kamalov en Data modeling, transformation, and analysis are integral parts of data pipelines. However, managing and maintaining data infrastructure can be a daunting task. dbt (data build tool) is a powerful open source package that helps data teams build modular, maintainable, and scalable data transformations. In this talk, we will introduce dbt to the Python community and demonstrate its full potential. We will go over best practices for data modeling and transformation, and how to integrate dbt into your existing data stack. We will also show how to use Python packages such as fal to interact with dbt and perform complex data analysis. Attendees will learn: - What is dbt and why it’s a game-changer for data engineering and analysis - Best practices for data modeling and transformation with dbt - How to integrate dbt into your existing data stack and work with data warehouses such as Snowflake and BigQuery - How to leverage Python packages such as fal to interact with dbt and perform advanced data analysis - Real-world examples and use cases of dbt and Python in action By the end of this talk, attendees will have a solid understanding of how to use dbt and Python together to build a modern, scalable, and maintainable data stack. Whether you’re a data engineer, analyst, or scientist, this talk will give you the knowledge and tools to take your data infrastructure to the next level. false https://programme.europython.eu/europython-2023/talk/GQAARK/ https://programme.europython.eu/europython-2023/talk/GQAARK/feedback/ Terrace 2B Talk 2023-07-21T14:35:00+02:00 14:35 00:30 SQLAlchemy is one of the most popular ORM libraries in Python. In this talk I will try to present caveats and gotchas that other Pythonists can find on their way while writing the asynchronous backend application using SQLAlchemy as an ORM. Mainly we will focus on how SQLAlchemy handles transactions and connections to the database and what issues we may face because of it. europython-2023-29814-deep-dive-into-asynchronous-sqlalchemy-transactions-and-connections Python Libraries (2023) Damian Wysocki en The presentation is about SQLAlchemy, which is an Object-Relational Mapping (ORM) library used in Python for working with databases. The presenter will discuss the challenges and potential problems that developers may encounter when using SQLAlchemy to create asynchronous backend applications. The main focus of the talk will be on how SQLAlchemy handles transactions and connections to the database, which are crucial components of building a robust and reliable backend system. The presenter will explain some of the common caveats and gotchas that can arise when using SQLAlchemy in this context. Overall, the talk aims to provide valuable insights and practical advice for Python developers who are interested in working with SQLAlchemy and building scalable, high-performance backend applications. As a bonus we'll see how other popular asynchronous ORM handles connections to the database. false https://programme.europython.eu/europython-2023/talk/REVKYV/ https://programme.europython.eu/europython-2023/talk/REVKYV/feedback/ Terrace 2B Talk 2023-07-21T15:30:00+02:00 15:30 00:30 At the Netherlands Forensic Institute (NFI), we've developed a Python-based deep learning model to spot life-threatening messages in lawfully intercepted communication data, like those from the infamous chat service Encrochat. Thanks to the application of our model in collaboration with the Dutch Police, dozens of potential victims of violent crimes, including murder, serious assault, and kidnapping, have been warned and safeguarded. In this talk, we'll dive into the development, implementation, and success of our deep learning model in the fight against violent criminal activities. We'll also tackle the risks tied to using deep learning for these cases and discuss the precautions we took to ensure responsible and accurate use. europython-2023-29661-threat-to-life-preventing-planned-murders-with-python PyData: Deep Learning, NLP, CV (2023) Edwin Rijgersberg en false https://programme.europython.eu/europython-2023/talk/F78KKP/ https://programme.europython.eu/europython-2023/talk/F78KKP/feedback/ Terrace 2B Talk 2023-07-21T16:05:00+02:00 16:05 00:30 There has been a renaissance around Artificial Intelligence systems in recent years. However, despite the hype, only a small percentage, i.e. 13% of Machine Learning models see the light of day! Well, effectively building and deploying machine learning models is more of an art than science! ML models are indeed inherently complex, have fuzzy boundaries, and rely heavily on data distribution. But what if they are trained on biased data? Then they’ll generate highly biased decisions! As the famous saying goes by, “Garbage in, garbage out,” so if the model is trained on skewed and unfair data distribution, they are bound to produce fuzzy output! So, join me in this talk as I will share my learnings in developing effective practices to build and deploy ethical, fair and unbiased machine learning models into production. europython-2023-29596-building-and-deploying-fair-and-unbiased-ml-systems-an-art-not-science TBD - Multiple Tracks (2023) Rashmi Nagpal en Have you ever wondered why the increasing reliance on Machine Learning systems raises concerns about fairness and bias in their data-driven decisions? What if ML models are built on skewed data or are not designed to mitigate bias - then they can perpetuate and even amplify existing inequalities and injustices! Since there's no one-size-fits-all approach, thus, building and deploying a fair and unbiased ML system is more of an art than a science! In this talk, firstly, we will explore the challenges involved in building and deploying fair and unbiased ML systems. Secondly, we will understand the technical debts which incur while building such systems and how to investigate them. Finally, we will learn fundamental strategies and best practices for ensuring your ML models are fair, unbiased, and ethical! false https://programme.europython.eu/europython-2023/talk/VFLKKR/ https://programme.europython.eu/europython-2023/talk/VFLKKR/feedback/ Open Space Open Space 2023-07-21T10:30:00+02:00 10:30 02:30 ✨ We are running mentored sprints for diverse community members at EuroPython this year ✨ 👉🏽 Apply to be a mentor on the day or feature your open source project: email [cheuk@europython.eu](mailto:cheuk@europython.eu) 👉🏽 Apply to participate as a contributor (sprint on the day): [fill in this form](https://forms.gle/56EbHh4g19Mevo9i8). If you are not a member of an underrepresented group of the community and want to take on the sprint we encourage you to bring someone from an underrepresented group with you. 👉🏽Volunteer for our Git Helpdesk (4 volunteers needed): Help new contributors with git/GitHub, such as cloning repo, creating branch, committing, resolving merge conflicts. [fill in this form](https://forms.gle/56EbHh4g19Mevo9i8) 📖 Check out our online handbook to learn more about our approach to sprinting: https://mentored-sprints.netlify.app/ europython-2023-33703-reserved-for-mentored-sprint Cheuk Ting Ho en Open source projects such as Python and its multiple stacks (web, scientific, etc.) are nothing but a collaborative effort from many community members. It is the constant involvement of the numerous maintainers, contributors, and users that make open-source software sustainable and keep the community as a whole going. Walking the path from user to collaborator, and thus contributing to an open-source project, can sometimes be intimidating especially for newcomers. From a technical perspective, interacting with web-based hosting services (such as GitHub, GitLab, etc.), branching and opening pull requests can be overwhelming if these are not everyday actions of your workflow. The correctness of the code and potential bugs are other common obstacles and fears any newcomer might face. Not to mention the time and frustration accumulated over the task of finding a ‘beginner-friendly’ issue to work on. We also recognize that some groups are traditionally underrepresented in the open-source community and we would like to support them in their open-source path. We are running the mentored sprints for individuals from underrepresented groups willing to start contributing to Python projects. This event will provide a supportive, friendly, and safe environment for all the attendees and partner open source projects. To achieve this goal, we are seeking to work with a number of Python projects and their maintainers interested in providing mentorship to these individuals. In return, we will provide guidance and advice on how to prepare the projects for the day and to better serve a diverse range of contributors. Check out more details at [https://ep2023.europython.eu/mentored-sprint](https://ep2023.europython.eu/mentored-sprint) false https://programme.europython.eu/europython-2023/talk/GDZU3R/ https://programme.europython.eu/europython-2023/talk/GDZU3R/feedback/ Open Space Open Space 2023-07-21T15:30:00+02:00 15:30 01:30 europython-2023-34244-reserved-for-tournament en false https://programme.europython.eu/europython-2023/talk/7VLWUV/ https://programme.europython.eu/europython-2023/talk/7VLWUV/feedback/