BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//programme.europython.eu//europython-2024//speaker//R9XT
 H7
BEGIN:VTIMEZONE
TZID:Europe/Prague
BEGIN:DAYLIGHT
DTSTART:20230713T000000
TZNAME:CEST
TZOFFSETFROM:+0200
TZOFFSETTO:+0200
END:DAYLIGHT
BEGIN:STANDARD
DTSTART:20231029T030000
RDATE:20241027T030000
TZNAME:CET
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20240331T030000
RDATE:20250330T030000
TZNAME:CEST
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
SUMMARY:Redun: Lazy Expressions for Efficient Reactive Python Workflows - 
 Maciej Szymczak\, Magdalena Borecka
DTSTART;TZID=Europe/Prague:20240712T130000
DTEND;TZID=Europe/Prague:20240712T140000
DTSTAMP:20261112T100651Z
UID:pretalx-europython-2024-KVNTFE@programme.europython.eu
DESCRIPTION:The goal of redun is to provide the benefits of workflow engin
 es for Python code in an easy and unintrusive way. Workflow engines can he
 lp run code faster by using parallel distributed execution\, they can prov
 ide checkpointing for fast resuming of previously halted execution\, they 
 can reactively re-execute code based on changes in data or code\, and can 
 provide logging for data provenance.\n\nWhile there are lots of workflow e
 ngines available even for Python\, redun differs by avoiding the need to r
 estructure programs in terms of dataflow. In fact\, we take the position t
 hat writing data flows directly is unnecessarily restrictive\, and by doin
 g so we lose abstractions we have come to rely on in most modern high-leve
 l languages (control flow\, recursion\, higher order functions\, etc). red
 un’s key insight is that workflows can be expressed as lazy expressions
 \, that are then evaluated by a scheduler that performs automatic parallel
 ization\, caching\, and data provenance logging.\n\nredun’s key features
  are:\n- Workflows are defined by lazy expressions that when evaluated emi
 t dynamic directed acyclic graphs (DAGs)\, enabling complex data flows.\n-
  Incremental computation that is reactive to both data changes as well as 
 code changes.\n- Code and data changes are detected using hashing of in me
 mory values\, external data sources or source code of individual Python fu
 nctions.\n- Workflow tasks can be executed on a variety of compute backend
 s. (threads\, processes\, AWS and GCP batch jobs\, Spark jobs\, etc).\n- P
 ast intermediate results are cached centrally and reused across workflows.
 \n\nLink to the code: https://github.com/insitro/redun/
LOCATION:Main Hall C
URL:https://programme.europython.eu/europython-2024/talk/KVNTFE/
END:VEVENT
END:VCALENDAR
