BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//programme.europython.eu//europython-2026//speaker//P3TRF
 T
BEGIN:VTIMEZONE
TZID:CET
BEGIN:STANDARD
DTSTART:20001029T040000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=10
TZNAME:CET
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20000326T030000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=3
TZNAME:CEST
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
UID:pretalx-europython-2026-788XZA@programme.europython.eu
DTSTART;TZID=CET:20260716T103000
DTEND;TZID=CET:20260716T111500
DESCRIPTION:This is the real story about the design\, benchmark\, tuning an
 d operation of a 24x7 multi-tenant network monitoring platform\, that star
 ted out at only 1 packet/second\, but then with the power of Python it sca
 led to 1 million packet/second.\n\nIt is like an high performance version 
 of ICMP ping and mtr/traceroute\, supports dualstack IP v4/v6\, and runs 2
 4x7 on a set of probing nodes distributed Worldwide.\n\nEach ICMP packet n
 eeds to be scheduled\, crafted\, sent\, analyzed and stored for query in n
 ear-time.\n\nTo make things harder\, the probing platform has been designe
 d and tuned to use the least amount of resources as CPU\, memory and stora
 ge\, in order to run on cheap burstable cloud instances.\n\nPython is used
  everywhere: packet scheduling\, generate randomized ICMP packets\, send t
 hem via RAW sockets\, and match results from probing.\n\nProbing results a
 re then pushed to ClickHouse in near-time\, and visualized via Grafana.\n\
 nAnd rest assured that every packet counts.\n\nSome of the concept explore
 d during the talk:\n- ICMP protocol\, BGP protocol\, routing table\n- ping
 \, mtr/traceroute\n- RAW socket in Python\, crafting ICMP packets\n- tcpdu
 mp\, PCAP dump file\n- msgpack\, zstd compression\n- object storage\n- Apa
 che Parquet as optimized data storage format\n- near-time batch and stream
 ing data workflow\n- performance profiling and tuning\n- Python vs PyPy pe
 rformance comparison\n- monitoring of the monitor: probing node performanc
 e monitoring
DTSTAMP:20260524T121644Z
LOCATION:Conference Hall Complex (S4)
SUMMARY:From one to 1 million packet/second: scaling global Internet monito
 ring - Marco Grossi
URL:https://programme.europython.eu/europython-2026/talk/788XZA/
END:VEVENT
END:VCALENDAR