Machine Learning en producción: Experimentos con versionado de datos con DVC y VSCode

El workshop utiliza herramientas OpenSource de DVC y su extension para VSCode para preparar los experimentos de Data Science para su versionado y puesta en producción. Utilizamos el IDE de VS Code y lo transformamos en una plataforma de experimentación de Machine Learning.

A través de un caso de uso real, veremos las posibilidades que ofrece el implementar practicas de Software a los proyectos de Data Science y herramientas para versionar los experimentos de Machine Learning.

Objetivo : ayudar a los data scientist a salir de los notebooks y preparar la experimentación y puesta en producción de manera un poco mas robusta .

• Laptop , requirements.txt installed.
• VS Code IDE.

Friendly fuzzing for your Python SaaS applications

Tired of bugs? Security issues in your Python code? Fuzzing approach can help you to decrease number of issues received from your production environment using only few lines of code! In this topic you are going to:

• learn what the fuzzing is and what type of fuzzing exists
• learn how it helps to catch the bugs and find potential security issues when you are sleeping
• “fuzz” your first python application
• find the way to fuzz your REST Django application
• discover the instruments to fuzz any API

• Initial python knowledges
• Would be great to know Django
• Laptop with installed Docker and Docker Compose

How many ants can carry an elephant? Pushing the limits of AWS Chalice

Chalice is a framework for writing serverless apps in python. It allows you to quickly create and deploy applications that use AWS Lambda. Serverless applications generally have some limits like RAM, storage, and CPU.. and the main purpose is simple functions like login, registration, etc. So what if we want to create an ML application? How can we handle our limits? don’t panic young Skywalker. We have to push our limits and we’ll install NumPy, and Sci-kit learn libraries and our app will roam freely in the cloud in peace.

Python, AWS account, AWS chalice framework

Build Air Quality Sensors with Python and choose your own adventure!

The goal of this hands-on workshop is to build an Air Quality sensor (with Raspberry Pis) using Python to get the data from the sensors. From here you are going to choose what happens next. Would you like to store the data on a database? Visualize it? Send it to a Cloud? or to a Telegram bot? You choose your own adventure! Everything in the edge using containers, python and balena.

Laptop

Build a full-stack app with Flask and Vue

In this workshop we will build a complete web application using Flask Python micro framework in the backend and Vue.js JS framework in the frontend. Both Flask and Vue are easy to learn, yet flexible and powerful, making them a great choice for those who want to create modern and robust applications - and do it fast.

• Familiarity with Python and basic understanding of HTML and CSS (ideally JS too, but it is not necessary)
• Laptop with Python3, Flask, NuxtJS and Docker.

Python as a GIS: Tools, howtos and gotchas

Use python as a GIS with Rasterio, Xarray and GeoPandas

Laptop with conda if attendees want to follow the notebooks and do some exercises, just ears and be present otherwise.

Building an End-to-End Open-Source Modern Data Platform for Biomedical Data

A detailed guide to help you navigate the modern data stack and build your own platform using open-source technologies.

Data engineering has experiences enormous growth in the last years, allowing for rapid progress and innovation as more people than ever are thinking about data resources and how to better leverage them.

In this talk we will explore the related technologies and build from scratch an end-to-end modern data platform for the analysis of medical data. We will be using open-source tools and libraries, including python-based DBT, Apache Airflow and Querybook.

The platform will consist of the following components:

• Data warehouse
• Data integration
• Data transformation
• Data orchestration
• Data visualization

Follow the installation steps in https://github.com/alabarga/pybcn22-modern-data-stack

Cuando los precios suben: Scrapy

Criptomonedas, la guerra en Ucrania, la pandemia, la falta de componentes y toda la serie de catastróficas desdichas que estamos sufriendo nos ha llevado a un punto en el que el precio de todo ha subido. En este taller aprenderemos a usar Scrapy para conseguir descargar, almacenar y comparar los precios de los productos que queramos.

Laptop

Inside out. Or how to get your app observable

Observability is key in distributed systems and it is gaining importance within the industry. So it is important to understand the concepts behind the idea of observabiity and why is important to us, as developers, to make our developments “observable”. Being able to create software that is easy to debug while systems scales and complexity grows will level up us as developers and will make our clients and employers far happier. This is what this workshop is about. From a brief theory of what observability is to some practices and best practices.

Laptop

Lightning talks (session 1) & coffee

Lightning talks

Have you ever wondered how to win your friends in a football fantasy league? In this talk I will show how to use python to get the best performant team by using web scraping, operations research, and machine learning!

We'd like to talk about a research project (working progress) trying to measure media bias in Spanish TV news. For this, we employ techniques of speech recognition, speaker diarization and text analysis. This project is carried on by PhD students of the Economics department at Universitat Autònoma de Barcelona.

Astropy is now a mature python library with over 34.000 commits on Github and hundreds of contributors. Astropy is still little known beyond the astronomical community, but offers several powerful tools that are useful to all python developers. In this lightning talk I will present some of these tools.

The Digital Team at Cetaqua works in bringing state of the art AI (Computer Vision, Reinforcement Learning) to one of the most crucial issues of our time: water and environmental management. The talk aims to briefly showcase how we use Python for that.

Invitación a la comunidad para participar de un evento diferente

Invitación a la comunidad para participar en conferencia y comunidades

Using Numba Effectively Today

Numba is syntactically easy to use - just add a decorator, but actually very hard to use effectively. The reason being it is difficult to understand what Numba does to speed up the numeric operation. This workshop will provide all the knowledge that you need to make Numba works for you.

This workshop is for Data scientists or developers who have math-heavy code that would like to speed up with the benefit of Numpy and Numba.

What is required from attendees

• - A computer with a stable internet connection (useful to look up information);
• - Python 3.8 or above;
• - Jupyter and Numba installed (detail about Python libraries required will be announced later);
• - An opened mind and ready to learn something new

Making sense of your Data Platform with OpenMetadata

OpenMetadata is an open-source project (https://open-metadata.org/) that is building a metadata standard and a centralized and shared metadata platform on top of it. In this workshop, we will explore the tool, how it works, and bit by bit we will dive into its implementation and design.

For the folks who would like to follow along, a laptop with docker compose

TDD Coding Dojo

Nowadays software products are becoming so complex that is unimaginable that one software engineer would develop it alone without any sort of automated testing, so let’s get together to practice Test Driven Development while pair programming with the other workshop participants. We will solve some code challenges together, under a bit of friendly time pressure and changing development hats every 5 minutes. If you are interested in knowing how it all looks like then join the workshop!

Lightning talks (session 2) + closing session & Kahoot

Lightning talks

En esta charla explicaremos los aspectos fundamentales de cómo diseñar e implementar un chatbot basado en el reconocimiento de intenciones desde el punto de vista de la ingeniería de Software. Mediante un caso de uso, exploramos cómo diseñar e implementar una arquitectura que nos permita integrar y gestionar la base de conocimiento que requiere el bot para su aprendizaje, integrar un motor de reconocimiento de intenciones que sea capaz de entender a los usuarios a partir de un entendimiento contextual de una conversación e integrar un sistema de respuestas en distintos formatos (voz, texto, imágenes, vídeos).

Match the resolution of Landsat imagery to fine grained Sentinel using Deep Learning, then create dynamic evolving scenes with blender.

In this talk I’m going to introduce the trrex package, for performing efficient keyword extraction with regular expressions. Additionally I'll show how to integrate it with pandas for text cleaning, how to use it with spacy to build a gazetteer and how to perform fuzzy matching with the regex library.

The goal of the LT is to give to the audience a brief overview about DB transactions, why there are important and how to leverage them for some specific use cases where they play a critical role.

Presentation of the OptBinning library, a Python library to perform optimal binning and scorecard modelling. Description of main features, current roadmap and applications.