Freerk Venhuizen is a senior data scientist with broad experience across the entire field of data science, ranging from data engineering, exploration and modelling, up to productionalizing and operating a data product. In his current position at Rabobank he is involved in building, designing and improving the various transaction enrichment models that power the financial insight features in the Rabobank app. In his earlier career he worked at the Radboud University Medical center to develop deep learning based methods for detection, segmentation and quantification of diseases in three-dimensional images of the human retina.
Can we have the best of both worlds? Can the same (Python) codebase achieve a low latency in a realtime setup (API) and -at the same time- have high throughput to process big data (batch)? At the RATE Periodicity team we have combined Polars and PySpark to get high performance in both situations! We currently […]