Adam Kawa is a founder and CEO with 13 years of hands-on experience building and scaling Big Data and real-time analytics companies and platforms. He co-founded GetInData and grew it from a two-person startup to a 130-person consultancy working with clients like Truecaller, Acast, ING and P&G while organizing Poland’s largest technical Big Data conference. Deeply technical, Adam cut his teeth operating and stabilizing multi-hundred-node Hadoop clusters at Spotify and contributing to the popular open-source Luigi project with Hadoop integrations and HDFS utilities. He teaches and writes prolifically on data engineering, has delivered Cloudera-authorized courses, and scores highly as a university instructor, blending practitioner knowledge with pedagogy. Beyond delivery, he runs a podcast and curates content and conferences to advance production-ready patterns in streaming, MLOps and cloud data platforms.
13 years of coding experience
8 years of employment as a software developer
Msc, Computer Science, Msc, Computer Science at University of Warsaw
Cloudera University
Bsc, Finance and Accounting, Bsc, Finance and Accounting at SGH Warsaw School of Economics
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Role in this project:
Backend Developer
Contributions:7 commits in 10 months
Contributions summary:Adam primarily contributed to the `luigi` Python module, enhancing its functionality related to Hadoop integration. Their work included adding features like the `copy`, `put`, `get`, and `getmerge` methods for interacting with HDFS, and adding support for job queue parameters for the Hadoop Capacity Scheduler. Furthermore, the user addressed code quality by refactoring and returning the stdout from the `call_check` function for improved error handling. They also added the `skip_trash` option to the remove method.
Contributions:80 commits, 1 PR, 22 pushes in 2 years 9 months
infrastructuremachine-learningsettingtrainings
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.