Igor Dvorzhak
Staff Software Engineer at Google
San Francisco Bay Area United States
Summary
🤩
Rockstar🎓
Top SchoolIgor Dvorzhak is a Staff Software Engineer based in the San Francisco Bay Area with 10 years of experience designing and operating large-scale distributed systems and big data platforms. As tech lead for Google Cloud Dataproc and Dataproc Serverless, he blends backend engineering, DevOps, and operational leadership to make Hadoop and Spark ecosystems run reliably on GCP. His open-source contributions to GoogleCloudDataproc projects include upgrading Hadoop connectors for GCS and BigQuery and improving HDFS compliance and build pipelines—work that directly impacts production clusters at scale. Trained with a Master’s (with honors) in Computer Science from NTUU KPI, he brings a pragmatic, systems-first approach and a knack for automating cluster lifecycle and monitoring tasks that keep data platforms healthy.
10 years of coding experience
5 years of employment as a software developer
Igor Sikorsky Kyiv Polytechnic Institute
English, Ukrainian, Russian
Stackoverflow
4,423reputation
152kreached
180answers
4questions
pyspark
top-5%
google-cloud-storage
top-5%
apache-spark
top-5%
google-cloud-platform
top-5%
Github Skills (23)
google-cloud-platform10
google-cloud-dataproc10
apache-hadoop10
bash10
hadoop10
java10
gcp10
javas10
script10
google-cloud10
devops10
bigquery9
apache-spark9
pyspark9
google-cloud-storage9
Programming languages (11)
Github contributions (5)
GoogleCloudDataproc/hadoop-connectors
Aug 2017 - Jan 2023
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:33 releases, 631 reviews, 886 commits in 5 years 6 months
Contributions summary:Igor primarily contributed to improving the interoperability between Hadoop-related open-source software and Google Cloud Platform, based on the repository description and topics. Their work involved fixing bugs and ensuring HDFS compliance, particularly in Hadoop 2.8 and 2.9, as shown by the commit messages. The user also made code improvements and handled tasks involving creating and setting up build pipelines.
hadoop-filesystemgoogle-cloud-platformbigqueryhadoop-hcfsinteroperability
GoogleCloudDataproc/initialization-actions
Mar 2018 - Sep 2022
Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
Role in this project:Backend & DevOps Engineer
Backend & DevOps EngineerContributions:203 reviews, 190 commits, 505 PRs in 4 years 6 months
Contributions summary:Igor primarily focused on improving the initialization actions for a Google Cloud Dataproc cluster, specifically regarding Apache Hadoop connectors for GCS and BigQuery. The contributions included adding support for the newest connector versions, independently updating the connectors, and restarting Dataproc agent service after the connector updates. Additionally, the user worked on configuring and installing the Ganglia monitoring tool, ensuring proper setup for the master node in HA mode.
nodesgoogle-cloud-dataprockubernetescustomizeterraform
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.