Deepak Jaiswal
Software Engineering Manager at The Apache Software Foundation
California, United States
Summary
🤩
Rockstar🎓
Top SchoolDeepak Jaiswal is a software engineering manager in California with eight years of experience leading large-scale data infrastructure and workflow systems at LinkedIn. He has deep backend and distributed-systems expertise, having led Azkaban modernization toward Kubernetes and now building hyperscale offline storage supporting exabytes of data. Prior to LinkedIn he focused on query performance and execution-level optimizations in Apache Hive and Cloudera, contributing notable fixes to Tez compilation and ACID-aware data loading. His open-source contributions to widely used projects like Azkaban and Apache Hive show a pragmatic focus on stability, race-condition fixes, and operational observability. He holds M.Tech and B.Tech degrees from IIT Kharagpur and brings a strong track record of shipping production-hardened systems across database, OLTP, and data-warehouse products. Known for blending hands-on engineering with team leadership, he often surfaces subtle correctness and robustness improvements that pay off at hyperscale.
8 years of coding experience
17 years of employment as a software developer
Master of Technology (M.Tech.) Computer Science and Engineering, Master of Technology (M.Tech.) Computer Science and Engineering at Indian Institute of Technology, Kharagpur
Github Skills (14)
javas10
configuration-management10
big-data10
logging10
sql10
apache-hive10
java10
hadoop9
tez9
workflow-engine9
databases8
scheduling8
database8
devops8
Programming languages (2)
Github contributions (5)
azkaban/azkaban
Apr 2019 - Sep 2022
Azkaban workflow manager.
Role in this project:
Back-end & DevOps Engineer
Back-end & DevOps EngineerContributions:2 releases, 526 reviews, 97 commits in 3 years 6 months
Contributions summary:Deepak primarily contributed to the Azkaban workflow manager by implementing auto-reloading of configuration files upon changes, utilizing WatchService for file monitoring. They fixed race conditions and improved the stability of the configuration reload mechanism. Furthermore, the user added and improved logging for triggers and implemented mechanisms to properly handle and propagate exceptions within the Hadoop job type.
workflow-engineschedulingazkabanworkflow
apache/hive
Aug 2017 - Mar 2019
Apache Hive
Role in this project:Back-end Developer
Back-end DeveloperContributions:93 commits in 1 year 6 months
Contributions summary:Deepak primarily contributed to the Apache Hive project by addressing critical bugs and implementing features related to query optimization and data loading. Their work includes improvements to the Tez compiler, particularly in semi-join optimization and the handling of bucket map joins. Furthermore, the user implemented enhancements to the "load data" statement, enabling file renaming and managing ACID table properties, specifically related to partitioning and bucketing. They demonstrate strong understanding of Hive's internal mechanisms and the complexities of data processing.
flinksqlapachebig-dataspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.