Sudarshan Vasudevan
Research Scientist at LinkedIn
Mountain View, California, United States
Summary
🤩
RockstarSudarshan Vasudevan is a Research Scientist based in Mountain View with nine years of experience building large-scale distributed systems. He combines hands-on backend engineering with research-oriented problem solving, focusing on reliable data integration and pipeline correctness. His open-source work on Apache Gobblin includes implementing a concurrent FlowGraph structure and fixing nuanced multi-hop flow compilation bugs, showing attention to concurrency and edge-case data completeness. Comfortable in both production engineering and exploratory research, he bridges core systems design with practical fixes that improve real-world data workflows. Outside of work he balances technical rigor with family life as a dad and mentor, often sharing lessons learned with the developer community.
9 years of coding experience
Github Skills (12)
javas10
data-structures10
data-pipeline10
data-pipelines10
data-structure10
java10
data-integration9
apache9
concurrency9
mapreduce8
hadoop-mapreduce8
big-data8
Programming languages (2)
Github contributions (5)
apache/gobblin
Aug 2018 - Aug 2021
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:298 reviews, 92 commits, 283 PRs in 3 years
Contributions summary:Sudarshan contributed to the Apache Gobblin data integration framework, specifically focusing on the implementation and improvement of core data structures and functionalities. They implemented a concurrent data structure, the FlowGraph, and added logic to handle data completeness checks, addressing potential issues with partitioned data with no records. They also fixed a bug in the multi-hop flow compiler related to path finding and handling single-hop paths. The contributions spanned multiple core components of the framework, including the core logic for building and managing data pipelines.
datadcosdata-streambig-data-integrationbatch-data
sv2000/incubator-gobblin
Dec 2017 - Aug 2021
Gobblin is a distributed big data integration framework (ingestion, replication, compliance, retention) for batch and streaming systems. Gobblin features integrations with Apache Hadoop, Apache Kafka, Salesforce, S3, MySQL, Google etc.
Contributions:533 pushes, 179 branches in 3 years 9 months
salesforceretentionbig-data-integrationcompliancekafka-connect
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.