Rahul Potharaju
Director Of Engineering at Databricks
San Francisco, California, United States
Summary
🤩
Rockstar🎓
Top SchoolRahul Potharaju is a Director of Engineering at Databricks with 12+ years building planet-scale data and analytics platforms, specializing in Delta Lake, Spark runtimes, and storage systems. A founding member of Azure Synapse Analytics, he led Spark reliability, performance and GPU-accelerated runtimes for hyperscale customers and helped open-source projects like Hyperspace and .NET for Apache Spark. His career blends deep research (PhD from Purdue) and product engineering, contributing to systems such as Cosmos, Azure Data Lake, and a hyperscale indexing system that processes quadrillions of events. Rahul has authored papers at VLDB/NSDI/SoCC and holds 30+ patents, reflecting a knack for turning research into production impact. Based in San Francisco, he pairs hands-on full‑stack contributions (notably Spark.NET notebooks and Delta Lake GDPR examples) with cross-company collaborations across academia and industry.
12 years of coding experience
17 years of employment as a software developer
Jawaharlal Nehru Technological University HyderabadPhD, Computer Science, PhD, Computer Science at Purdue UniversityMS, Computer Science, MS, Computer Science at Northwestern University
Github Skills (13)
net10
asp-net10
notebook10
apache-spark10
dotnet10
delta-lake10
csharp10
dotnet-core10
azure-synapse-analytics10
dataframe9
pyspark9
dataframes9
sql8
Programming languages (8)
Github contributions (5)
Azure-Samples/Synapse
Apr 2020 - May 2020
Role in this project:
Full-stack Developer
Full-stack DeveloperContributions:3 reviews, 6 commits, 4 PRs in 21 days
Contributions summary:Rahul primarily contributes to the .NET for Apache Spark examples within the Azure Synapse Analytics repository. Their work focuses on creating and updating tutorials and notebooks, specifically for Spark.NET, showcasing how to interact with Apache Spark using C# and the .NET framework. They are also responsible for implementing features like using Delta Lake for updates and GDPR compliance, demonstrating a range of skills from data manipulation to applying database operations.
azure-synapse-analyticsanalyticsazure-synapsesynapse-analyticsazure
johnpaulada/spark
Jun 2019 - Jul 2020
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Contributions:4 pushes in 1 year 1 month
dotnetaccessibleapachesparkapache-spark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.