Niranjan J is a Staff Software Engineer based in Berlin with 9 years of experience building developer tools and cloud infrastructure at scale. He has led major initiatives at Databricks and AWS, including tech leadership for Databricks Connect and shepherding AWS CDK v2 from planning to developer preview while launching a unit-testing module that improved CDK testability. His contributions span distributed systems, developer productivity, and serverless platforms—driving features like Lambda Python support, Lambda Layers design, and a Cognito CDK module that boosted adoption dramatically. An active open-source contributor, he has improved core projects such as aws-cdk (S3 validation and version checks) and Apache Spark’s PySpark Connect (better error handling and client metadata). Colleagues rely on him for cross-team architecture, mentoring senior engineers, and turning complex platform problems into pragmatic, testable solutions. He combines deep systems design with a knack for developer experience, evidenced by both production launches and community-driven merges.
9 years of coding experience
12 years of employment as a software developer
M.Sc Software Engineering, M.Sc Software Engineering at PSG College of Technology
The AWS Cloud Development Kit is a framework for defining cloud infrastructure in code
Role in this project:
Backend Developer
Contributions:1680 reviews, 61 commits, 563 PRs in 2 years
Contributions summary:Niranjan primarily focused on enhancing the AWS Cloud Development Kit (CDK) by adding crucial validations for S3 bucket names, ensuring compliance with AWS S3 naming conventions. Their work involved modifying existing TypeScript code, adding test cases to validate bucket name formats, and integrating new error messages. Additionally, the user contributed to the CDK toolkit, implementing a feature to notify users of new CDK versions. This included adding unit tests and optimizing the version check for efficient execution.
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Contributions:42 reviews, 1 commit, 20 PRs in 1 day
Contributions summary:Niranjan primarily contributed to the PySpark Connect component of the Apache Spark project. Their work involved implementing features, addressing bugs, and improving the error handling of the Spark Connect client. Specifically, they focused on enhancements such as adding user agent information, exposing client properties, and resolving issues related to session management and UDF failures within the Connect framework. They also worked on the underlying infrastructure and error messages, optimizing them to be more informative for the user.
analyticspythondata-processingsqlapache
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Niranjan J - Staff Software Engineer at Databricks