Andreas Neumann
Senior Staff Software Engineer at The Apache Software Foundation
San Francisco, California, United States
Summary
👤
Senior🎓
Top SchoolAndreas Neumann is a Senior Staff Software Engineer based in San Francisco with 14 years of experience designing and shipping large-scale data platforms and distributed systems. Currently the Technical Lead for Declarative Pipelines at Databricks, he blends deep backend and data-engineering expertise with product-facing leadership gained from founding engineering roles and driving migrations of CDAP to Google Cloud DataFusion. His background spans Hadoop-era architecture at Yahoo to building CDAP as Cask’s chief architect and launching it as a managed Google Cloud service, showing rare end-to-end ownership from research to production. An active Apache committer (Twill, Tephra) and contributor to the CDAP open-source project, he has hands-on experience optimizing storage and partitioned file set interactions in Java-based data frameworks. Colleagues rely on him for pragmatic architectural vision that balances performance, portability and developer ergonomics.
13 years of coding experience
24 years of employment as a software developer
Dr. rer. nat. Computer Science, Dr. rer. nat. Computer Science at Universität TrierDiploma Computer Science, Diploma Computer Science at TU Dortmund UniversityAbitur Mathematics French, Abitur Mathematics French at Otto Pankok
German, English, French, java
Stackoverflow
5reputation
0reached
0answers
0questions
Github Skills (12)
data-engineering10
javas10
filesystem10
api10
data-management10
apidoc10
java10
data-set10
datasets10
hadoop8
avro8
hbase7
Programming languages (7)
Github contributions (5)
cdapio/cdap
May 2012 - Jun 2019
An open source framework for building data analytic applications.
Role in this project:
Back-end Developer & Data Engineer
Back-end Developer & Data EngineerContributions:2771 commits, 616 PRs, 1330 pushes in 7 years 1 month
Contributions summary:Andreas's commits indicate a focus on back-end development, primarily involving Java code and interactions with file system components. The user implemented features related to reading and writing data in a partitioned file set, as well as building an API for managing datasets within the CDAP environment. These contributions involved working on code to enhance the interaction between the system and various storage elements, implying data engineering skills. The commits reveal an understanding of dataset properties, performance optimization, and the intricacies of handling non-ASCII strings.
integrationpythonanalyticsanalyticjava-8
cdapio/cdap-clients
Sep 2014 - Apr 2019
Clients to interact with CDAP in multiple languages
Contributions:11 commits, 6 PRs, 8 pushes in 4 years 7 months
interactmultiple-languagescdaplanguagesclients
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.