Niel Markwick

Brussels Metropolitan Area Belgium

Join Prog.AI to see contacts

Summary

🤩

Rockstar

Niel Markwick is a backend software engineer with eight years’ experience focused on high-performance, cloud-native data processing and integrations from Brussels. He contributes to Apache Beam, where his work on the SpannerIO connector improved batching, streaming support, memory handling, and schema preparation—demonstrating a knack for making critical storage integrations more reliable at scale. Comfortable deep in systems-level Java and distributed pipeline concerns, he balances performance tuning with pragmatic documentation and edge-case handling. Niel publishes practical GCP-focused solutions at gcp.solutions, signaling both applied cloud expertise and a commitment to sharing operational lessons.

8 years of coding experience

Stackoverflow

Stats

2,274reputation

1.1mreached

58answers

1question

Badges

google-cloud-platform

top-5%

Github Skills (20)

java10

google-cloud-spanner10

javas10

apache-beam10

batch-processing10

google-cloud-platform9

data-stream9

data-pipelines9

streaming-data9

streaming9

data-pipeline9

stream-processing9

stream9

data-streaming9

sql8

Programming languages (12)

TypeScriptSmartyHCLJavaDockerfileC++ShellCSS

Github contributions (5)

apache/beam

Sep 2018 - Jun 2022

Apache Beam is a unified programming model for Batch and Streaming data processing.

Role in this project:

Back-end Developer

Contributions:52 reviews, 30 commits, 39 PRs in 3 years 9 months

Contributions summary:Niel's commits primarily focus on improving the performance and functionality of the SpannerIO integration within the Apache Beam project. Their work includes optimizing batching processes, adding support for streaming pipelines, and addressing memory allocation issues. The user also introduced a feature to handle database schema preparation and improved documentation around SpannerWriteResult. Furthermore, the user addressed edge cases related to null values when encoding key columns, enhancing the reliability of the SpannerIO connector.

golangpythonstreaming-databeambatch

GoogleCloudPlatform/docker-clamav-malware-scanner

Oct 2021 - Dec 2022

Contributions:11 releases, 47 reviews, 23 commits in 1 year 1 month

Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.

Request Free Trial