Calvin Pietersen
Software Engineer at Rokt
Greater Sydney Area Australia
Summary
👤
Senior🎓
Top SchoolCalvin Pietersen is a software engineer based in the Greater Sydney Area with a decade of experience building backend systems and data-focused applications. He has worked across consulting and product teams at firms like Rokt, Think Big (Teradata), and Avanade, bringing practical experience in data engineering and enterprise solutions. Calvin contributed to the notable open-source Kylo data lake platform, improving Spark validators, partitioning, and Avro schema discovery to strengthen data validation and feed management. His background in business information technology and accounting gives him a pragmatic edge in aligning technical work with business needs and data governance. Known for quietly improving robustness and maintainability, he often focuses on refactoring and parameterization to make systems easier to operate at scale. He balances hands-on development with a systems-level view that helps teams turn messy data problems into reliable workflows.
10 years of coding experience
5 years of employment as a software developer
Diploma, Information Technology, Diploma, Information Technology at Great Southern Institute of TechnologyBachelor of Commerce (B.Com.), Business Information Technology, Bachelor of Commerce (B.Com.), Business Information Technology at Curtin University
Stackoverflow
141reputation
3kreached
1answer
2questions
Github Skills (14)
javas10
spark10
java10
data-engineering10
hadoop9
data-lake9
avro8
sql8
http-client6
apache-spark6
exceptions6
out-of-memory6
post6
tcp6
Programming languages (9)
Github contributions (5)
Teradata/kylo
Jan 2017 - Jun 2017
Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:27 commits, 6 PRs, 5 comments in 4 months
Contributions summary:Calvin primarily focused on optimizing and refactoring the Spark validator application within the Kylo data lake management platform. Their work involved removing unused SQL context, parameterizing storage levels, and addressing double-counting issues in accumulators. They also enhanced the platform by adding the TO_DATE partition function and integrating Avro schema discovery for feed creation. The user's contributions improved data validation and feed management capabilities.
data-lakelicensedbig-dataetlapache-spark
calvin-pietersen/gossip-mesh
Oct 2018 - Jun 2019
Gossip framework for mesh networking
Contributions:110 commits, 8 PRs, 140 pushes in 8 months
meshnetworkinggossip
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.