Yongqiang Duan
Senior Engineer - Data Platform
Shenzhen, Guangdong Province, Australia
Summary
👤
Senior🎓
Top SchoolYongqiang Duan is a Senior Engineer specializing in cloud-native data platforms with over 10 years of experience designing and operating real-time streaming pipelines and infrastructure automation. He has built production systems across AWS, GCP, Azure and Kubernetes—implementing Kafka/Flink, Snowflake/BigQuery, and IaC with Terraform/Ansible—while architecting monitoring, security, and CI/CD for high-availability environments. At Xero and Pepperstone he delivered user behavior and risk-management pipelines, combining Golang, Python and serverless patterns to bridge analytics and operational systems. His background spans consultancy and product teams, from end-to-end ML pipeline POCs on GCP Kubeflow to large-scale order management deployments using Consul, Nomad and Vault. Fluent in both software and infra, he often moves between building operators and low-level tooling (KubeBuilder, custom K8s operators) and driving product-facing APIs and data warehouses. Based in Shenzhen and educated at Shanghai Jiao Tong University, he balances deep academic training with practical, hands-on delivery across continents.
10 years of coding experience
16 years of employment as a software developer
Bachelor computer science, Bachelor computer science at Tianjin UniversityPh.D computer science, Ph.D computer science at Shanghai Jiao Tong University
English, Chinese
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (17)
telegram-bot-api9
telegram-bot9
aiogram9
bot-framework9
python8
api8
async7
asynchronous7
telegram7
aiohttp6
asyncio5
markdown3
macos2
css1
telegraph1
Programming languages (1)
Github contributions (5)
Yyonging/musicFromHeart
Feb 2016 - Jun 2020
Contributions:6 commits, 5 pushes, 1 branch in 4 years 4 months
Yyonging/telegrambot
May 2020 - Jun 2020
a telegram bot for my daily
Contributions:1 PR, 71 pushes, 1 branch in 1 month
telegramtelegram-botbot
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.