Summary
Ching-chuan Chen is a Senior Data Engineer with 12 years of experience specializing in reliability engineering, large-scale ETL, and data visualization across Microsoft, Trend Micro, and TSMC. He has a strong track record of cutting processing times and costs—e.g., shrinking model estimation from 2 minutes to 2 seconds, reducing pipeline runtimes from 16 to 2 hours, and moving workloads to serverless Spark to cut costs by 60%. Skilled in Spark, Azure Data Explorer, Redis, Python/Cython and Power BI, he has processed billions of records (up to 30B network events) to deliver actionable insights for hardware reliability and IoT detection. He also mentors and leads small teams, guiding interns and contractors to deliver dashboards and large migrations under tight timelines. Remarkably, his work not only accelerates analytics but also closes compliance gaps and improves product visibility during development through remote stress-testing systems.
12 years of coding experience
7 years of employment as a software developer
Bachelor's Degree, Statistics, 3.5 / 4.0, Bachelor's Degree, Statistics, 3.5 / 4.0 at National Cheng Kung University
English, Chinese, Japanese