André Pires is a Staff Software Data Engineer with a decade of experience designing and operating large-scale data platforms, currently advancing security ratings pipelines at BitSight. He specializes in distributed systems and big data technologies—Spark, Kafka, Hadoop/EMR, Iceberg and modern Azure/Databricks cloud stacks—building reliable, production-grade pipelines and data mesh integrations. His background spans end-to-end architecture, hands-on development, and mentoring teams for clients across banking, telecom and retail. He combines research experience from INESC-ID and teaching at Instituto Superior Técnico with a pragmatic focus on delivering daily data products at scale (supporting ratings for ~1M companies). Outside work he runs a home lab cluster (Proxmox, K3s, Home Assistant, PiHole) where he experiments with edge/cloud patterns, reflecting a practical curiosity about bringing distributed systems concepts to the home. Practical, system-minded and curious, he thrives at the intersection of research, architecture and operational delivery.
11 years of coding experience
9 years of employment as a software developer
Master's Degree in Computer Science and Engineering, Computer Science and Engineering, Master's Degree in Computer Science and Engineering, Computer Science and Engineering at Instituto Superior Técnico
Vehicle Maintenance Manager - used to manage the maintenance of a set of vehicles
Contributions:46 pushes, 1 branch, 1 issue in 2 years 11 months
vehiclevehiclesmaintenance
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.