Steve Loughran
Member Of Technical Staff at Apache Software Foundation
Bristol, England, United Kingdom
Summary
🤩
Rockstar🎓
Top SchoolSteve Loughran is a seasoned distributed-systems engineer with 24 years' experience building and testing datacentre-scale platforms, currently a Member of Technical Staff at Cloudera and long-time contributor to the Apache Hadoop and Spark ecosystems. He specializes in deployment, scalability, reliability and test-centric development, and has authored advanced distributed testing infrastructures used in production cloud platforms. Active in Apache projects for decades, he combines deep backend and DevOps expertise (including Windows support for Hadoop) with hands-on work fixing YARN, HDFS and integration issues across Spark, Hive and HBase. Known for pragmatic, no-nonsense collaboration, he prefers working relationships he’s met and keeps a strict focus on critical PRs and issues.
24 years of coding experience
30 years of employment as a software developer
BSc(Hons) 1st Class, BSc(Hons) 1st Class at The University of Edinburgh
Stackoverflow
13,078reputation
2.2mreached
566answers
0questions
hadoop
top-1%
amazon-web-services
top-1%
pyspark
top-5%
amazon-s3
top-1%
scala
top-5%
rdd
top-5%
Github Skills (44)
apache-spark10
filesystem10
spark10
azure-storage-file10
testing10
windows10
big-data10
hdfs10
hadoop10
batchfile10
amazon-web-services10
java10
scala10
aws-sdk10
file-api10
Programming languages (14)
Github contributions (5)
apache/hadoop
Mar 2009 - Dec 2022
Apache Hadoop
Role in this project:
Back-end Developer
Back-end DeveloperContributions:2217 reviews, 1034 commits, 1384 PRs in 13 years 11 months
Contributions summary:Mingliang Liu primarily contributed to the Azure-related features of Apache Hadoop. His work focused on enhancing the robustness and reliability of the Hadoop-Azure integration, addressing failure scenarios and improving file handling within the ABFS storage system. These enhancements include resolving issues where the source directory might not exist during rename operations or where access could be restricted and addressing failures in directory structure deletion.
apachebig-datasparkhadoopjava
steveloughran/winutils
Sep 2015 - Nov 2022
Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)
Role in this project:Back-end Developer
Back-end DeveloperContributions:2 releases, 25 commits, 1 PR in 7 years 3 months
Contributions summary:Steve's contributions primarily involve adding and modifying Windows binaries, specifically `.cmd` and `.exe` files, related to Hadoop YARN commands. These changes include updates for various Hadoop versions (2.6.0, 2.6.3, 2.6.4, 2.7.1, 2.8.0-RC3, 2.8.1, 2.8.3, and 3.0.0), indicating a focus on providing Windows support for Hadoop functionalities like yarn.cmd and winutils.exe. The user has also been responsible for merging updates and incorporating new binaries to reflect the latest Hadoop releases. These changes ensure Windows-based users can leverage Hadoop's functionality.
windowsbinariesasfcommithadoop
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.