Pau Crespí
Software Engineer at Port d'Informació Científica
Barcelona, Catalonia, Spain
Summary
👤
Senior🎓
Top SchoolPau Crespí is a seasoned software engineer with 13 years of experience building high-performance systems for scientific research, currently designing and integrating databases for the PAU survey project at Port d'Informació Científica in Barcelona. He combines deep HPC and Linux expertise with hands-on Python and big-data tooling (Hive, Spark) to deliver robust data pipelines and backend integrations. Pau has contributed notable enhancements to the widely used PyHive library—updating HiveServer2 Thrift bindings and adding async query control, logging and progress monitoring—highlighting his focus on operability and compatibility. His background spans system administration, web and mobile tooling, and bespoke desktop applications, reflecting a pragmatic, full-stack engineering approach. Comfortable in open-source ecosystems and academic environments, he blends research-grade rigor with production-oriented software craftsmanship.
13 years of coding experience
3 years of employment as a software developer
Engineer's degree, Computer Science, A, Engineer's degree, Computer Science, A at Universitat de les Illes BalearsMaster's degree in HPC, Computer Science, A, Master's degree in HPC, Computer Science, A at Universitat Autònoma de Barcelona
Catalan, Spanish, English
Github Skills (10)
databases10
hive10
database-api10
thrift10
presto10
python10
database10
async9
asynchronous9
sqlalchemy8
Programming languages (6)
Github contributions (5)
dropbox/PyHive
May 2016 - Jul 2017
Role in this project:
Back-end Developer
Back-end DeveloperContributions:5 commits, 7 PRs, 23 comments in 1 year 2 months
Contributions summary:Pau primarily focused on enhancing the `pyhive` library, specifically by updating Thrift bindings and adding functionality for asynchronous query execution, log retrieval, and query cancellation. They also modified the code to retrieve progress updates when polling cursors, indicating a focus on improving query monitoring and control. Furthermore, the user updated the HiveServer2 Thrift bindings to v11, suggesting a role in maintaining the library's compatibility with Hive and Presto.
pythonsqlalchemyhiveserver2python-interfacedbapi
ptallada/pic-hadoop-udf
Oct 2019 - May 2024
Contributions:14 pushes, 1 branch in 4 years 7 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.