Arpit Solanki
Data Engineer
Summary
🤩
RockstarArpit Solanki is a data engineer with 10 years of hands-on experience building reliable data preparation and integration solutions. He contributes to open-source tooling—most notably enhancing the optimus project with Presto connectivity and richer data-type profiling (ip, url, credit_card_number, zip_code)—demonstrating practical expertise in database integrations and data quality. Comfortable with Pandas, Dask, cuDF and PySpark ecosystems, he focuses on making ETL workflows more robust and scalable. Based in India, Arpit combines production-focused engineering with community contribution, often improving JDBC interactions and type inference in real-world data pipelines. Pragmatic and detail-oriented, he brings a blend of tool-level improvements and system-level thinking to data engineering challenges.
11 years of coding experience
Stackoverflow
9,707reputation
1.4mreached
238answers
3questions
django
top-1%
scrapy
top-5%
django-models
top-5%
django-urls
top-5%
github
top-5%
python
top-5%
Github Skills (31)
spark10
python10
django10
data-engineering10
jdbc10
datatypes9
markdown9
github9
presto9
sql9
django-rest-framework9
django-models9
nodejs9
django-templates9
scrapy9
Programming languages (15)
Github contributions (5)
hi-primus/optimus
Jul 2019 - Sep 2019
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Role in this project:
Data Engineer
Data EngineerContributions:13 commits, 5 PRs, 1 push in 1 month
Contributions summary:Arpit primarily contributed to enhancing the `optimus` project, which focuses on data preparation workflows. Their work includes adding support for connecting to a Presto query engine, demonstrating database interaction skills. Further contributions include adding new data types such as "ip", "url", "credit_card_number", and "zip_code" as data types, improving the data profiling capabilities of the project. The user's changes touch on JDBC connections and improving data type identification, aligning with data engineering tasks.
agilecudfdaskpandaspyspark
arpit1997/PQusic
Aug 2016 - Mar 2018
Contributions:1 release, 110 commits, 46 pushes in 1 year 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.