Prashant Pandey is a founder and seasoned software architect with a quarter-century background in IT, currently leading ScholarNest after nearly nine years of senior-architect roles including a long tenure at Tata Consultancy Services. He blends hands-on engineering and architecture in big data and telecom domains, having led Big Data COE and digital enterprise practices across major Indian technology firms. An active learner and trainer based in Noida, he contributes practical Spark-in-Python resources on GitHub that demonstrate real-world ETL, Spark SQL and unit-tested pipelines. Prashant’s work favors pragmatic, production-ready solutions—bridging database technologies, distributed processing and enterprise requirements. He pairs deep technical breadth with entrepreneurial drive, moving from senior technical leadership into building products and training the next generation. Notably, his public Spark examples reveal a commitment to reproducible data engineering and teaching.
9 years of coding experience
17 years of employment as a software developer
Master of Computer Applications - MCA Computer Software Engineering, Master of Computer Applications - MCA Computer Software Engineering at NATIONAL INSTITUTE OF ELECTRONICS & INFORMATION TECHNOLOGY (NIELIT)
Apache Spark 3 - Spark Programming in Python for Beginners
Role in this project:
Data Engineer
Contributions:40 commits, 38 pushes, 1 branch in 10 months
Contributions summary:Prashant primarily contributed to setting up and demonstrating Apache Spark programming in Python. Their commits showcase the use of Spark for data loading, transformation, and aggregation tasks. Code changes include the implementation of Spark SQL queries, UDFs, and various data sinks, alongside the development of testing using unittest framework.
Contributions:34 commits, 28 pushes, 1 branch in 2 months
apache-sparkbig-databigdatadata-lakedatalake
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.