Gideon Potok
Senior Machine Learning Engineer at Egen
New York, New York, United States
Summary
🤩
Rockstar🎓
Top SchoolGideon Potok is a Senior Machine Learning Engineer in New York with 8 years of experience building cloud-native data platforms, production ML systems, and real-time AI services. He has driven end-to-end solutions—from architecting multi-agent data science platforms on Vertex AI and BigQuery to shipping a real-time Voice AI accelerator and vision pipelines that digitized 200,000+ health records. Gideon blends strong data engineering rigor (batch & streaming ETL, cloud warehouses) with hands-on ML work that materially improved fraud/trading anomaly detection and operational efficiency at Morgan Stanley. He contributes to high-profile open-source projects like Apache Spark, improving SQL string/collation behavior and adding benchmarks, reflecting a focus on correctness and performance at scale. Comfortable at the intersection of security and ML, he has published MCP research exposing deployment risks such as tool poisoning and built reusable alignment-aware agent frameworks.
7 years of coding experience
7 years of employment as a software developer
Master's degree, Master's degree at Georgia Institute of TechnologyBachelor of Science - BS Computer Science, Bachelor of Science - BS Computer Science at University of Maryland
Hebrew, Spanish
Github Skills (12)
scala10
javas10
big-data10
spark10
sql10
java10
testing10
junit9
algorithms8
data-structures8
algorithm8
data-structure8
Programming languages (5)
Github contributions (5)
apache/spark
Nov 2018 - Sep 2024
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer & Test Automation Engineer
Back-end Developer & Test Automation EngineerContributions:141 reviews, 27 PRs, 204 comments in 5 years 11 months
Contributions summary:Gideon's contributions center around enhancing Apache Spark's SQL capabilities, specifically focusing on string functions and collation support. They implemented and tested collation support for `substr`, `left`, `right`, `lpad`, `rpad` and the `mode` expression, adding new functionalities and addressing existing limitations. The user also contributed unit tests to validate the correctness and behavior of these features, ensuring compatibility with different collation types. Furthermore, they added benchmarks to measure performance improvements.
analyticspythondata-processingsqlapache
GideonPotok/spark
Mar 2024 - Sep 2024
Contributions:4 PRs, 274 pushes, 23 branches in 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.