BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Role in this project:
Back-end Developer Contributions:27 releases, 809 reviews, 359 commits in 3 years 5 months
Contributions summary:David primarily contributed to the BigQuery connector, specifically focusing on write support, which included adding the functionality to write Spark DataFrames into BigQuery tables. Their work involved code modifications to support different save modes, intermediate data formats (Parquet and ORC), and the addition of new features like support for the BigQuery Storage Write API. Additionally, they made several updates related to dependency versions and code cleanup.
apache-sparkbigquerydataframedataframes
Contributions:5 pushes, 1 branch in 2 years 5 months