Location: San Mateo, California, United States
Job Summary:
Job Duties:
- Design and implement scalable, distributed systems for Iceberg transactions and data management.
- Architect integration with external Iceberg catalogs and cloud architectures.
- Develop solutions for catalog federation and query capabilities across multiple catalogs.
- Collaborate with open-source teams and enhance the Iceberg REST specification.
- Work on data access control and governance features.
- Support external query engines interfacing with Iceberg tables through Polaris.
- Build tools for automated data lake table maintenance.
Required Skills:
- Strong programming skills in Java, Scala, or C++.
- Deep understanding of distributed transaction processing.
- Familiarity with open-source data lake formats (Apache Iceberg, Parquet, Delta).
- Knowledge of data governance and security models.
Required Experiences:
- 8+ years designing and building scalable, distributed systems.
- Experience with cloud-native services and public cloud providers (AWS, Azure, GCP).
- Passion for open-source software and community engagement.
- Experience managing large-scale data lakes or catalogs in production environments (bonus).
Job URLs: