Software Engineer III, Infrastructure, Conduit Flume Pipelines
8 Tage altAngaben zum Job
| Firma | |
| Kategorie | Informatik | Pensum | 100% |
| Einsatzort | Zürich |
Job-Inhalt
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
- 2 years of experience with data structures or algorithms.
- 2 years of experience with developing infrastructure, distributed systems or networks, or with compute technologies, storage or hardware architecture.
- Experience developing software applications using the C++ programming language.
- Experience with object-oriented programming, templates, and the Standard Template Library (STL).
Preferred qualifications:
- Experience in operating and managing flume pipelines.
- Experience with ML data processing workflows.
About the job
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.
Responsibilities
- Build components of a managed system that handles deployment, scheduling, launching, monitoring and debugging of Flume jobs.
- Deliver new features to expand the set of use cases that Conduit Flume Pipelines (CFP) can serve, including support for data processing for Machine Learning (ML).
- Build core orchestration libraries in C++, define and extend public Application Programming Interface (APIs) in C++, Python, Java and Go.
- Work with the underlying infrastructure teams (e.g., Conduit, Flume, Data Engineering Console, Table Service) to integrate with their APIs, define requirements for new features and make code contributions to their codebases.
- Make smaller contributions to Dreampipe to continue supporting the most important new use cases.