GCP Data Engineer
Capco · Posted today
- Bengaluru, Karnataka, India (Hybrid)
- Full-time
- 8-12 yrs
About the role
Job Title: GCP Data Engineer
Location - Bangalore , Hyderabad , Chennai
About Us
“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.
WHY JOIN CAPCO?
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
MAKE AN IMPACT
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.
#BEYOURSELFATWORK
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
CAREER ADVANCEMENT
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.
DIVERSITY & INCLUSION
We believe that diversity of people and perspective gives us a competitive advantage.
Role Overview
We are looking for an experienced GCP Data Engineer with strong hands-on expertise in designing, building, and supporting distributed systems and large-scale data processing solutions in production.
The ideal candidate should have strong experience in GCP data products, batch and real-time data pipelines, programming, big data technologies, and CI/CD automation.
Key Responsibilities & Requirements
- 8–12 years of hands-on experience in GCP Data Engineering, with proven experience designing, building, and supporting distributed systems and large-scale data processing systems in production.
- Strong expertise in GCP Data Products, including:
- BigQuery
- Dataflow
- Cloud Storage
- Pub/Sub
- Cloud Composer
- Apache Kafka
- Hands-on experience building batch and streaming data pipelines on Google Cloud.
- Strong commercial/industry experience with Python, SQL, Java, Scala, or Go.
- Strong SQL skills with the ability to write complex queries.
- Experience with operational data stores, data warehouses, big data technologies, and data lakes.
- Hands-on experience with distributed processing frameworks such as:
- Spark
- Flink
- Apache Beam
- Hadoop
- Good knowledge of Docker, Kubernetes, and cloud platforms such as GCP, AWS, or Azure.
- Strong experience with real-time streaming technologies, particularly Apache Kafka.
- Experience with automation and CI/CD, including Jenkins, GitHub, and Spinnaker.
- Strong understanding of data structures, algorithms, software design, design patterns, and core programming concepts.
- Good client-handling and stakeholder-management skills, with the ability to lead a feature team and deliver outcomes.
Preferred / Good to Have
- GCP certifications such as:
- Professional Cloud Architect
- Professional Cloud Developer
- Professional Data Engineer
- Apache Kafka CCDAK certification