Data Engineer II
Job Description Roles & Responsibilities What's On Your Plate? Design, build, and maintain data pipelines and workflows for batch and streaming use cases. Work with Kafka to manage real-time data ingestion and event-driven architectures. Leverage GCP and AWS services for storage, processing, and orchestration (e.g., BigQuery, Dataflow, S3, Lambda). Orchestrate workflows using tools like Airflow or similar schedulers. Ensure data quality and reliability through monitoring, alerting, and automated validation. Collaborate with analysts, data scientists, and product teams to understand requirements and deliver data solutions that drive business impact. Optimize for cost and performance across cloud environments. Participate in code reviews, documentation, and knowledge sharing to raise the bar for the team. Our Tech Stack Data Ingestion & Streaming: Apache Kafka, Kafka Connect Cloud Platforms: Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage), AWS (S3, Lambda, Glue) Workflow Orchestration: Apache Airflow Programming Languages: Python, SQL, (bonus: Java/Scala) Infrastructure & DevOps: Terraform, CI/CD pipelines, Docker Monitoring & Observability: Grafana, Prometheus, Cloud-native toolsQualifications Desired Candidate Profile What We re Looking For Experience (1-3 years) in data engineering, software engineering, or a related field. Proficiency in SQL and at least one programming language (Python preferred). Understanding of data modeling, ETL/ELT concepts, and cloud-based data warehouses. Familiarity with streaming platforms (Kafka, Kinesis, or similar). Comfort working in cloud environments (GCP, AWS, or Azure). Strong communication skills, able to explain technical concepts to non-technical audiences. Growth mindset, eager to learn, adapt, and take on new challenges.br> Nice-to-Have (But Not Required and willing to learn) Experience with infrastructure-as-code (Terraform, CloudFormation). Exposure to containerization (Docker, Kubernetes). Knowledge of data governance, security, and compliance best practices. Company Industry InternetE-CommerceDotcom Department / Functional Area IT Software Keywords Data Engineer II Get real-time job updates only on our App
Ready to apply?
You are viewing this role on JobSphere AI. Applications are completed on the original employer / source website.
Apply NowOpens the employer's site in a new tab
- Companytalabat
- LocationDubai, UAE
- CategoryCybersecurity
- SourceNaukrigulf
- Listed3 months ago
Related Cybersecurity jobs
Senior Support Engineer Digital Channels
The Senior Support Engineer Digital Channels is responsible for end-to-end production support, maintenance and enhancement of the Bank's mobile banking…
Technical Project Manager
We are looking for an experienced Technical Project Manager to lead the planning, execution, and successful delivery of software development and digital…
Registered Midwife
Midwives are recognized as a responsible and accountable professional who works in partnership with women to give the necessary support, care and advice during…
Senior Consultant PSP
This is a position focused on power systems analysis. The skill shall be applied to a large span of issues such as renewables integration, grid code compliance…