Sourced Job
Associate Data Engineer
Nagavara, Bangalore
2 years
Amazon S3AWS IAM user and policy managementAmazon API GatewayAWS Elastic Kubernetes Service (EKS)Amazon EC2AWS Elastic MapReduce (EMR)AWS LambdaAWS CloudFormationSQL (Postgres)Oracle SQL++Microsoft SQL ServersPython courseJava (Programming Language)ScalaApache KafkaKafkaKSQLDBApache KafkaDockerKubernetesJenkinsApache AirflowCI/CDGit (Version Control System)Data ModelingDatabase DesignAgile Methodology
Job Description:
Technical skills:
- AWS – S3, IAM, API Gateway, EKS, EC2, EMR, Lambda, Cloud formation etc.,
- SQL – snowflake or other cloud data warehouse solutions, Oracle, MS SQL server
- Python, Java, Scala
- Kafka, Kafka streams, KSQL DB, Kafka connect preferably confluent kafka
- Docker, Kubernetes, Jenkins, Airflow
Work Experience:
- 1+ years of total IT experience preferably in field of data engineering.
- 1+ years experience with AWS services such as IAM, API gateway, EC2, S3, EMR, Lambda, EKS etc.
- 1+ years experience in creating and deploying docker containers on Kubernetes.
- 1+ years experience with CI/CD pipelines tools such as Jenkins and Github actions.
- 1+ years experience with Snowflake data warehousing and data lake solutions.
- Strong programming skills in Python, Java or Scala.
- Very strong experience with SQL and NO SQL data bases
- Knowledge of data modelling and database design principles
- Experience with GIT d other version control systems
- Knowledge of Agile methodologies and software development lifecycle processes.
