Data Engineer
- Grid Dynamics
- 4 - 9 years
- Bengaluru
- 6 days ago
- Email to a friend
- Report this job
Job Description
Required Qualifications:
- 4+ years of professional experience in data engineering and data analysis roles.
- Strong proficiency in SQL and experience with database management systems such as MySQL, PostgreSQL, Oracle, and MongoDB.
- Hands-on experience with big data tools like Hadoop and Apache Spark.
- Proficient in Python programming.
- Experience with data visualization tools such as Tableau, Power BI, and Jupyter Notebooks.
- Proven ability to design, build, and maintain scalable ETL pipelines using tools like Apache Airflow, DBT, Composer (GCP), Control-M, Cron, and Luigi.
- Familiarity with data engineering tools including Hive, Kafka, Informatica, Talend, SSIS, and Dataflow.
- Experience working with cloud data warehouses and services (Snowflake, Redshift, BigQuery, AWS Glue, GCP Dataflow, Azure Data Factory).
- Understanding of data modeling concepts and data lake/data warehouse architectures.
- Experience supporting CI/CD practices with Git, Docker, Terraform, and DevOps workflows.
- Knowledge of both relational and NoSQL databases, including PostgreSQL, BigQuery, MongoDB, and DynamoDB.
- Exposure to Agile and DevOps methodologies.
- Experience with at least one cloud platform:
- Google Cloud Platform (BigQuery, Dataflow, Composer, Cloud Storage, Pub/Sub)
- Amazon Web Services (S3, Glue, Redshift, Lambda, Athena)
- Microsoft Azure (Data Factory, Synapse Analytics, Blob Storage)
Essential functions
Key Responsibilities:
- Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools.
- Build and optimize data architectures including data lakes and data warehouses.
- Integrate data from multiple sources ensuring data quality and consistency.
- Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical solutions.
- Analyze complex datasets to identify trends, generate actionable insights, and support decision-making.
- Develop and maintain dashboards and reports using Tableau, Power BI, and Jupyter Notebooks for visualization and pipeline validation.
- Manage and optimize relational and NoSQL databases such as MySQL, PostgreSQL, Oracle, MongoDB, and DynamoDB.
- Work with big data tools and frameworks including Hadoop, Spark, Hive, Kafka, Informatica, Talend, SSIS, and Dataflow.
- Utilize cloud data services and warehouses like AWS Glue, GCP Dataflow, Azure Data Factory, Snowflake, Redshift, and BigQuery.
- Support CI/CD pipelines and DevOps workflows using Git, Docker, Terraform, and related tools.
- Ensure data governance, security, and compliance standards are met.
- Participate in Agile and DevOps processes to enhance data engineering workflows.
Qualifications
Data Engineer with experience in MySQL or SQL or PL/SQL and any cloud experience like GCP or AWS or Azure
Would be a plus
Preferred Skills:
- Strong problem-solving and communication skills.
- Ability to work independently and collaboratively in a team environment.
- Experience with service development, REST APIs, and automation testing is a plus.
- Familiarity with version control systems and workflow automation.
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Grid DynamicsLocation(s): Bengaluru+ View Contact
Keyskills: Data analysis Automation Data modeling MySQL Workflow Informatica Oracle Apache SSIS Analytics
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Grid Dynamics
NextSphere is full-service custom application development firm that helps customers grow and keep up, in a constantly changing technology landscape. We at NextSphere develop and support business applications for customers in wide range of industries. We strive to work on projects where the NextSpher...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in