Big Data Engineer | Immediate Joiners | To The New
- TO THE NEW
- 4 - 6 years
- Noida, Gurugram
- 6 days ago
- Email to a friend
- Report this job
Job Description
Designation: Senior Software Engineer/ Software Engineer - Data Engineering
Location: Noida
Experience: 4-6 years
Job Summary/ Your Role in a Nutshell:
The ideal candidate would be a skilled Data Engineer proficient in Python, Scala, or Java with a strong background in Hadoop, Spark, SQL, and various data platforms and have expertise in optimizing the performance of data applications and contributing to rapid and agile development processes.
What youll do:
- Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues are fully tested with minimal defects
- Partner with a software development team to implement best practices and optimize the performance of Data applications to ensure that client needs are met at all times
- Collaborate across the company and interact with our customers to understand, translate, define, design their business challenges and concerns into innovative solutions
- Research on new Big Data technologies, assessing maturity and alignment of technology to business and technology strategy
- Work in a rapid and agile development process to enable increased speed to market while maintaining appropriate controls
What you need:
- BE/B.Tech/MCA with At least 4+ years of experience in design and development using Data Engineering technology stack and programming languages
- Mandatory experience in following areas:
- Python/Scala/Java
- Hadoop, HDFS, MR
- Spark SQL, Dataframes, RDDs
- SQL
- Hive / Snowflake/SQL Server/Bigquery
- Elastic Search
- Preferred experience in 3 or more of the following areas:
- Spark Streaming, Spark ML
- Kafka/Flume
- Apache NiFi
- Apache Airflow/Oozie
- Cloud-based Data Platforms
- NoSQL Databases HBase/Cassandra/Neo4j/MongoDB
- Good knowledge of the current technology landscape and ability to visualize industry trends
- Working knowledge of Big Data Integration with Third-party or in-house built Metadata Management, Data Quality, and Master Data Management solutions
- Active community involvement through articles, blogs, or speaking engagements at conferences
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: TO THE NEWLocation(s): Noida, Gurugram
Keyskills: Pyspark Big Data Spark Python Data Engineering Hadoop Kafka Hdfs Spark Streaming YARN SQL Hive Sqoop Oozie AWS
Similar positions
TO THE NEW
TO THE NEW is a digital technology company providing digital transformation and product engineering services to ISVs, Consumer Internet, and large enterprises across the globe. We design & build digital platforms and products with Cloud and Data at the focal point by working on cutting-edge tech...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in