Specialist Software Engineer - Spark
- NICE
- 4 - 8 years
- Pune
- 1 month ago
- Email to a friend
- Report this job
Job Description
So, whats the role all about?
As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems, as well as working with cross-functional teams to ensure efficient data processing and integration. You will leverage your knowledge of Apache Spark to create robust ETL processes, optimize data workflows, and manage high volumes of structured and unstructured data.
How will you make an impact?
- Design, implement, and maintain data pipelines using Apache Spark for processing large datasets.
- Work with data engineering teams to optimize data workflows for performance and scalability.
- Integrate data from various sources, ensuring clean, reliable, and high-quality data for analysis.
- Develop and maintain data models, databases, and data lakes.
- Build and manage scalable ETL solutions to support business intelligence and data science initiatives.
- Monitor and troubleshoot data processing jobs, ensuring they run efficiently and effectively.
- Collaborate with data scientists, analysts, and other stakeholders to understand business needs and deliver data solutions.
- Implement data security best practices to protect sensitive information.
- Maintain a high level of data quality and ensure timely delivery of data to end-users.
- Continuously evaluate new technologies and frameworks to improve data engineering processes.
Have you got what it takes?
- 8-11 years of experience as a Data Engineer, with a strong focus on Apache Spark and big data technologies.
- Expertise in Spark SQL, DataFrames, and RDDs for data processing and analysis.
- Proficient in programming languages such as Python, Scala, or Java for data engineering tasks.
- Hands-on experience with cloud platforms like AWS, specifically with data processing and storage services (e.g., S3, BigQuery, Redshift, Databricks).
- Experience with ETL frameworks and tools such as Apache Kafka, Airflow, or NiFi.
- Strong knowledge of data warehousing concepts and technologies (e.g., Redshift, Snowflake, BigQuery).
- Familiarity with containerization technologies like Docker and Kubernetes.
- Knowledge of SQL and relational databases, with the ability to design and query databases effectively.
- Solid understanding of distributed computing, data modeling, and data architecture principles.
- Strong problem-solving skills and the ability to work with large and complex datasets.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
You will have an advantage if you also have:
- Knowledge of SQL and relational databases, with the ability to design and query databases effectively.
- Solid understanding of distributed computing, data modeling, and data architecture principles.
- Strong problem-solving skills and the ability to work with large and complex datasets.
Whats in it for you?
Join an ever-growing, market disrupting, global company where the teams comprised of the best of the best work in a fast-paced, collaborative, and creative environment! As the market leader, every day at NICE is a chance to learn and grow, and there are endless internal career opportunities across multiple roles, disciplines, domains, and locations. If you are passionate, innovative, and excited to constantly raise the bar, you may just be our next NICEr!
Enjoy NICE-FLEX!
At NICE, we work according to the NICE-FLEX hybrid model, which enables maximum flexibility: 2 days working from the office and 3 days of remote work, each week. Naturally, office days focus on face-to-face meetings, where teamwork and collaborative thinking generate innovation, new ideas, and a vibrant, interactive atmosphere.
Requisition ID: 7235
Reporting into: Tech Manager
Role Type: Individual Contributor
Job Classification
Industry: Software ProductFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: NICELocation(s): Pune
Keyskills: python scala amazon redshift data processing big data technologies distributed computing dataproc sql data architecture principles java apache nifi data modeling spark collaboration kafka data warehousing concepts aws big data etl programming communication skills
Similar positions
NICE
Nice Software Solutions (NSS) is a professional services company, focusing in Business Intelligence and Data Warehousing solutions. We specialize in MicroStrategy, Tableau and Informatica technologies and are expert in producing quicker, impactful and user friendly analytics within Data Warehousing ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in