Qualifications 7+ years of lead experience as a Big Data Senior Engineer or Lead role, working on large-scale data processing projects. Hands-on experience in building pipelines using Hadoop, Spark, Autosys, Unix etc. Hands-on experience with Bitbucket, Jenkins, TeamCity, Sonar Cube, Bitbucket, etc. Experience in distributed data processing using Apache Spark, PySpark, etc. Experience in Python / Scala programming languages in data processing. Proficient in data warehousing and ETL (Extract, Transform, Load) processes. Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment. Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to non-technical stakeholders. Banking Domain exposure Key Responsibilities Develop and implement big data strategies to enhance analytics capabilities. Utilize various tools and technologies for data extraction, transformation, and loading (ETL). Analyze large datasets to identify patterns, trends, and anomalies. Collaborate with IT and data engineering teams to maintain data pipelines and architecture. Design and build scalable data solutions for operational reporting and predictive analytics. Ensure data integrity and quality throughout all processes. Deploy machine learning models to automate data analysis tasks. Create user-friendly data visualization dashboards for stakeholder insights. Conduct data modeling to optimize data storage and accessibility. Monitor and assess system performance and efficiency of data processing. Stay updated with new technologies, tools, and best practices in big data. Participate in code reviews and contribute to software development best practices. Collaborate with business units to define data needs and reporting requirements. Provide technical support and training for teams regarding big data tools. Prepare and present findings to stakeholders to drive business decisions. Skills: sql proficiency,etl,data warehousing,hadoop,unix,apache spark,autosys,big data,sonar cube,scala,jenkins,cloud computing,data analysis,pyspark,data visualization,teamcity,machine learning,data modeling,bitbucket,python,spark,
Employement Category:
Employement Type: Full timeIndustry: BFSIRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Hiring for Big Data Job in Risk Resources at
Contact Details:
Company: Risk ResourcesLocation(s): Other Maharashtra