Data Engineer-Data Platforms
- IBM
- 3 - 5 years
- Mumbai
- 16 hours ago
- Email to a friend
- Report this job
Job Description
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
- Your primary responsibilities include:
- Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
- Strive for continuous improvements by testing the build solution and working under an agile framework.
- Discover and implement the latest technologies trends to maximize and build creative solutions
- Experience with Apache Spark (PySpark): In-depth knowledge of Sparks architecture, core APIs, and PySpark for distributed data processing.
- Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
- Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
- SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
- Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems
- Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
- Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
- Good to have detection and prevention tools for Company products and Platform and customer-facing
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: IBMLocation(s): Mumbai
Keyskills: python data processing pyspark data modeling spark sql queries data analysis microsoft azure data warehousing cloud platforms numpy data engineering sql pandas etl pipelines java gcp kafka data warehousing concepts hadoop big data aws etl
Similar positions
IBM
Accelalpha is a rapidly growing consultancy delivering Oracle Cloud Solutions to global clients. Despite the challenges faced over the last few years, Accelalpha continued to grow rapidly providing stability for our employees and customers. Accelalpha is proudly a Certified as a Great Place to Work...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in