Lead Software Engineer
- Coupa
- 10 - 15 years
- Pune
- 12 days ago
- Email to a friend
- Report this job
Job Description
The Impact of a Lead Software Engineer - Data to Coupa:
The Lead Software Engineer - Data is a pivotal role at Coupa, responsible for leading the architecture, design, and optimization of the data infrastructure that powers our business. This individual will collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to build and maintain scalable, high-performance data solutions.
The Lead Software Engineer - Data will drive the development of robust data architectures, capable of handling large and complex datasets, while ensuring data integrity, security, and governance. Additionally, this role will provide technical leadership, mentoring engineers, and defining best practices to ensure the efficiency and scalability of our data systems.
Suitable candidates will have a strong background in data engineering, with experience in data modeling, ETL development, and data pipeline optimization. They will also have deep expertise in programming languages such as Python, Java, or Scala, along with hands-on experience in cloud-based data storage and processing technologies such as AWS, Azure, or GCP.
The impact of a skilled Lead Software Engineer - Data at Coupa will be significant, ensuring that our platform is powered by scalable, reliable, and high-quality data solutions. This role will enable the company to deliver innovative, data-driven solutions to our customers and partners. Their work will contribute to the overall success and growth of Coupa, solidifying its position as a leader in cloud-based spend management solutions.
What You ll Do:
- Lead and drive the development and optimization of scalable data architectures and pipelines.
- Design and implement best-in-class ETL/ELT solutions for real-time and batch data processing.
- Optimize Spark clusters for performance, reliability, and cost efficiency, implementing monitoring solutions to identify bottlenecks.
- Architect and maintain cloud-based data infrastructure leveraging AWS, Azure, or GCP services.
- Ensure data security and governance, enforcing compliance with industry standards and regulations.
- Develop and promote best practices for data modeling, processing, and analytics.
- Mentor and guide a team of data engineers, fostering a culture of innovation and technical excellence.
- Collaborate with stakeholders, including Product, Engineering, and Data Science teams, to support data-driven decision-making.
- Automate and streamline data ingestion, transformation, and analytics processes to enhance efficiency.
- Develop real-time and batch data processing solutions, integrating structured and unstructured data sources.
What you will bring to Coupa:
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Expertise in processing large workloads and complex code on Spark clusters.
- Expertise in setting up monitoring for Spark clusters and driving optimization based on insights and findings.
- Experience in designing and implementing scalable Data Warehouse solutions to support analytical and reporting needs.
- Experience with API development and design with REST or GraphQL. Experience building and optimizing big data data pipelines, architectures, and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- We are looking for a candidate with 10+ years of experience in a in Data Engineering with at least 3+ years in a Technical Lead role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. They should also have experience using the following software/tools: Experience with object-oriented/object function scripting languages: Python, Java, C++, .net, etc. Expertise in Python is a must.
- Experience with big data tools: Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Working knowledge of stream-processing systems: Storm, Spark-Streaming, etc.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Technical LeadEmployement Type: Full timeContact Details:
Company: Coupa Location(s): Pune+ View Contact
Keyskills: Software Engineering RDS GCP API development EC2 ETL development Data Warehouse EMR ELT Redshift SQL
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in