Data Engineer
- Atlassian
- 5 - 10 years
- Kolkata
- 13 days ago
- Email to a friend
- Report this job
Job Description
Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Atlassian is looking for a Data Engineer to join our Data Engineering team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.
On a typical day you will help our stakeholder teams ingest data faster into our data lake, you ll find ways to make our data pipelines more efficient, or even come up ideas to help instigate self-serve data engineering within the company.
You ll get the opportunity to work on a AWS based data lake backed by the full suite of open source projects such as Spark and Airflow. We are a team with little legacy in our tech stack and as a result you ll spend less time paying off technical debt and more time identifying ways to make our platform better and improve our users experience.
As a Data Engineer in the DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.
On your first day, well expect you to have:
- A BS in Computer Science or equivalent experience
- At least 5+ years professional experience as a Software Engineer or Data Engineer
- Strong programming skills (Python, Java or Scala preferred)
- Experience writing SQL, structuring data, and data storage practices
- Experience with data modeling
- Knowledge of data warehousing concepts
- Experience building data pipelines, platforms
- Experience with Databricks, Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
- Experience in modern software development practices (Agile, TDD, CICD)
- Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies.
- A willingness to accept failure, learn and try again
- An open mind to try solutions that may seem crazy at first
- Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)
Its preferred that you have:
- Experience building self-service tooling and platforms
- Built and designed Kappa architecture platforms
- Contributed to open source projects (Ex: Operators in Airflow)
- Experience with Data Build Tool (DBT)
Benefits & Perks
Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: AtlassianLocation(s): Kolkata+ View Contact
Keyskills: Computer science Data modeling TDD SCALA Agile Data quality Test cases Open source SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in