Senior Software Engineer Data Engineering @ Vatsana Technologies

Vatsana, an organization started by seven people has grown into a global organization today. We started to code back in 2011 but who knew we re writing a story which will turn into a legend. Today, we inspire the world by creating world-class products. With a strong content publishing platform and the power of social media, we intend to give brands a gateway to communicate their story. And, with a reach of more than a billion, we serve millions of users on daily basis and entertain our massive follower base having one of the biggest content marketing platforms of India. Our vision is to impact human lives at the scale of a billion.

SUMMARY

As a Data Engineer in the Data Infrastructure team, you will build platforms and tools that churn through, process analyze terabytes of data. You will have to buid and manage entier fata floew pipeline. You will work on technologies such as Apache Spark, Elasticsearch, Redshift to build a scalable infrastructure that delivers recommendations to our users in real-time.

The pace of our growth is incredible if you want to tackle hard and interesting problems at scale, and create an impact within an entrepreneurial environment, join us!

WHAT YOU WILL DO:

• You will work closely with Software Engineers ML engineers to build data infrastructure that fuels the needs of multiple teams, systems and products.
• You will automate manual processes, optimize data-delivery and build the infrastructure required for optimal extraction, transformation and loading of data required for a wide variety of use-cases using Apache Spark.
• You will build stream processing pipelines and tools to support a vast variety of analytics and audit use-cases.
• You will continuously evaluate relevant technologies, influence and drive architecture and design discussions.
• You will work in cross-functional team and collaborate with peers during entire SDLC.

• BE/B.Tech/BS/MS/PhD in Computer Science or a related field (ideal).
• Minimum 4 years of work experience building data warehouse and BI systems.
• Experience in either Go or Python (plus to have).
• Experience in Apache Spark, Hadoop, Redshift, Athena.
• Strong understanding of database and storage fundamentals.
• Experience with the AWS stack.
• Ability to create data-flow design and write complex SQL / Spark based transformations.
• Experience working on real time streaming data pipelines using Spark Streaming or Storm.