Big Data Engineer - Exciting Opportunity
- Innova Solutions
- 5 - 10 years
- Bhubaneswar
- 5 years ago
- Email to a friend
- Report this job
Job Description
Job Title: Big Data Engineer
Experience: 5-9 Years
Location: Vizag
Skill Set: Big data (Hadoop eco systems and Java/ Python)
Summary:
Come work as a Big Data Engineer at growing company that offers great benefits with opportunities to advance and learn alongside accomplished leaders, For Leading Global investment firm in collaboration with technology services company Innova Solutions.
Innova Solutions is a global information technology company combining a global reach with a local touch. Headquartered in Santa Clara, California, Innova employs more than 1,800 technology professionals worldwide, with field offices in New York, Chennai, Bangalore, Hyderabad, Pune, and Taipei. From Cloud Transformation to Data Services to Managed IT Operations, Innova provides a broad array of proven, tested, cost effective and enterprise scale technologies and services that leverage latest technology and delivery models to deliver high value in the cloud, in the data center, and across complex inter connected environments.
Position Overview:
Big data engineers are responsible for developing, maintaining, evaluating and testing big data solutions. In addition, they are generally involved in the design of big data solutions. This is because they are usually skilled and experienced with Hadoop [-]based technologies such as MapReduce, Hive, MongoDB or Cassandra.
What are we looking for?
We are looking for a Big Data Engineer to create solutions suitable for the job in a real-time, highly data-driven organization and make technical innovations happen. With a range of projects to develop data processing applications, you will have the opportunity to use cutting edge technology across all stages of the lifecycle.
A big data engineer should embrace the challenge of dealing with petabyte or even exabytes of data on a daily basis. A big data engineer understands how to apply technologies to solve big data problems and to develop innovative big data solutions. In order to be able to do this, the big data engineer should have extensive knowledge in different programming or scripting languages like Java, Linux, C++, PHP, Ruby, Phyton and/or R. Also, expert knowledge should be present regarding different (NoSQL or RDBMS) databases such as MongoDB or Redis. Building data processing systems with Hadoop and Hive using Java or Python should be common knowledge to the big data engineer.
should also have the capability to architect highly scalable distributed systems, using different open source tools
He or she should understand how algorithms work and have experience building high-performance algorithms.
Generally, works on implementing complex big data projects with a focus on collecting, parsing, managing, analysing and visualizing large sets of data to turn information into insights using multiple platforms. He or she should be able to decide on the needed hardware and software design needs and act according to the decisions.
Duties and responsibilities:
- Responsible for Hadoop development
- Implementation including loading from disparate data sets, preprocessing using Hive and Pig.
- Scope and deliver various Big Data solutions
- Ability to design solutions independently based on high-level architecture.
- Manage the technical communication between the survey vendor and internal systems
- Maintain the production systems (Kafka, Hadoop, Cassandra, Elasticsearch
- Collaborate with other development and research teams
- Building a cloud-based platform that allows easy development of new applications
Key Requirements.
- 3+ years of experience as a Big Data Engineer or similar role
- Should have experience programming and/or architecting a back-end language (Java, J2EE, Core
- University degree in Computer Science, Engineering or equivalent preferred)
- Experience with Java oriented technologies (JBoss, Spring, Spring, Hibernate, REST/SOAP)
- Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
- Experience with Spark, or the Hadoop ecosystem and similar frameworks
- Familiarity with various tools such as AWS, Mesos or Docker and an instinct for automation
- Creative and innovative approach to problem-solving
Perks and Benefits
Best in the Market - Fixed CTCJob Classification
Industry: IT-Software / Software ServicesFunctional Area: IT Software - Application Programming, Maintenance, Role Category: Programming & DesignRole: Programming & DesignEmployement Type: Full timeEducation
Under Graduation: Any Graduate in Any Specialization, Graduation Not RequiredPost Graduation: Any Postgraduate in Any Specialization, Post Graduation Not RequiredDoctorate: Any Doctorate in Any Specialization, Doctorate Not RequiredContact Details:
Company: Innova SolutionsLocation(s): Bhubaneswar
Keyskills: python Hive java hadoop developer spark scala big data engineer Flume Mapreduce Alogrithms Pig
Innova Solutions
Company ProfileInnova Solutions Private LimitedAt Innova, we believe your business deserves better services and solutions, applications that are ready to go, easy to setup/use, and require minimal customization. Today, many leading enterprises partner with us to solve their real world problems, an...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in