Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Hadoop reporting platform (freelancer / consultant) @ Codevian Technologies

Home > Other Consulting

 Hadoop reporting platform (freelancer / consultant)

Job Description

  • Install, configure and maintain enterprise hadoop environment.
  • Loading data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
  • Understanding the requirements of input to output transformations.
  • Hadoop developers spend lot of time in cleaning data as per business requirements using streaming API s or user defined functions.
  • Defining Hadoop Job Flows.
  • Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
  • Managing Hadoop jobs using scheduler.
  • Reviewing and managing hadoop log files.
  • Design and implement column family schemas of Hive and HBase within HDFS.
  • Assign schemas and create Hive tables.
  • Managing and deploying HBase clusters.
  • Develop efficient pig and hive scripts with joins on datasets using various techniques.
  • Assess the quality of datasets for a hadoop data lake.
  • Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
  • Build new hadoop clusters
  • Maintain the privacy and security of hadoop clusters .
  • Fine tune hadoop applications for high performance and throughput.
  • Troubleshoot and debug any hadoop ecosystem run time issues.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Consulting
Role Category: Other Consulting
Role: Financial Consultant
Employement Type: Full time

Contact Details:

Company: Codevian Technologies
Location(s): Pune

+ View Contactajax loader


Keyskills:   hive Hadoop Debugging hdfs Deployment Management Troubleshooting Analytics HBase

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Energy Auditor / Energy Manager (EA/EM)

  • PTC India
  • 5 - 7 years
  • Lucknow
  • 3 days ago
₹ Not Disclosed

SAP (GR/BPC)

  • Trigent
  • 5 - 10 years
  • Pune
  • 4 days ago
₹ 18-30 Lacs P.A.

Clinical Assistant / RMO

  • Saishree Vitalife
  • 1 - 6 years
  • Pune
  • 6 days ago
₹ -4.5 Lacs P.A.

Erp Cloud/fin/financials (ppm) Professional

  • Kastech
  • 5 - 8 years
  • Hyderabad
  • 13 days ago
₹ Not Disclosed

Codevian Technologies

Got a Startup ideaLet us give you our honest opinion!! We are best Mobile and Web App Development Company in Pune, providing custom made, robust, innovative solutions