Your job as a Data Mining Professional is to use your skills to gather data from a variety of internet sources, cleanse it, and create APIs on top of it.
Develop a thorough understanding of our broad online data sources, including how, when, and what data to scrape, process, and store.
Create frameworks for automating and sustaining a steady stream of data from many sources. Research and test creative solutions on your own with little supervision.
Knowledge of Cloud implementation would be an added advantage.
Desired Candidate Profile:
6 to 8 years of experience in Web crawling domain
Hands-on coding experience in PERL and Python 3
Exposure of extracting data from Webpage using Parsers (HTML Parser, JSON Parser, XML Parser etc.)
Good Understanding and Implementation of Scrapy, Selenium based crawlers which are highly scalable and reusable
Right usage of Regular Expression
Pro in understanding Website Structure standards
Experience on MYSQL Data base server / Data manipulation (Create / Update / Delete )
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Database Architect / DesignerEmployement Type: Full time