Data Architect- AWS-Big Data
- InfoCepts
- 9 - 10 years
- Kolkata
- 3 months ago
- Email to a friend
- Report this job
Job Description
As a Data Architect, you will be responsible for designing and optimizing complex Big Data solutions using AWS services, ensuring a balance between cost and performance. Responsibilities include assessing existing technology, performing impact assessments, optimizing designs, and documenting projects. The role involves effective communication of architectural decisions, conducting Proof-of-Concepts and design solutions, suggesting automation and providing expert advice.
Location: Nagpur/Pune/Chennai/Bangalore
Type of Employment: Full-time
Key Result Areas and Activities:
- Technology Assessment and Impact Analysis : Evaluate existing technology and data integration frameworks, and conduct impact assessments based on requirements.
- Big Data Use Case Design: Create complex Big Data use cases using AWS services, focusing on cost, performance, and durability.
- Optimization and Performance: Recommend optimizations to balance cost and performance in existing designs.
- Architectural Communication and Proof-of-Concepts: Communicate architectural decisions to stakeholders, conduct Proof-of-Concepts, document findings, and lead design reviews.
- Process Improvement and Automation: Implement automation to improve processes and enhance team productivity, while providing expert advice, troubleshooting, and support for client proposals.
Essential Skills:
- Experience of AWS services (S3,EC2, EMR, Athena, AWS Glue, Lambda) and AWS VPC, subnets, security groups, and route tables
- Expertise in MPP databases (AWS Redshift, Snowflake, SingleStore) and Data Warehousing concepts
- Proficient in Big Data technologies, specifically Apache Spark, and table formats like Delta Lake or Apache Iceberg
- Strong programming skills in Scala and Python, along with SQL proficiency and experience with orchestration tools like Apache Airflow
- Skilled in developing ETL workflows with complex transformations (SCD, deduplication, aggregation)
- Proficient in operating systems, including Linux and Windows
Desirable Skills:
- Prior experience working in a large media company would be an added advantage. Knowledge of Data Fabric and Data Mesh concepts
- Programming Language: Java, Bash
- Cloud Databases: AWS Aurora
Qualifications:
- Bachelors degree in computer science, engineering, or related field (Masters degree is a plus)
- Demonstrated continued learning through one or more technical certifications or related methods
- 9 years of IT experience with minimum 5 years of experience on cloud-related projects
Qualities:
- Hold strong technical knowledge and experience with the capability to deep dive and research in various technical fields
- Self-motivated and focused on delivering outcomes for a fast-growing team and organization
- Able to communicate persuasively through written, verbal and client presentations
- Effective and self-organized in cross-functional team and across different time zones
Job Classification
Industry: Management ConsultingFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Data warehouse Architect / ConsultantEmployement Type: Full timeContact Details:
Company: InfoCeptsLocation(s): Kolkata+ View Contact
Keyskills: Computer science Automation Linux Architecture Process improvement Windows Troubleshooting Apache SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
InfoCepts
InfoCepts Technologies Pvt. Ltd. InfoCepts is a leading provider of Information Management and Business Analytics services. With over 700+ Industry leading professionals spread globally, we help organizations make business decisions faster, smarter & better, by deriving maximum value from th...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in