Data Technical Architect

14 - 18 years

0 Lacs

Posted:1 week ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

You will be leading the architectural design for a migration project, utilizing Azure services, SQL, Databricks, and PySpark to develop scalable, efficient, and reliable solutions. Your responsibilities will include designing and implementing advanced data transformation and processing tasks using Databricks, PySpark, and ADF. You should have a strong understanding of data integration, ETL, and data warehousing concepts. It will be essential to design, deploy, and manage Databricks clusters for data processing, ensuring performance and cost efficiency. Troubleshooting cluster performance issues when necessary is also part of your role. You will mentor and guide developers on using PySpark for data transformation and analysis, sharing best practices and reusable code patterns. Having experience in end-to-end architecture for SAS to PySpark migration will be beneficial. Documenting architectural designs, migration plans, and best practices to ensure alignment and reusability within the team and across the organization is a key aspect of this position. You should be experienced in delivering end-to-end solutions and effectively managing project execution. Collaborating with stakeholders to translate business requirements into technical specifications and designing robust data pipelines, storage solutions, and transformation workflows will be part of your responsibilities. Supporting UAT and production deployment planning is also required. Strong communication and collaboration skills are essential for this role. Experience: 14-16 Years Skills: Primary Skill: Data Architecture Sub Skill(s): Data Architecture Additional Skill(s): ETL, Data Architecture, Databricks, PySpark About the Company: Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. They engineer business outcomes for Fortune 500 companies and digital natives in various industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. Infogain accelerates experience-led transformation in the delivery of digital platforms. The company is a Microsoft Gold Partner and Azure Expert Managed Services Provider. Infogain, an Apax Funds portfolio company, has offices in multiple locations worldwide.,

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Infogain logo
Infogain

IT Services and IT Consulting

Los Gatos CA

RecommendedJobs for You