Home
Jobs

Senior PySpark - SSIS Data Engineer

5 - 8 years

6 - 10 Lacs

Posted:2 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description


Experience:

2-4 Years

Location:

Pune/Hybrid

Mandatory Skills:

Pyspark, SQL, ETL, ssis(knowledge), AWS/Azure
Key Job Summary:
    We are seeking a PySpark -SSIS Data Engineer with extensive experience in developing, optimizing, and maintaining data processing jobs using PySpark. The ideal candidate will possess a robust background in SQL and ETL processes, along with proficiency in cloud platforms such as AWS or Azure. This role will require excellent analytical skills and the ability to communicate effectively with both technical and non-technical stakeholders.
    Key Responsibilities:
    Design, develop, and optimize PySpark jobs for enhanced performance and scalability.
    Collaborate with data architects and business analysts to understand data requirements and translate them into technical specifications. Redesign and maintain complex SQL queries and stored procedures to support data extraction and transformation processes. Utilize ETL tools, specifically Informatica PowerCenter, to build effective data pipelines. Troubleshoot and resolve data quality issues and performance bottlenecks. Mentor and provide technical guidance to a team of developers to enhance productivity and code quality. Stay updated with new technologies and practices to continually improve data processing capabilities.
    Qualifications:
    Education: Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
    Experience: 5-8 years of experience in data engineering, with a strong focus on PySpark and ETL processes.
    Technical Skills:

    Must-Have:

    1. Extensive experience with PySpark, focusing on job optimization techniques.
    2. Proficiency in SQL, with experience in SQL Server, MySQL, or other relational databases. 3. Strong knowledge of ETL concepts and tools, particularly Informatica PowerCenter and IDMC. 4. Excellent analytical and troubleshooting skills. 5. Strong communication skills for effective collaboration.

    Good to Have:

    1. Basic knowledge of Unix commands and Shell scripting.
    2. Experience in leading and mentoring development teams. 3. Familiarity with Azure/Fabric.

Interested candidates, please share your updated resume atinfo@d-techworks.comwith the following details:

Updated Resume
Experience Current Organization Current CTC Expected CTC Notice Period Offer In Hand Current Location

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

Hyderabad/Secunderabad, Bangalore/Bengaluru, Delhi / NCR