Jobs
Interviews
Fusion Plus Solutions logo

python,pyspark

5 - 8 years

4 - 7 Lacs

Hyderabad Telangana India

Posted:1 week ago| Platform: Foundit logo

Apply

Skills Required

DAGs

Work Mode

On-site

Job Type

Full Time

Job Description

  • Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently.
  • Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency (Databricks exposure will be an advantage)
  • Leverage AWS services such as EC2, S3, etc. for comprehensive data processing and storage solutions.
  • Expertly manage SQL database schema design, query optimization, and performance tuning to support data transformation and loading processes.
  • Design and maintain scalable and performant data warehouses, employing best practices in data modeling and ETL processes.
  • Utilize modern data platforms for collaborative data science, integrating seamlessly with various data sources and types.
  • Ensure high data quality and accessibility by maintaining optimal performance of Databricks clusters and Spark jobs.
  • Develop and implement security measures, backup procedures, and disaster recovery plans using AWS best practices.
  • Manage source code and automate deployment using GitHub along with CI/CD practices tailored for data operations in cloud environments.
  • Provide expertise in troubleshooting and optimizing PySpark scripts, Databricks notebooks, SQL queries, and Airflow DAGs.
  • Keep abreast of latest developments in cloud data technologies and advocate for the adoption of new tools and practices that can benefit the team.
  • Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and reliable execution of data jobs across various data sources and systems.
  • Collaborate closely with data scientists and business analysts to design data models and pipelines that support advanced analytics and machine learning projects.

More Jobs at Fusion Plus Solutions

Adobe Campaign Classic Developer

Hyderabad

2 - 4 yrs
|

INR 1 - 4 Lacs

Cloud Engineer

Hyderabad

4 - 5 yrs
|

INR 3 - 7 Lacs

Apache Kafka Admin

Hyderabad

3 - 7 yrs
|

INR 2 - 6 Lacs

Canvas Apps, Model Driven Apps, Power

Hyderabad

6 - 8 yrs
|

INR 6 - 10 Lacs

Account Manager / Business Development Manager

Hyderabad

1 - 5 yrs
|

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Fusion Plus Solutions logo
Fusion Plus Solutions

Information Technology & Services

Innovation City

RecommendedJobs for You

python,pyspark

Fusion Plus Solutions

Hyderabad, Telangana, India

python,pyspark

Fusion Plus Solutions

Hyderabad, Telangana, India

Appian Developer

Vantageiq Technologies Opc

Kolkata, West Bengal, India

Appian Developer

Vantageiq Technologies Opc

Hyderabad, Telangana, India

Appian Developer

Vantageiq Technologies Opc

Bengaluru, Karnataka, India

Appian Developer

Vantageiq Technologies Opc

Mumbai, Maharashtra, India

Data Engineer

Vantageiq Technologies Opc

Chennai, Tamil Nadu, India

Data Engineer

Vantageiq Technologies Opc

Bengaluru, Karnataka, India

Aws Cloud Engineer

Vantageiq Technologies Opc

Pune, Maharashtra, India

AWS Cloud Engineer CI/CD Pipeline

Vayuz Technologies

Pune, Maharashtra, India