Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in bengaluru
>
Red Hat
>
Data Engineer

Data Engineer

Red Hat

5 - 10 years

8 - 12 Lacs

bengaluru

Posted:Just now| Platform:

Apply

Skills Required

python debugging troubleshooting aws job scheduling snowflake rest data analytics amazon redshift airflow python development numpy emr amazon rds relational databases data engineering sql server sql pandas data cleansing git postgresql

Work Mode

Work from Office

Job Type

Full Time

Job Description

The Data Engineer exercises judgment when following general instructions and works with minimal instruction to support the integration and automation of data solutions. This role focuses on data massaging, reconciliation, and analysis, resolving routine to semi-routine issues. Responsibilities include creating optimized SQL queries, managing data pipelines, and collaborating with cross-functional teams to ensure data accuracy and availability.NoteThis role may come into contact with confidential or sensitive customer information requiring special treatment in accordance with Red Hat policies and applicable privacy laws.- Write optimized and scalable complex SQL queries- Automate data processing tasks using Python, focusing on cleaning and merging datasets.- Manage data pipelines, including scheduling, monitoring, and debugging workflows.- Collaborate with data engineers and IT teams to maintain data accessibility for stakeholders.- Assist in developing automated tests to ensure the accuracy and integrity of data.- Participate in version control and CI/CD processes for deploying and testing pipeline changes across environments.- Work cross-functionally with analysts, engineers, and operations.- Data stewardship includingdata governance, data compliance, data transformation, data cleanliness, data validation, data audit/maintenance.Primary Job Responsibilities

Writing complex, highly-optimized SQL queries across large datasets, involved in SQL Query tuning and provided tuning recommendations

Experienced in Data Analytics, hands-on experience of various Python libraries such as NumPy and Pandas

Python development experience to massage, clean data and automate data extract and loads

Expertise to convert raw data to processed data by merging, finding outliers, errors, trends, missing values and distributions in the data

Expertise in Creating, Debugging, Scheduling and Monitoring jobs using Airflow, resolve performance tuning related issues and queries

Foster collaboration among Data engineers, IT & other business groups to ensure data is accessible to FP&A team

Scheduled a regular hot backup process and involved in the backup activities

Strong analytical and problem-solving skills with ability to represent complex algorithms in software

Develop automated unit tests, end-to-end tests, and integration tests to assist in quality assurance (QA) procedures

Required Skills

Bachelor's or Master's degree in Computer Science, IT, Engineering or equivalent

5+ years of experience as a Data Engineer, BI Engineer, Systems Analyst in a company with large, complex data sources

Working knowledge of DBT, Snowflake, Fivetran, Git and SQL or Python programming skills for data querying, cleaning, and presentation

Build highly available, reliable and secured API solutions, experience working with REST API design and Implementation

Working knowledge of relational databases (PostgreSQL, MSSQL, etc.), experience with AWS services including S3, Redshift, EMR and RDS.

Ability to manage multiple projects at the same time in a fast-paced team environment, across time zones, and with different cultures, while maintaining ability to work as part of a team

The candidate must have good troubleshooting skills and be able to think through issues and problems in a logical manner and planning knowledge would be an added advantage

Detail-oriented and enthusiastic who is also focused and diligent on delivering results

More Jobs at Red Hat

Senior Consultant

Mumbai

3 - 7 yrs

INR 11 - 16 Lacs

Senior Software Engineer

Bengaluru

3 - 5 yrs

INR 6 - 8 Lacs

Software Engineer

Pune

2 - 5 yrs

INR 8 - 12 Lacs

Account Solution Architect

Mumbai

6 - 10 yrs

INR 8 - 12 Lacs

Corporate Account Executive

Mumbai, Pune, Bengaluru

1 - 4 yrs

INR 3 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Red Hat

Software Development

Raleigh NC

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer