Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in Noida
>
Iris Software
>
Data Engineer - Senior

Data Engineer - Senior

Iris Software

4 - 7 years

7 - 11 Lacs

Noida

Posted:2 days ago| Platform:

Apply

Skills Required

pyspark machine learning sql data science big data kubernetes aws iam sas glue amazon redshift microsoft azure dbms azure devops sql server docker aws glue configuration management aws cloud gcp devops troubleshooting etl aws aws devops

Work Mode

Work from Office

Job Type

Full Time

Job Description

Design, implement, and maintain data pipelines for processing large datasets, ensuring data availability, quality, and efficiency for machine learning model training and inference.
Collaborate with data scientists to streamline the deployment of machine learning models, ensuring scalability, performance, and reliability in production environments.
Develop and optimize ETL (Extract, Transform, Load) processes, ensuring data flow from various sources into structured data storage systems.
Automate ML workflows using ML Ops tools and frameworks (e.g., Kubeflow, MLflow, TensorFlow Extended (TFX)).
Ensure effective model monitoring, versioning, and logging to track performance and metrics in a production setting.
Collaborate with cross-functional teams to improve data architectures and facilitate the continuous integration and deployment of ML models.
Work on data storage solutions, including databases, data lakes, and cloud-based storage systems (e.g., AWS, GCP, Azure).
Ensure data security, integrity, and compliance with data governance policies.
Perform troubleshooting and root cause analysis on production-level machine learning systems.
Skills: Glue, Pyspark, AWS Services, Strong in SQL; Nice to have : Redshift, Knowledge of SAS Dataset

Mandatory Competencies

DevOps - CLOUD AWS

DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Docker

ETL - ETL - AWS Glue

Big Data - Big Data - Pyspark

Database - Other Databases - Redshift

Data Science and Machine Learning - Data Science and Machine Learning - Azure ML

Beh - Communication and collaboration

DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Containerization (Docker, Kubernetes)

Database - Sql Server - SQL Packages

Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight

DevOps/Configuration Mgmt - Cloud Platforms - AWS

More Jobs at Iris Software

Python Automation Tester with Robot Framework

Noida, Gurugram

7 - 12 yrs

INR 22 - 37 Lacs

.Net - Intern

Noida, Uttar Pradesh

Experience: Not specified

Salary: Not disclosed

ETL Tester

Pune, Delhi / NCR

5 - 8 yrs

INR 14 - 24 Lacs

Java Architect

Noida

14 - 18 yrs

INR 25 - 40 Lacs

QA Tester - Intern

Noida, Uttar Pradesh

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.