At Modern, we are seeking a highly motivated and focused Data Engineers with a proven consulting background to join our Client Technology Team. As lead data engineers, you will act as a subject matter expert for our Enterprise Data Product Platform, DataOS . As a subject matter expert, you would provide technical expertise in needs identification, data modeling, data movement, and translating business needs into technical solutions.

Responsibilities:

Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.

Work closely with various stakeholders including business teams, data stewards, various consumers to define data product roadmap and bring them to fruition.

Design and build a scalable, fault-tolerant solutions optimized for distributed computing and large-scale data processing using DataOS

Optimize Spark-based workflows for performance, scalability, and cost efficiency.

Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.

Actively participates with other consultants in problem-solving and approach development.

Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.

Coordinate with Data Architects, Program Managers and participate in recurring meetings.

Requirements

Bachelor\u2019s degree in computer science, business analytics or similar discipline.

5+ years of experience in data engineering, architecture, or analytics roles.

Strong working knowledge of Spark, Python, SQL and API Integration frameworks is a must

Working experience in Modern data architecture and modeling concepts, including Cloud data lakes, data warehouses, and data marts. Familiarity with dimensional modeling, star schemas, and real-time/batch ETL pipelining including experience with data streaming (Kafka).

Expertise in ensuring data quality and reliability using monitoring and validation techniques.

Working experience with tools such as DBT, Airflow, or similar is a plus

Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).

Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.

Benefits

Working at Modern

First and foremost, our value system is sacred to us \u2013 HEAT: Humility, Empathy, Accountability and Transparency. Beyond this, we are fond of individuals who are curious, love solving problems and can see the larger picture. We love to take a leap of faith on potential. If you believe you haven\u2019t had the chance to do your life\u2019s best work, Modern is the place for you.

Modern embraces competition for great talent. We have been able to get great talent onboard owing to the attractive compensation and benefits we provide, in addition to the upside we share with all our employees in the form of ESOPs. Moreover, our ESOP policies are highly employee-friendly replicating ethos of some of the best Silicon Valley tech startups. We are committed to making sure our employees create significant value for themselves.

More Jobs at The Modern Data Company

Python Backend Developer

Indore, Madhya Pradesh

Experience: Not specified

Salary: Not disclosed

Experience Specialist

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

DevOps Lead

Indore, Madhya Pradesh

Experience: Not specified

Salary: Not disclosed

Sr. Interaction Designer

Indore

5.0 - 7.0 yrs

INR 2 - 5 Lacs

Sr. Interaction Designer

Indore, Madhya Pradesh

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

The Modern Data Company

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Lead Data Engineer