Posted:5 days ago|
Platform:
On-site
Full Time
At Thoucentric, we offer end-to-end consulting solutions designed to address the most pressing business challenges across industries. Leveraging deep domain expertise, cutting-edge technology, and a results-driven approach, we help organizations streamline operations, enhance decision-making, and accelerate growth. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally.
Data Engineer
Location-New Delhi
Exp-3-5 years
- Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF).- Build ETL/ELT processes that ingest, transform, and load data from various sources into data lakes, warehouses, or databases. - Implement both batch and near real-time data flows.
- Create, schedule, and monitor ADF pipelines. - Implement complex data workflows, including dependency management, parameterization, and dynamic pipeline design. - Integrate ADF with other Azure services (Blob Storage, Synapse, Databricks, Key Vault, etc.). - Implement logging, alerting, and retry logic for production stability.
- Analyze large datasets to identify trends, issues, and transformation needs. - Write performant SQL queries and transformations. - Collaborate with data analysts to understand data requirements and structure transformations accordingly. - Ensure data is accurate, consistent, and aligned with business logic.
- Quickly diagnose and resolve data quality issues, pipeline failures, or performance bottlenecks. - Perform root cause analysis for pipeline errors and implement long-term fixes. - Debug and optimize Spark or SQL transformations in environments like Databricks.
- Implement data validation and quality checks within pipelines. - Perform reconciliation and sanity checks across data sources. - Maintain data dictionaries and metadata repositories.
- Work closely with data architects, analysts, BI developers, and business users. - Translate business data needs into technical implementations. - Document pipeline logic, data flows, and troubleshooting procedures.
- Work closely with data architects, analysts, BI developers, and business users. - Translate business data needs into technical implementations. - Document pipeline logic, data flows, and troubleshooting procedures.
- Optimize ADF pipeline execution time and cost. - Improve query performance using indexing, partitioning, and efficient transformation logic. - Recommend improvements in data infrastructure and tooling.
Required Skills
Practice Name
Date Opened
Work Mode
Job Type
Industry
Zip/Postal Code
City
Country
State/Province
Thoucentric
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
gurgaon
Experience: Not specified
4.125 - 6.0 Lacs P.A.
gurgaon
5.0 - 7.5 Lacs P.A.
delhi
Salary: Not disclosed
chennai, tamil nadu, india
Experience: Not specified
Salary: Not disclosed
bengaluru
5.505 - 7.675 Lacs P.A.
chennai, tamil nadu, india
Experience: Not specified
Salary: Not disclosed
bengaluru, karnataka, india
Salary: Not disclosed
gurugram, haryana, india
Experience: Not specified
Salary: Not disclosed
bengaluru, karnataka, india
Salary: Not disclosed
gurgaon, haryana, india
Experience: Not specified
Salary: Not disclosed
