Posted:3 weeks ago|
Platform:
On-site
Part Time
Report to
Job Summary:
We are looking for a skilled and detail-oriented Associate Data Engineer with 3 to 8 years of professional experience to join our growing data team. The candidate should be proficient in designing data models, managing databases, developing scalable data pipelines (especially using Azure Data Factory), and programming in Python, PySpark, and SQL. The role involves end-to-end development, optimization, and maintenance of data workflows that support critical business functions.
Key Responsibilities:
o Design, implement, and maintain efficient data models for structured and unstructured data.
o Create and maintain detailed technical documentation for data flows, architecture, and transformations.
o Manage large-scale databases, including schema design, indexing, and performance tuning.
o Write complex stored procedures, triggers, and functions to support data workflows.
o Build and manage robust, scalable ETL/ELT pipelines using Azure Data Factory (ADF).
o Integrate diverse data sources including APIs, flat files, databases, and cloud services.
o Develop and maintain data transformation scripts using Python, PySpark, and SQL.
o Optimize code for performance and scalability in distributed environments.
o Conduct thorough unit, integration, and regression testing for data solutions.
o Implement data quality checks, monitoring, and alerting mechanisms.
o Collaborate with data analysts, data scientists, and business teams to gather requirements and deliver solutions.
o Translate complex business needs into efficient and scalable technical implementations.
Required Skills & Qualifications:
Preferred Qualifications:
MOL Information Technology
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python NowSalary: Not disclosed
Salt Lake, Kolkata, West Bengal
Salary: Not disclosed
Salary: Not disclosed
Salary: Not disclosed
Salt Lake, Kolkata, West Bengal
Salary: Not disclosed
Salary: Not disclosed
Salt Lake, Kolkata, West Bengal
Salary: Not disclosed
Salary: Not disclosed
Salt Lake, Kolkata, West Bengal
Salary: Not disclosed
Salary: Not disclosed