Data Engineer

Wits Innovation Lab

0 years

0 Lacs

Bengaluru Karnataka India

Posted:20 hours ago| Platform:

Apply

Skills Required

data sql server oracle database drawing design profiling communication reporting databricks aws spark pyspark apache etl query analysis resolve documentation model flow support maintenance optimization integrity

Work Mode

On-site

Job Type

Full Time

Job Description

Experience in SQL Server databases, Oracle and/or cloud databases.
Experience in data warehousing and data mart, Star and Snowflake model.
Experience in loading data into database from databases and files.
Experience in analyzing and drawing design conclusions from data profiling results.
Understanding business process and relationship of systems and applications.
Must be comfortable conversing with the end-users.
Must have ability to manage multiple projects/clients simultaneously.
Excellent analytical, verbal and communication skills.

Role And Responsibilities

Work with business stakeholders and build data solutions to address analytical & reporting requirements.
Work with application developers and business analysts to implement and optimise Databricks/AWS-based implementations meeting data requirements.
Design, develop, and optimize data pipelines using Databricks (Delta Lake, Spark SQL, PySpark), AWS Glue, and Apache Airflow
Implement and manage ETL workflows using Databricks notebooks, PySpark and AWS Glue for efficient data transformation
Develop/ optimize SQL scripts, queries, views, and stored procedures to enhance data models and improve query performance on managed databases.
Conduct root cause analysis and resolve production problems and data issues.
Create and maintain up to date documentation of the data model, data flow and field level mappings.
Provide support for production problems and daily batch processing.
Provide ongoing maintenance and optimization of database schemas, data lake structures (Delta Tables, Parquet), and views to ensure data integrity and performance

(ref:hirist.tech)

More Jobs at Wits Innovation Lab

.Net Developer - ASP/MVC

Sahibzada Ajit Singh Nagar, Punjab, India

2 - 2 yrs

Salary: Not disclosed

Golang Developer

Mohali district, India

Experience: Not specified

Salary: Not disclosed

Content Writer

Mohali

1 - 6 yrs

INR 7 - 9 Lacs

Content Writer

Mohali

1 - 2 yrs

INR 7 - 9 Lacs

DotNet Developer

Mohali

1 - 4 yrs

INR 7 - 12 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.