Posted:1 month ago|
Platform:
On-site
Full Time
Role : Databricks Developer with Python Location: Bangalore Exp: 3-5 yrs Notice Period: Immediate to 15 days Mandatory Skills: · Around 5 years experience as Databricks/PySpark developer · Strong Python programming skills, a solid understanding of Apache Spark's concepts (like DataFrames, Spark SQL, and MLlib), and familiarity with cloud platforms. · 1 to 3 days per week - Work from Bengaluru office Job Description Summary: Design and Development: • Design, develop, and deploy ETL processes on Databricks for data integration and transformation. • Implement and optimize Spark jobs, data transformations, and data processing workflows. • Build and optimize data pipelines, architectures, and datasets. • Collaboration - Collaborate with data engineers, architects and team members to ensure efficient data processing and storage. Best Practices - Implement best practices for data pipelines, including monitoring, logging, and error handling. Tools and Technologies: •Proficient in using Databricks, Azure Data Factory, and other Azure services. •Experience with PySpark, SQL for ETL logic. •Familiarity with Apache Spark and Delta Lake. Other Skills: ·Experience with data warehousing concepts and data modeling. ·Hands-on experience in creating stored procedures, functions, tables, cursors. ·Experience in database testing, data comparison, and data transformation scripting ·Capable of troubleshooting common database issues ·Familiar with tools that can aid with profiling server resource usage and optimizing it ·Hands on experience in Gitlab with understanding of CI/CD Pipeline, DevOps tools Show more Show less
Mastek
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
6.0 - 8.0 Lacs P.A.
5.0 - 15.0 Lacs P.A.
Experience: Not specified
Salary: Not disclosed
Chennai, Tamil Nadu, India
Salary: Not disclosed
3.92 - 10.0 Lacs P.A.
Bengaluru
Salary: Not disclosed
Experience: Not specified
5.64 - 8.0 Lacs P.A.
Bengaluru
6.75 - 9.895 Lacs P.A.
Noida
Experience: Not specified
4.0625 - 6.75 Lacs P.A.
Bengaluru, Karnataka, India
Salary: Not disclosed
