Home
Jobs

Senior Data Engineer (Databricks, PySpark, SQL, Cloud Data Platforms)

8 - 10 years

10 - 12 Lacs

Posted:15 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Senior Data Engineer (Databricks, PySpark, SQL, Cloud Data Platforms, Data Pipelines)


Job Summary
Synechron is seeking a highly skilled and experienced Data Engineer to join our innovative analytics team in Bangalore. The primary purpose of this role is to design, develop, and maintain scalable data pipelines and architectures that empower data-driven decision making and advanced analytics initiatives. As a critical contributor within our data ecosystem, you will enable the organization to harness large, complex datasets efficiently, supporting strategic business objectives and ensuring high standards of data quality, security, and performance. Your expertise will directly contribute to building robust, efficient, and secure data solutions that drive business value across multiple domains.Software
Required Software & Tools:

  • Databricks Platform (Hands-on experience with Databricks notebooks, clusters, and workflows)
  • PySpark (Proficient in developing and optimizing Spark jobs)
  • SQL (Advance proficiency in writing complex SQL queries and optimizing queries)
  • Data Orchestration Tools such as Apache Airflow or similar (Experience in scheduling and managing data workflows)
  • Cloud Data Platforms (Experience with cloud environments such as AWS, Azure, or Google Cloud)
  • Data Warehousing Solutions (Snowflake highly preferred)
  • Preferred Software & Tools:
  • Kafka or other streaming frameworks (e.g., Confluent, MQTT)
  • CI/CD tools for data pipelines (e.g., Jenkins, GitLab CI)
  • DevOps practices for data workflows
  • Programming LanguagesPython (Expert level), and familiarity with other languages like Java or Scala is advantageous
  • Overall Responsibilities
  • Architect, develop, and maintain scalable, resilient data pipelines and architectures supporting business analytics, reporting, and data science use cases.
  • Collaborate closely with data scientists, analysts, and cross-functional teams to gather requirements and deliver optimized data solutions aligned with organizational goals.
  • Ensure data quality, consistency, and security across all data workflows, adhering to best practices and compliance standards.
  • Optimize data processes for enhanced performance, reliability, and cost efficiency.
  • Integrate data from multiple sources, including cloud data services and streaming platforms, ensuring seamless data flow and transformation.
  • Lead efforts in performance tuning and troubleshooting data pipelines to resolve bottlenecks and improve throughput.
  • Stay up-to-date with emerging data engineering technologies and contribute to continuous improvement initiatives within the team.
  • Technical Skills (By Category)
    Programming Languages:
  • EssentialPython, SQL
  • PreferredScala, Java
  • Databases/Data Management:
  • EssentialData modeling, ETL/ELT processes, data warehousing (Snowflake experience highly preferred)
  • Preferred NoSQL databases, Hadoop ecosystem
  • Cloud Technologies:
  • EssentialExperience with cloud data services (AWS, Azure, GCP) and deployment of data pipelines in cloud environments
  • PreferredCloud native data tools and architecture design
  • Frameworks and Libraries:
  • EssentialPySpark, Spark SQL, Kafka, Airflow
  • PreferredStreaming frameworks, TensorFlow (for data prep)
  • Development Tools and Methodologies:
  • EssentialVersion control (Git), CI/CD pipelines, Agile methodologies
  • PreferredDevOps practices in data engineering, containerization (Docker, Kubernetes)
  • Security Protocols:
  • Familiarity with data security, encryption standards, and compliance best practices
  • Experience
  • Minimum of 8 years of professional experience in Data Engineering or related roles
  • Proven track record of designing and deploying large-scale data pipelines using Databricks, PySpark, and SQL
  • Practical experience in data modeling, data warehousing, and ETL/ELT workflows
  • Experience working with cloud data platforms and streaming data frameworks such as Kafka or equivalent
  • Demonstrated ability to work with cross-functional teams, translating business needs into technical solutions
  • Experience with data orchestration and automation tools is highly valued
  • Prior experience in implementing CI/CD pipelines or DevOps practices for data workflows (preferred)
  • Day-to-Day Activities
  • Design, develop, and troubleshoot data pipelines for ingestion, transformation, and storage of large datasets
  • Collaborate with data scientists and analysts to understand data requirements and optimize existing pipelines
  • Automate data workflows and improve pipeline efficiency through performance tuning and best practices
  • Conduct data quality audits and ensure data security protocols are followed
  • Manage and monitor data workflows, troubleshoot failures, and implement fixes proactively
  • Contribute to documentation, code reviews, and knowledge sharing within the team
  • Stay informed of evolving data engineering tools, techniques, and industry best practices, incorporating them into daily work processes
  • Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field
  • Relevant certifications such as Databricks Certified Data Engineer, AWS Certified Data Analytics, or equivalent (preferred)
  • Continuous learning through courses, workshops, or industry conferences on data engineering and cloud technologies
  • Professional Competencies
  • Strong analytical and problem-solving skills with a focus on scalable solutions
  • Excellent communication skills to effectively collaborate with technical and non-technical stakeholders
  • Ability to prioritize tasks, manage time effectively, and deliver within tight deadlines
  • Demonstrated leadership in guiding team members and driving project success
  • Adaptability to evolving technological landscapes and innovative thinking
  • Commitment to data privacy, security, and ethical handling of information
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Databricks Interview Now
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Skills

    Practice coding challenges to boost your skills

    Start Practicing Now
    Synechron
    Synechron

    Information Technology and Services

    New York

    1000+ Employees

    401 Jobs

      Key People

    • Faisal Husain

      Co-Founder & CEO
    • Maqbool Kazi

      Managing Director

    RecommendedJobs for You