Senior Data Engineer

Role :

The Data Engineers role is to design and build data-centric solutions that provide actionable business insights and deepen analytic capabilities in the JSW One Platform systems. The Data Engineer will be responsible for taking requirements and analysis of business processes and developing applications himself/herself or with help of vendors. This will include ETL/ELT coding, database & architecture design in cloud environment and implementation, and working closely with Data Scientists and Data Visualization developers on solution design.

Responsibilities

Key skills :

• Architect, Plan and Develop our data strategy and work with our team to turn it into working software. 
• Co-create the detailed application architecture strategy with the teams, aligning your strategy with the teams deliverables
• Take an active role in collaborating to develop strategic direction, systems roadmap, and business and operational processes by providing the required technical guidance.
• Work with business stakeholders, product managers and architects to understand the business data and related processes
• Own the communication and documentation of the strategy, syndicating with CTO, business and the development teams
• Get hands-on in the code building prototypes and upholding best design and engineering practice, demonstrating the patterns you would like realized
• Extensive knowledge in data integration architecture/ETL/Data warehouse, esp large volumes with complex integrations
• Help the teams slice their deliveries to allow for agile and incremental delivery of business value
• Consult development teams towards application development in Cloud Native way
• Evaluate tools / services and new technologies and suggest the right service and technology to be used.
• Speed as a Habit can operate in a fast-moving environment, make quick decisions and execute fiercely to deliver outcomes.
• Using Agile and Dev/Ops methods, build platform architecture using a variety of sources (such as cloud IaaS/ SaaS).
• Integrate data from a variety of business subject areas: Leads management, Customer Portal, Seller App, SAP, Sales Force etc
• Implement rules & automate data cleansing, mapping, transformation, logging, and exception handling.
• Design, build, and deploy databases and data stores
• Participate in cross-functional teams to promote technology strategies, analyze and test products, perform proof-of-concept, and pilot new technologies and/or methods.
• Establish and document standards, guidelines, and best practices for teams utilizing the solutions.
• Review vendor solution designs to ensure technology appropriateness, standards compliance, and platform capacity alignment.

Required Skills

• At least 5+ years of overall experience with over 2+ years in architecting and working on big data applications and technologies

• Strong Object-Oriented Programming concepts.

• Should be proficient in

  Server Side (Java/Linux)

  technologies. Hands-on deep knowledge of Java and Spring boot
• Expertise in

  GCP (google cloud platform)

  and ability to operate in DevOps model.
• Expertise in architecting or developing features for enterprise scale systems will be an added advantage.
• Good experience in

  data and ML use cases,

  incl

  building data pipelines

  , document scanning and

  ingestion

  , camera feed anomaly detection, etc
• Experience with all relevant tools, platforms and services including

  Big Query, Python,

  Langchain, Gemini, Hugging face, etc
• Understands concepts of

  data governance, cataloging

  , etc