Data Architect

Job Description

Role- Data Architect About Talentica Software Talentica Software is a boutique software development company founded by industry veterans and ex-IITB graduates. We specialize in helping startups build innovative products using cutting-edge tools and technologies. Over our 21 years, we have collaborated with over 180 startups, primarily in the US, leading to many successful exits. In 2022, we were recognized as India's Great Mid-Size Workplace by Great Place to Work. Position: Data Engineer We are looking for a highly skilled Data Engineer to lead the development and implementation of our Data Warehouse/Lakehouse solution. Your expertise will ensure a robust foundation for scalable, high-performance analytics. Key Responsibilities: Lead the end-to-end development and deployment of a scalable and secure Lakehouse architecture. Define best practices for data ingestion, storage, transformation, and processing using modern cloud technologies. Architect data pipelines using ETL/ELT frameworks for structured, semi-structured, and unstructured data. Optimize data modeling strategies to meet analytical and performance needs. Evaluate and select appropriate cloud technologies and frameworks. Develop and maintain efficient, automated data pipelines integrating data from multiple sources (e.g., Oracle, BigQuery, MongoDB). Implement distributed data processing frameworks using tools like Apache Spark and Dataflow. Ensure optimal query performance and cost-effective cloud resource utilization. Establish data governance policies, ensuring compliance with regulations (GDPR, CCPA). Implement robust data access control and security measures across multi-tenant environments. Define data lineage, cataloging, and metadata management for data democratization. Stay updated on cloud data platforms and analytics technologies to drive innovation. Lead Proof of Concepts (POCs) to validate new approaches and technologies. Qualifications: Education: BE/BTech from top institutes in India (IIT, NIT, BITS, etc.). Experience: 8+ years in data engineering with a track record of implementing large-scale data solutions. Technical Skills: Extensive experience with cloud platforms (AWS, GCP, Azure) for data warehouse/lakehouse implementations. Expertise in modern data architectures (Databricks, Snowflake, BigQuery). Strong background in SQL, Python, and distributed computing frameworks (Spark, Dataflow). Experience in building high-volume, reliable data pipelines for real-time and batch processing. Knowledge of data modeling principles (Star Schema, Snowflake Schema). Familiarity with AI tools and implementing semantic layers. Tools & Technologies: Cloud Platforms: AWS, GCP, Azure Data Processing Tools: Apache Spark, Databricks, Airflow, Dataflow Programming: Python, SQL, Scala (advantageous) Database Systems: Oracle, BigQuery, MongoDB CI/CD & Infrastructure as Code: Git, Jenkins Security & Compliance: RBAC, encryption, data masking BI Tools: Tableau, Power BI, Looker Soft Skills: Excellent problem-solving abilities and strategic thinking. Strong leadership and collaboration skills. Effective communication skills for technical concepts. Ability to work independently and manage multiple priorities. What You'll Find Here: Culture of Innovation: We focus on technology expertise, not maintenance projects. Endless Learning Opportunities: Explore advancements in your field and apply them to create innovative products. Talented Peers: Work alongside experienced graduates from top engineering colleges. Work-Life Balance: Flexible schedules with remote working options. Great Culture: 82% of our employees recommend us to their friends.