Data Engineer-Python & Pyspark & GIS-Onsite Hyderabad-Long term contract

As a Data Platform Engineer, you will be responsible for developing and enhancing data-processing, orchestration, monitoring, and more using popular open-source software, AWS, and GitLab automation. Your role will involve collaborating with product and technology teams to design and validate the capabilities of the data platform. Additionally, you will be tasked with identifying, designing, and implementing process improvements, such as automating manual processes and optimizing for usability and scalability. A key aspect of your role will be to provide technical support and usage guidance to the users of our platform services. You will also drive the creation and refinement of metrics, monitoring, and alerting mechanisms to ensure visibility into our production services. To be successful in this position, you should have experience in building and optimizing data pipelines in a distributed environment. You should also be comfortable working with cross-functional teams and have proficiency in a Linux environment. A minimum of 4 years of advanced working knowledge in SQL, Python, and PySpark is required, with a specific emphasis on PySpark queries. Knowledge of Palantir and experience using tools such as Git/Bitbucket, Jenkins/CodeBuild, Code Pipeline, and platform monitoring and alerts tools are also beneficial for this role.,