Data Engineer

1. 5-12 Years of in Big Data & Data related technology experience
2. Expert level understanding of distributed computing principles3. Expert level knowledge and experience in Apache Spark 4. Hands on programming with Python5. Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop6. Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming 7. Experience with messaging systems, such as Kafka or RabbitMQ8. Good understanding of Big Data querying tools, such as Hive, and Impala9. Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files10. Good understanding of SQL queries, joins, stored procedures, relational schemas11. Experience with NoSQL databases, such as HBase, Cassandra, MongoDB12. Knowledge of ETL techniques and frameworks13. Performance tuning of Spark Jobs14. Experience with native Cloud data services AWS or AZURE Databricks15. Ability to lead a team efficiently16. Experience with designing and implementing Big data solutions17. Practitioner of AGILE methodology