Senior Software Engineer, Big Data

software data technology ai design processing databricks apache spark etl service cutting analytics hadoop elasticsearch aws drive reliability automation docker kubernetes terraform code development scalability efficiency mentoring optimization management troubleshooting pipeline tuning query agile planning stability security compliance controls encryption governance scala java debugging sql nosql mysql microservices leadership airflow orchestration sensors integration learning mllib ml devops monitoring