Job
Description
We are looking for a skilled Database Engineer with 5 to 10 years of experience to design, develop, and maintain our database infrastructure. This position is based remotely.
Roles and Responsibility
Design, develop, and maintain the database infrastructure to store and manage company data efficiently and securely.Work with databases of varying scales, including small-scale and big data processing.Implement data security measures to protect sensitive information and comply with relevant regulations.Optimize database performance by analyzing query execution plans, implementing indexing strategies, and improving data retrieval and storage mechanisms.Collaborate with cross-functional teams to understand data requirements and support the design of the database architecture.Migrate data from spreadsheets or other sources to relational database systems or cloud-based solutions like Google BigQuery and AWS.Develop import workflows and scripts to automate data import processes.Ensure data integrity and enforce data quality standards, including data validation rules, constraints, and referential integrity.Monitor database health and resolve issues, while collaborating with the full-stack web developer to implement efficient data access and retrieval mechanisms.Demonstrate creativity in problem-solving and contribute ideas for improving data engineering processes and workflows, exploring third-party technologies as alternatives to legacy approaches for efficient data pipelines.Embrace a learning mindset, staying updated with emerging database technologies, tools, and best practices, and use Python for tasks such as data manipulation, automation, and scripting.Collaborate with the Data Research Engineer to estimate development efforts and meet project deadlines, taking accountability for achieving development milestones.Prioritize tasks to ensure timely delivery in a fast-paced environment with rapidly changing priorities, while also collaborating with fellow members of the Data Research Engineering Team as required.Perform tasks with precision and build reliable systems, leveraging online resources effectively like StackOverflow, ChatGPT, Bard, etc., considering their capabilities and limitations.Job Proficiency in SQL and relational database management systems like PostgreSQL or MySQL, along with database design principles.Strong familiarity with Python for scripting and data manipulation tasks, with additional knowledge of Python OOP being advantageous.Demonstrated problem-solving skills with a focus on optimizing database performance and automating data import processes.Knowledge of cloud-based databases like AWS RDS and Google BigQuery.Experience with data warehousing concepts and tools (e.g., Snowflake, Redshift) to support advanced analytics and reporting.Skills in working with APIs for data ingestion or connecting third-party systems, which could streamline data acquisition processes.Proficiency with tools like Prometheus, Grafana, or ELK Stack for real-time database monitoring and health checks beyond basic troubleshooting.Familiarity with continuous integration/continuous deployment (CI/CD) tools (e.g., Jenkins, GitHub Actions).Deeper expertise in cloud platforms (e.g., AWS Lambda, GCP Dataflow) for serverless data processing or orchestration.Knowledge of database development and administration concepts, especially with relational databases like PostgreSQL and MySQL.Knowledge of Python programming, including data manipulation, automation, and object-oriented programming (OOP), with experience in modules such as Pandas, SQLAlchemy, gspread, PyDrive, and PySpark.Knowledge of SQL and understanding of database design principles, normalization, and indexing.Knowledge of data migration, ETL (Extract, Transform, Load) processes, or integrating data from various sources.Knowledge of data security best practices, including access controls, encryption, and compliance standards.Strong problem-solving and analytical skills with attention to detail.Creative and critical thinking.Strong willingness to learn and expand knowledge in data engineering.Familiarity with Agile development methodologies is a plus.Experience with version control systems, such as Git, for collaborative development.Ability to thrive in a fast-paced environment with rapidly changing priorities.Ability to work collaboratively in a team environment.Good and effective communication skills.Comfortable with autonomy and ability to work independently.About Company
Marketplace is an experienced team of industry experts dedicated to helping readers make informed decisions and choose the right products with ease. We arm people with trusted advice and guidance, so they can make confident decisions and get back to doing the things they care about most.
