We are looking for the Data Quality Engineer, the developer of a data quality layer in the large scale data infrastructure.

Data Quality Engineer creates manual and automated tests for monitoring and testing data in the warehouse. The database we use is https://clickhouse.com/ , which has standard support of SQL. Data test creation involves investigating blockchain data structures, invariants, consensus and protocols. Automated scripts that can fix the data in automatic or semi-automatic mode helps to ensure data quality in a continuous process.

Metric of success is the test coverage over the data, number of client complaints on data quality. These metrics are achieved by automating tests, scripts and any procedures, as with a big data warehouse operating it in the manual manner can not be efficient.

Role & Responsibilities:

• Design and implement data quality layer in the large scale data infrastructure;
• Execute a data quality testing framework to validate data at various stages of the processing lifecycle;
• Hands-on with test preparation and execution in the Agile and DevOps environment;
• Become familiar with Bitquery’s blockchain products, data sets, and processing pipelines;
• Coordinate with subject matter experts to develop, maintain, and validate test scenarios;
• Meet with internal stakeholders to review current testing approaches and provide feedback on ways to improve/extend / automate;
• Preparation, review and update of test cases and relevant test data consistent with the system requirements, including functional, integration & regression
• Analyze, debug, and document quality issues
• Record and report test status at the respective stages
• Be proactive and follow Shift-left testing approach in identifying the issues early and following-up on them efficiently
• Support quality assurance initiatives and help institutionalize best practices
• Maximize the opportunity to excel in an open and recognising work culture. Be a problem solver and a team player to make a bigger contribution to the achievements.
• Open to learn from each other in the team and each experience day-to-day