Address
Form of workData - Test Engineer
The Role
Sogeti UK is renowned for being the Testing & Quality Engineering specialists and we're looking for talented individuals with a passion for quality engineering and testing who want to join a market leading organisation as a Data Quality Assurance Specialist.
Essential Skills:
- Expertise in testing data validation scenarios and processes related to data ingestion, pipelines, and transformation (e.g., ETL).
- Ability to work closely with data engineering functions to establish a sustainable test approach.
- Understanding of big data engineering tools and their strategic utilization (e.g., PySpark, Hive, Hadoop, Cloudera, Stackable.tech).
- Proficiency in working with Apache NiFi, Apache PySpark 2.4, Hive QL, Power BI, Kibana, and Apache Superset.
- Proven experience with Data Lake/Delta Lake technologies.
- Strong experience in working with MS SQL and PostgreSQL databases.
- Hands-on experience with automated testing tools.
- Experience working with large datasets and data ingestion pipelines.
- Demonstrated ability to automate tests across multiple platforms and technologies throughout the development lifecycle.
- Proficient in Issue and Defect Management.
- Testing systems that capture, verify, and maintain field-generated metadata.
- Familiarity with multiple backend databases, database design, and APIs.
- Experience with Agile Software Development & Testing methods.
- Strong experience in SQL, with the ability to extract and manipulate data.
- Hands-on experience with data ingestion, cleaning, verifying, and validating processes.
- Commercial experience within the Azure cloud, particularly with Databricks, Data Factory, and Synapse.
- Data visualization experience using PowerBI.
- Desirable experience with Python, Spark, or PySpark.
Nice-to-Have Skills:
- Knowledge of issue tracking and project management tools.
- Ability to grasp the broader perspective of automation frameworks and testing across a range of products.
- Demonstrated experience in manual and automation testing, specifically in validating data sources, extraction, transformation logic, and loading data into target tables.
