Data Engineer- Sc Cleared- London (Hybrid)

Data Engineer- SC Cleared is a must

Rate- £375-400/day OUTSIDE IR35, Location- London- Hybrid (2-3 days/ week in office)

1. Build streaming data ingestion pipelines using AWS MSK and batch data ingestion pipelines using APIs
2. Experience working with various data formats e.g., parquet, Avro, json.
3. Experience in building ETL pipelines using S3, Lambda, Step Functions, and Glue - building inbound / outbound data pipelines (using APIs)
4. Building data processing pipelines based on the business transformation rules
5. Experience working with various AWS database services (e.g, RDS, DynamoDB, and Redshift)
6. Technical expertise with various data modelling techniques
7. Hands-on experience with Python and SQL
8. Should be SC Cleared