About Albany Beck

Albany Beck is a consultancy dedicated to delivering tailored talent and operational solutions to our clients across Financial Services and beyond. We partner with top-tier financial institutions to deliver expert consulting and transformation services. Our collaborative approach places experienced professionals in high-impact roles, helping our clients to navigate complex challenges and realise strategic outcomes.

Purpose:

The model quality assurance lead is responsible for designing, implementing, and performing the quality checks on input and output data for a specific model, and in case of Machine Learning models, will implement regression tests to measure model performance after retraining.

Their focus is to ensure that their assigned models are delivering to a high-quality standard and meet internal production timelines. This involves developing and executing a list of quality assurance checks that may differ per product. To this end they carry out the data quality checks, trace back errors through the model computation. They should report on controls, provide regular quality reports to track progress, and keep a catalogue of errors.

They will also provide recommendations on how we can improve model quality to the model manager and business analyst as part of a backlog of enhancements.

Accountabilities:

• Running checks and balances to spot spurious / anomalous values in all datasets (inputs, intermediaries, and model outputs); must be done for each input dataset and all output files per model.
• Design, implement and complete the quality checks on raw and delivered data by model in Python code. In certain cases, these checks may be automated.
• In case of Machine Learning models, implement non-regression tests to measure performance of the model.
• Make sure that issues with either input data quality or output data quality are followed up with other content / research partners,
• Centralization of model quality documentation based on sources. Produce Model Quality Control Reports, showing model performance and quality/accuracy.
• Document recurrent errors and related resolutions
• Finding opportunities for model automation and optimization
• Works with content management to make sure data sources have been refreshed for all live models and ensuring refreshes are done in a timely fashion.
• Working with the Model Manager to Ensure availability of model outputs to FTSE Index Research and LSEG D&A Product Development teams within agreed timelines.

Key skills:

• Good knowledge of queries to DBs, data analysis and data checks,
• Good proficiency in Python and coding standards
• Some experience with cloud solutions (AWS, Azure, GCP) is a plus
• Understanding of quantitative tools and techniques, with the ability to perform quantitative/qualitative analysis required,
• Strong analytical and problem-solving skills, good attention to detail, proven writing skills,
• Understanding/Curiosity about Sustainability Investments (climate, ESG,…),
• Collaborative, with intellectual curiosity to independently research topics,
• Solid experience of Microsoft Office (Word, Excel, PowerPoint, Jira, and Confluence),
• At least 2 years’ experience in a similar role.

Show more
Show less