“If you cannot measure it, you cannot improve it.”

Indeed, the most critical skill of a data scientist (DS) is the ability to define the right metrics for measuring the success of a product. Because of this, there is significant emphasis on Business Case interviews (also known as Product Sense or Metrics interviews) for data scientist roles, as companies wish to identify candidates who have strong product sense and are able to help stakeholders make data-informed decisions.

https://towardsdatascience.com/the-ultimate-guide-to-cracking-business-case-interviews-for-data-scientists-part-1-cb768c37edf4

1. Say you need to produce a binary classifier for fraud detection. What metrics would you look at, how is each defined, and what is the interpretation of each one?

Answer