Senior Manager, Measurement Analytics and Test Design (Hybrid or Remote)

Role Specific Information

Job Description

About the Role

As Senior Manager, Measurement Analytics and Test Design, you will identify organizational learning goals, develop holistic omnichannel testing strategies, schedule organizational testing and communication plans and create and implement statistical testing procedures. 

What You’ll Do

• Lead the conversation on the scaling, persevering or shelving of marketing tactics

• Design long-term testing strategies based on organizational learning initiatives

• Manage the execution of tests and ensure the validity of results

• Lead ad-hoc analysis for upcoming and in-flight campaigns and provide the approach for data modeling

• Prepare aggregated testing results, generally tied to a learning initiative, for broad audiences 

• Drive organizational change through effective storytelling based on test results

• Define the coding, model selection, visualization and analytical approach for research projects

• Implement analytical processes and data models into production (e.g., Break Even modeling)

• Lead the overall portfolio of process improvement opportunities and development of new capabilities 

• Own the measurement capability roadmap and align stakeholder needs with capabilities and processes

• Design protocols and procedures for testing, including statistical models and execution standards 

• Facilitate improvement projects with internal teams and partners

• Establish testing and analysis KPIs 

• Lead ad hoc modeling projects to develop machine learning solutions aimed at facilitating test design and informing target audiences for marketing tests

• Lead the technical development of resources to meet measurement capabilities, including statistical analysis, coding (R, Python, SQL) and data visualization (Tableau, R)

• Additional tasks may be assigned

What Skills You Have

Required

• Master’s Degree in Data Science, Business, Statistics, Computer Science, Management Information Systems or similar

• 6+ years of experience

• Advanced experience in SQL and knowledge of Excel functions

• Deep understanding of statistical analysis, Data Mining and Machine Learning toolsets and methodologies

• Extensive experience and knowledge of A/B test measurement and associated methodologies (incl. statistical tests, bias correction, propensity score modeling, et al.)

• Experience with one or many object-oriented programming languages (R, Python, C++, Java, etc.) and the ability to write production-level programs

• Background in utilizing data visualization tools (e.g., Tableau, PowerBI), and an advanced understanding of data visualization practices

• Demonstrated project management skills

• 2+ years of experience in leading analytics or data science teams

• Experience with designing testing programs

Preferred

• Experience developing production-level Machine Learning/statistical algorithms

Essential Functions

The requirements listed below are representative of functions you will be required to perform, however you may be required to perform additional functions. Kohl’s may revise this job description from time to time. To perform this job successfully, you must be able to perform each essential function satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions, absent undue hardship.

• Ability to perform the accountabilities listed in the “What You’ll Do” Section

• Ability to comply with dress code requirements

• Basic math and reading skills, legible handwriting, and basic computer operation

• Ability to maintain prompt and regular attendance and meet scheduling requirements as set by the company

• Ability to learn and comply with all company policies, procedures, standards and guidelines

• Ability to give direction and to receive, understand and proactively respond to direction from leadership and other company personnel

• Ability to work as part of a team and interact effectively and appropriately with others

• Ability to maintain composure and work in a fast paced environment while accomplishing multiple tasks within established timeframes

• Ability to satisfactorily complete company training programs

• Ability to use a personal computer for tasks such as communicating, preparing reports, etc.

• Ability to plan, prioritize and monitor activities across business units

• Ability to complete or oversee the completion of assigned projects in a timely manner