Frequently Asked Questions

Competition

Will the Humana-Mays Case Competition still be held due to COVID-19?

Yes! The Case Competition will be held in the Fall of 2021. Follow us on our Facebook for up-to-date announcements.

Where can I learn more about the Humana-Mays Healthcare Analytics Case Competition Round 1 Leaderboard?

You can learn more about the Round 1 Leaderboard here.

Where can I find the Humana-Mays Healthcare Analytics Case Competition Fairness in AI Guide?

You can find the Humana-Mays Healthcare Analytics Case Competition Fairness in AI Guide here.

How are Round One and Round Two different in terms of the analysis for the participants?

The 2 items required for a complete submission on October 10th will be used in Round One and Round Two of judging.

Round 1: This is all about prediction accuracy and ‘fairness’ (i.e equal opportunity) in your solution. Using the HOLDOUT file, a ROC/AUC metric will be calculated for each team to measure the accuracy of the prediction.  Similarly, a DISPARITY SCORE will be calculated to measure ‘fairness’ in the modeling solution.  These two measures will be combined for each submission and compared across all participants.  The top 50 submissions from Round 1 will move on to Round 2.

Refer to the PowerPoint used in the kick-off meeting and the “Fairness in AI Guide” to see more details on the judging criteria.

Will the Kickoff Call recording and PowerPoint be available?

Yes, the recording and PowerPoint will be posted on the website.

Will people who weren’t selected for Round Two still present?

No, only the finalists will present their analysis.

Can we get school credit for working on this case?

Competitors may use their submission for class work after the final rounds are complete.

Once questions pertaining to the case are submitted, when can we expect to receive answers?

Questions will be answered within two business days and uploaded to “Weekly Asked Questions” as they are answered.

What are the judging criteria for accuracy and fairness?

Round 1 is evaluating modeling accuracy & fairness using objective metrics based on the HOLDOUT file returned by the participants.

Accuracy: ROC/AUC measure will be calculated

Fairness: Disparity score calculated using RACE & SEX

Refer to the PowerPoint used in the kick-off meeting and the “Fairness in AI Guide” to see more details on the judging criteria.

Registration

Will we receive a confirmation email once our team has been registered successfully?

Yes, each team member will receive a confirmation that their team has been registered successfully.

Is there a number for us to dial in to the Kick Off Call?

An email will be sent with a link inviting students to join the Kickoff Call.

Is someone who formerly worked for Humana eligible to compete?

As long as the member of the team is no longer considered a Humana employee, they may compete.

How can we form a team?

Teams are to be formed on your own. As long as you are a full-time and/or part-time master’s student enrolled in the same university, you can be on a team together. Teams can be interdisciplinary.

Can I form a team with an undergraduate student?

No. This competition is open to master’s level students from within the same university.

What is the minimum/maximum number of students allowed on a team?

The team minimum is 2 students and maximum is 4 students.

Can I compete with more than one team?

No, students are only allowed to register for one team.

Have my Round One or Round Two submissions been received?

Each team member will receive a confirmation email that the submission has been received successfully. If you have any issues, please contact humanacasecomp@tamu.edu.

Deliverables

Is there a page limit for submission?

There is no page limit, but a concise presentation of findings will be noted during judging. Based on previous competitions, finalists typically submit between 15-25 pages. Please see previous finalist submissions here.

Do we submit different documentation for rounds 1 and 2?

For round 1 & 2, you are required to submit 2 different deliverables by the submission deadline of October 10th, 2021.

Deliverable 1: A scored CSV file of the holdout file that contains 3 fields: ID, SCORE, and RANK

Deliverable 2: A written summary of your work including key findings, implications, and recommendation.

Refer to previous finalist submissions for several examples of successful submissions.

Do we need an executive summary?

That is up to the participants. There is no exact guidelines for final submissions. They should be professional and concise.

Can we request feedback from non-participants?

Discussion of the case with external parties is not allowed, per the signed NDA. Discussion of programming is allowed, though guidance on the analytic approach is forbidden.

In the second round, can we include visualization tools?

There are no restrictions as long as the final deliverable is in a PowerPoint presentation.

If we are removing observations or making assumptions, do we have to validate them first through email or can we just move forward as long as we have good reasons to back them up?

As long as you have good reason to back it up, it is fine.

Data

When will the dataset be available?

There will be two rounds. Students who have registered by the first deadline (September 13, 2021) will receive the dataset by 11:59 p.m. CST on September 15, 2021. Students who have registered by the second deadline (September 17, 2021) will receive the dataset by 11:59 p.m. CST on September 19, 2021.

What format will the dataset be in?

CSV file, with a data dictionary.

Are we allowed to use publicly available data to help us in this case competition?

Yes. Students are encouraged to use open-source data when creating a solution.