Category: Uncategorized

HealthTap Builds a Skills-Based Hiring Growth Machine with HackerRank

by HackerRank Blog, posted in Hiring, Uncategorized


What if sharing your symptoms with a doctor was as easy as sharing a photo with a friend?

HealthTap is one startup that’s making this possible. Having received more than 23,000 notes from people thanking HealthTap for saving lives, the company is making healthcare information more accurate and accessible. 

Its latest innovation is the launch of Doctor A.I., which combines the world’s largest network of 105,000 doctors
and 5.4 billion healthcare questions served with a personal artificial intelligence (AI)-powered “physician” that routes users to doctor-recommended insights and care immediately.

But you can’t make real progress in disrupting an industry as dated as healthcare without an army of entrepreneurially minded leaders and engineering talent that isn’t afraid of going the extra mile.
How do you find this kind of talent? If you’re a growth manager, you hack it, of course.

As one of the first product growth managers in the health tech space, Steijn Pelle (pictured above), along with lead designer Jordan Pease tell us how HealthTap is saving lives while building the first growth team for the company:

 

First, give us a little background about yourself and what you’re doing at HealthTap.

Steijn: We basically code….and save lives. I’m not exaggerating. In our product, we give people the opportunity to rate the impact of the experience with HealthTap and Dr. A.I. More than 23,000 people thanked us for saving their lives or the life of a loved one, and told us the story of how we’ve done so–it’s beyond inspiring!

Okay so you’re in charge of both growth and building the first product growth team at HealthTap — finding the right skills and mission-driven people. 

Steijn: Yes. One of the most valuable resources you have at a product company is obviously the designers, data scientists, and engineers that are building a product people love to use. When you need to take time away from your team to evaluate other engineers or candidates you’re bringing in, it becomes very expensive.

Especially when you’re doing it at a scale that we were doing it in. We were reviewing hundreds of candidates per week. Any way you can optimize that adds tons of value to the process.

What kind of process was it?

Steijn: To give you an impression of what our hiring process is like, we looked at more than 3,000 applications to find five people. That makes the ratio of hires to candidates 1 to 600. Especially because we have a mission-driven culture; we have certain core values and we’re in an entrepreneurial stage it’s important to find the right match.

How long did it take you to screen people when you were doing things the traditional way?

As a growth guy, I like to measure things and look at things from an optimization perspective. We basically spent 30 minutes reviewing or doing technical assignments manually–and we did that back in the day through Skype conversations or phone calls. A bottleneck in our funnel.

So we decided to use HackerRank to create custom coding assessments, which are automatically graded for us. This helps us evaluate thousands of people by their skills.

And how did this impact your hiring speed?

Jordan: What we saw with HackerRank was an immediate, massive uptick in productivity and our ability to filter candidates out that didn’t quite cut it without wasting engineering resources.   There was a very significant gap that we jumped across from the time before we had a HackerRank system to after HackerRank.

With HackerRank, we brought that 30 minutes down to five minutes. An engineer only has to look at the assignment, which is already pre-set. So, it’s mostly just directional. Jordan and I were able to get a sense of candidates even if we don’t have HTML or engineering skills. I can get a sense of someone’s skills with coding assessments.

Note: The “time spent screening” is based on HealthTap’s estimation on the average time it takes to perform technical phone screenings. 

But did you see better quality candidates as well? People who were truly skilled?

Jordan: It allowed us to bring through–with less resources, time, and effort–much higher-level candidates through the testing component of HackerRank. It gave us the chance to vet people for technical skills and cultural values.

It’s interesting. I saw a lot of qualified candidates who you would have think would do well on the test because they went to a great school actually not pass the test.

How did HackerRank and this skills-based hiring approach impact your bottom line?

Jordan: With this time back, it’s much easier to ship things faster. Hiring is a time-intensive process. Especially if you’re involved in multiple stages of the process.

At HealthTap we have five stages to a good interview process. If you can eliminate any time away from me as a designer and not a recruiter–Steijn as a growth PM not a recruiter–that’s immense value you’re giving back to the company.

You increase speed in bringing candidates, but also you get to commit your own time to the goals you were initially hired for. It basically turns you into an hiring machine!

Doctor A.I. sounds truly transformative. How long did it take for you to build and ship Doctor A.I.?

Steijn: The knowledge and data-foundation building has taken six years to build up. The engine behind it was built and iterated multiple times over these years. The ontology was built and evolved with thousands of doctors contributing and reviewing since the company was founded. Only within the last year was machine learning and AI applied to the data to train the engine and to create the Doctor A.I. functionality.

Building the UI/UX part was a matter of 4 months from start to finish.

Do you think you shipped faster because of your hiring growth engine?

Steijn: That’s the other thing about hiring, it’s important to consider and measure how much time can you delegate to tools like HackerRank? How many hours do you need to bring in candidates?

Back in the day, before HackerRank, we needed 30 hours to bring in a candidate. We’re able to do it in five hours right now. That’s a big benefit.

What’s next for you?  What are your hiring goals?

Steijn: The rubber meets the road this year. The business is growing very rapidly and we want to at least double the team, while keeping quality as high as it’s always been. What’s holding us back from growing faster is adding more talented and entrepreneurial engineers, designers, product managers, and data scientists. It’s a great problem to have.

We’re excited to work together with HackerRank and others to see how can we save a lot of time to make sure we’re making the right matches. Jordan and I are going to be contributing to that challenge.

I think there’s a great potential on the sourcing side. As we start picking up hiring for the start of the year, we can accelerate the pace of high-quality sourcing of great candidates. The idea of having pre-tested, pre-vetted candidates is phenomenal.

Jordan: We have experience using tools and services like Hired, A-list, Angel list, and they have their own set of vetting. You only get into that batch or pool if there’s a demand for you and if you meet a certain set of requirements. We love those services, and I think having the HackerRank assignment vetted by top engineers adds a layer that I like and I think would add a lot of value.

 

Interested in learning more about HealthTap’s skills-based hiring approach? Say hello.

 

 

Top Performing Coding Bootcamps

by HackerRank Blog, posted in Hiring, Stories, Uncategorized
 It used to be that companies mainly look for developers from top universities, like Stanford, MIT, UC Berkeley. Now, things are changing. Computer science education is more accessible online. We’re standardizing technical skill assessment.
Many companies are hiring people who learned their coding skills through ‘untraditional’ means. VMware, JP Morgan Chase and Puppet…to name a few. By ‘untraditional,’ we mean:

 

  • Bootcamps
  • Junior colleges (or acceleration programs at universities)
  • Online resources (Self-taught)
By 2024, there will be 1.4 million new developer jobs with only 400 thousand CS grads. This mismatch means employers must look at elsewhere to fill the skills gap.
One big hesitation from employers has been: How do you know if these folks actually have the right skills?

 

At HackerRank, we help companies find the right developer based on their skills. Not pedigree. Using practical coding challenges, employers can standardize the way the measure skills. This is the evolution toward skills-based hiring.

 

The White House launched the ‘TechHire Initiative’ in 2015 to promote skills-based hiring as a solution to the skills gap in America. They partnered with us last year to host a nationwide online hackathon. ‘Untraditional’ developers from underrepresented cities solved coding challenges. Employers included Jaguar, Agile, WebMD among many others.

 

The beauty of standardized skill assessments is that you get an apples-to-apples comparison. We were curious: Which bootcamps performed the strongest on HackerRank coding challenges?
TechHire, which is powered by the Opportunity@Work nonprofit, targeted developer communities in 9 states. Fifteen bootcamps participated, and The Software Guild stood out with the most participants. And they had the strongest performers too.

 

We looked at bootcamps with the most developers who made it to the 70th percentile. Dozens of employers sponsored the event in kind, and we sent them contact info of the 70th percentile.

 

 

 

Which Languages Were Most Popular in the TechHire Hackathon?

It turns out, bootcamps focused on Javascript more so than traditional colleges. Javascript’s popularity has been skyrocketing. Because it’s — well — everywhere. It’s used by 94% of all websites.
“Bootcamps have a limited amount of time to teach, and Javascript is a more practical skill in the industry,” says Dr. Heraldo Memelli, the lead content curator at HackerRank. “Javascript has increasingly become of the one of the most sought after skills. It’s a tool that new developers can use to build things fast.”

The Bottom Line

Strong programming skills can come from anywhere, from unlikely towns and unlikely backgrounds. It’s hard to measure someone’s skills based on a certificate of completion. Standardized skill assessment is expanding the talent pool for companies. It uncovers untraditional talent.
Untraditional developers may not look as good on paper. But they could have the drive, ability and skills to do the job. All you have to do is give them the opportunity to prove their skills to you first.
If you enjoyed this piece, subscribe here to get a quick note the next time we have an interesting, new piece on tech hiring.

If you liked this piece, you might like:

 

Which Countries Have the Most Skilled Female Developers?

by HackerRank Blog, posted in Programming, Uncategorized

 

 

 

 

 

 

 

 

 

 

It’s no secret that there’s a gender gap in coding.

Women make up less than a third of the tech talent pool in Silicon Valley. At Google and Facebook, women make up just 17% and 15% of technical positions.

One of the problems could be that recruiters look for talent in the same places — MIT / Stanford — leading to bidding wars for pedigreed candidates and the illusion of a skills shortage, especially among underrepresented groups. When, actually, companies are overlooking thousands of qualified female developers simply because they don’t look good on paper.

We were curious to find out: Where do the best female developers live? We decided to analyze our data of 2M+ developers.

At HackerRank, we create coding challenges to help find top talent and help developers get jobs. Hundreds of thousands of developers from all over the world participate in challenges in a variety of programming languages and knowledge domains, from Python to artificial intelligence to distributed systems.

About 17% of people who have solved HackerRank coding challenges are female. According to our data, India and Italy have the highest percentage of female developers, while women from Belarus, China and Russia score the best. We also found that female developers are unusually likely to take our Java challenges, and are not drawn to our challenges on security or artificial intelligence.

***

We began our analysis with an attempt to assess exactly how many HackerRank test takers are female. Though we don’t collect gender data from our developers, we were able to assign a gender to about 80% of developers based on their first name. (We did not include first names with equal gender distributions, such as Taylor or Riley.)

The vast majority – 82.9% – of developers on HackerRank are male. Though the gender balance is far from equal, it’s a significantly more balanced than the 5.8% female StackOverflow survey result.

Next, we looked for trends within countries. Below is a breakdown of the share of female developers from each of the top 50 countries with the most developers on HackerRank. For each of these countries, thousands of developers have participated in a HackerRank challenge.

Russia’s female developers, who only account for 7.8% of Russian HackerRank developers, top the list with an average score of 244.7 on algorithms tests.

Russia is closely followed by its European counterparts in Italy and Poland. Though India has the largest share of female developers, they rank 18th, with a middling average score of 146.2 points.

***

So what does looking abroad teach us about the gender gap in coding?

For starters, we see further evidence that the United States, which ranks 11th in terms of percentage of female developers and should improve…especially in regards to Java development. In comparison, women in India are growing up with coding stitched a little closer into their culture.

But we also see an encouraging sign for women who find themselves working in a male-dominated industry. Relatively few women in Belarus, China, and Russia participate in coding challenges. But their female developers—despite these challenges—are still crushing it.

…

Is diversity hiring one of your goals?
Learn how to find more female developers.

…

India, which contributes nearly 40% of HackerRank’s developers, leads the pack with about 23% female developers. Experts have found that India’s education and tech industry culture is more conducive to gender equality in computer programming.

The United States, the second largest contributor of developers, falls just shy of the top 10 with 14.8% female developers. Chile had the lowest representation of women, with fewer than 3% female developers.

When women do take our challenges, which computer programming domains are they particularly drawn to? The chart below shows the percentage of female test takers for each of our challenges.

Women account for 21% of developers in tutorial and Java challenges. The tutorials domain includes our 30 Days of Code Challenge, which is heavily Java-based. Women spend the least time on artificial intelligence and security challenges.  

 

…

Looking to hire more female developers?
Learn more about skills-based hiring to boost diversity.

…

So, does more female developers mean better female developers?

We looked at women’s average scores on algorithms challenges (which account for more than 40% of all HackerRank tests taken) to find out. Algorithms challenges include sorting data, dynamic programming, searching for keywords, and other logic-based tasks. Scores typically range from 0 to 115 points. We examined the 20 countries with the most female developers in order to have large sample sizes.

 

Russia’s female developers, who only account for 7.8% of Russian HackerRank developers, top the list with an average score of 244.7 on algorithms tests.

Russia is closely followed by its European counterparts in Italy and Poland. Though India has the largest share of female developers, they rank 18th, with a middling average score of 146.2 points.

***

So what does looking abroad teach us about the gender gap in coding?

For starters, we see further evidence that the United States, which ranks 11th in terms of percentage of female developers and should improve…especially in regards to Java development. In comparison, women in India are growing up with coding stitched a little closer into their culture.

But we also see an encouraging sign for women who find themselves working in a male-dominated industry. Relatively few women in Belarus, China, and Russia participate in coding challenges. But their female developers—despite these challenges—are still crushing it.

 

Is diversity hiring one of your goals?
Learn how to find more female developers.