Chakra Launches for General Availability
HackerRank has made its AI interviewer, Chakra, generally available to customers starting Monday. This innovative tool is designed to observe candidates as they work, ask contextual follow-up questions, and produce detailed reports for hiring managers. During its six-month beta phase, Chakra conducted over 500,000 interviews, with organizations such as Snowflake, Snorkel, and Capgemini participating in the testing.
Interview Structure and AI Fluency
Chakra places candidates in a workspace connected to a real-world code repository, accompanied by an embedded AI assistant. As candidates tackle tasks, the system prompts them with follow-up questions, such as why they chose a particular approach or how their solution would adapt to new constraints. This structure aims to mimic on-the-job work rather than traditional timed coding tests.
HackerRank co-founder and CEO Vivek Ravisankar emphasized that the evaluation process is shifting from merely judging final outputs to examining the thinking and judgment behind them. The startup also aims to assess what it terms “AI fluency,” which refers to how well candidates frame problems for AI, evaluate its output, and guide it toward solutions.
Human Oversight and Cheating Concerns
Ravisankar clarified that Chakra is designed to score candidates rather than make final hiring decisions, leaving those choices to human reviewers. Interestingly, HackerRank reported that suspicious-activity flags were 70% to 80% lower in Chakra interviews compared to traditional assessments, although this rate varied based on geography and seniority. Ravisankar argued that providing candidates with AI access during interviews can reduce the temptation to use outside tools covertly.
Regulatory Scrutiny and Compliance
HackerRank is aware of the regulatory scrutiny surrounding automated hiring tools. In some jurisdictions, such as New York City, employers using certain automated decision-making systems are required to conduct independent bias audits and notify candidates beforehand. Ravisankar acknowledged that compliance with such regulations is a key aspect of what HackerRank has integrated into Chakra.
Strategic Shift in Assessment
Since launching its original product at TechCrunch Disrupt in 2012, HackerRank has grown to serve over 3,000 business customers, including Amazon, Nvidia, Clay, and Replit, and boasts a community of over 30 million developers worldwide. Ravisankar likened the transition to Chakra to Apple’s evolution from the iPod to the iPhone, suggesting that while the old product still holds value, Chakra represents the future direction of the market.
Original source: TechCrunch AI