Clicky

  • Login
  • Register
  • Submit Your Content
  • Contact Us
Sunday, July 6, 2025
World Tribune
No Result
View All Result
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food
Submit
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food
No Result
View All Result
World Tribune
No Result
View All Result

Workday, Amazon AI employment bias claims add to growing concerns about the tech’s hiring discrimination

July 5, 2025
in Business
Reading Time: 5 mins read
A A
Workday, Amazon AI employment bias claims add to growing concerns about the tech’s hiring discrimination
0
SHARES
ShareShareShareShareShare

Workday, Amazon AI employment bias claims add to growing concerns about the tech’s hiring discrimination

Despite AI hiring tools’ best efforts to streamline hiring processes for a growing pool of applicants, the technology meant to open doors for a wider array of prospective employees may actually be perpetuating decades-long patterns of discrimination.

READ ALSO

4 key trends dominating office design and planning: ABM CEO Scott Salmirs

Texas flood: 14 children among the 37 dead so far

AI hiring tools have become ubiquitous, with 492 of the Fortune 500 companies using applicant tracking systems to streamline recruitment and hiring in 2024, according to job application platform Jobscan. While these tools can help employers screen more job candidates and help identify relevant experience, human resources and legal experts warn improper training and implementation of hiring technologies can proliferate biases.

Research offers stark evidence of AI’s hiring discrimination. The University of Washington Information School published a study last year finding that in AI-assisted resume screenings across nine occupations using 500 applications, the technology favored white-associated names in 85.1% of cases and female associated names in only 11.1% of cases. In some settings, Black male participants were disadvantaged compared to their white male counterparts in up to 100% of cases.

“You kind of just get this positive feedback loop of, we’re training biased models on more and more biased data,” Kyra Wilson, a doctoral student at the University of Washington Information School and the study’s lead author, told Fortune. “We don’t really know kind of where the upper limit of that is yet, of how bad it is going to get before these models just stop working altogether.”

Some workers are claiming to see evidence of this discrimination outside of just experimental settings. Last month, five plaintiffs, all over the age of 40, claimed in a collective action lawsuit that workplace management software firm Workday has discriminatory job applicant screening technology. Plaintiff Derek Mobley alleged in an initial lawsuit last year the company’s algorithms caused him to be rejected from more than 100 jobs over seven years on account of his race, age, and disabilities.

Workday denied the discrimination claims and said in a statement to Fortune the lawsuit is “without merit.” Last month the company announced it received two third-party accreditations for its “commitment to developing AI responsibly and transparently.”

“Workday’s AI recruiting tools do not make hiring decisions, and our customers maintain full control and human oversight of their hiring process,” the company said. “Our AI capabilities look only at the qualifications listed in a candidate’s job application and compare them with the qualifications the employer has identified as needed for the job. They are not trained to use—or even identify—protected characteristics like race, age, or disability.”

It’s not just hiring tools with which workers are taking issue. A letter sent to Amazon executives, including CEO Andy Jassy, on behalf of 200 employees with disabilities claimed the company flouted the Americans with Disabilities Act. Amazon allegedly had employees make decisions on accommodations based on AI processes that don’t abide by ADA standards, The Guardian reported this week. Amazon told Fortune its AI does not make any final decisions around employee accommodations.

“We understand the importance of responsible AI use, and follow robust guidelines and review processes to ensure we build AI integrations thoughtfully and fairly,” a spokesperson told Fortune in a statement.

How could AI hiring tools be discriminatory?

Just as with any AI application, the technology is only as smart as the information it’s being fed. Most AI hiring tools work by screening resumes or resume screening evaluating interview questions, according to Elaine Pulakos, CEO of talent assessment developer PDRI by Pearson. They’re trained with a company’s existing model of assessing candidates, meaning if the models are fed existing data from a company—such as demographics breakdowns showing a preference for male candidates or Ivy League universities—it is likely to perpetuate hiring biases that can lead to “oddball results” Pulakos said.

“If you don’t have information assurance around the data that you’re training the AI on, and you’re not checking to make sure that the AI doesn’t go off the rails and start hallucinating, doing weird things along the way, you’re going to you’re going to get weird stuff going on,” she told Fortune. “It’s just the nature of the beast.”

Much of AI’s biases come from human biases, and therefore, according to Washington University law professor Pauline Kim, AI’s hiring discrimination exists as a result of human hiring discrimination, which is still prevalent today. A landmark 2023 Northwestern University meta-analysis of 90 studies across six countries found persistent and pervasive biases, including that employers called back white applicants on average 36% more than Black applicants and 24% more than Latino applicants with identical resumes.

The rapid scaling of AI in the workplace can fan these flames of discrimination, according to Victor Schwartz, associate director of technical product management of remote work job search platform Bold.

“It’s a lot easier to build a fair AI system and then scale it to the equivalent work of 1,000 HR people, than it is to train 1,000 HR people to be fair,” Schwartz told Fortune. “Then again, it’s a lot easier to make it very discriminatory, than it is to train 1,000 people to be discriminatory.”

“You’re flattening the natural curve that you would get just across a large number of people,” he added. “So there’s an opportunity there. There’s also a risk.”

How HR and legal experts are combatting AI hiring biases

While employees are protected from workplace discrimination through the Equal Employment Opportunity Commission and Title VII of the Civil Rights Act of 1964, “there aren’t really any formal regulations about employment discrimination in AI,” said law professor Kim. 

Existing law prohibits against both intentional and disparate impact discrimination, which refers to discrimination that occurs as a result of a neutral appearing policy, even if it’s not intended.

“If an employer builds an AI tool and has no intent to discriminate, but it turns out that overwhelmingly the applicants that are screened out of the pool are over the age of 40, that would be something that has a disparate impact on older workers,” Kim said.

Though disparate impact theory is well-established by the law, Kim said, President Donald Trump has made clear his hostility for this form of discrimination by seeking to eliminate it through an executive order in April.

“What it means is agencies like the EEOC will not be pursuing or trying to pursue cases that would involve disparate impact, or trying to understand how these technologies might be having a discrete impact,” Kim said. “They are really pulling back from that effort to understand and to try to educate employers about these risks.”

The White House did not immediately respond to Fortune’s request for comment.

With little indication of federal-level efforts to address AI employment discrimination, politicians on the local level have attempted to address the technology’s potential for prejudice, including a New York City ordinance banning employers and agencies from using “automated employment decision tools” unless the tool has passed a bias audit within a year of its use. 

Melanie Ronen, an employment lawyer and partner at Stradley Ronon Stevens & Young, LLP, told Fortune other state and local laws have focused on increasing transparency on when AI is being used in the hiring process, “including the opportunity [for prospective employees] to opt out of the use of AI in certain circumstances.”

The firms behind AI hiring and workplace assessments, such as PDRI and Bold, have said they’ve taken it upon themselves to mitigate bias in the technology, with PDRI CEO Pulakos advocating for human raters to evaluate AI tools ahead of their implementation.

Bold technical product management director Schwartz argued that while guardrails, audits, and transparency should be key in ensuring AI is able to conduct fair hiring practices, the technology also had the potential to diversify a company’s workforce if applied appropriately. He cited research indicating women tend to apply to fewer jobs than men, doing so only when they meet all qualifications. If AI on the job candidate’s side can streamline the application process, it could remove hurdles for those less likely to apply to certain positions.

“By removing that barrier to entry with these auto-apply tools, or expert-apply tools, we’re able to kind of level the playing field a little bit,” Schwartz said.

Credit: Source link

ShareTweetSendSharePin
Previous Post

Get two months of Essential or Premium for only $2

Next Post

I tried Denmark’s No. 1 secret to happiness for a year—it made me happier and more confident

Related Posts

4 key trends dominating office design and planning: ABM CEO Scott Salmirs
Business

4 key trends dominating office design and planning: ABM CEO Scott Salmirs

July 6, 2025
Texas flood: 14 children among the 37 dead so far
Business

Texas flood: 14 children among the 37 dead so far

July 6, 2025
Camp Mystic has been in the same family for generations
Business

Camp Mystic has been in the same family for generations

July 6, 2025
Secret Service in US expands a global push against crypto scams
Business

Secret Service in US expands a global push against crypto scams

July 6, 2025
Ford CEO Jim Farley warns AI will wipe out half of white-collar jobs
Business

Ford CEO Jim Farley warns AI will wipe out half of white-collar jobs

July 5, 2025
OPEC+ to ramp up oil output even higher with eye on market share
Business

OPEC+ to ramp up oil output even higher with eye on market share

July 5, 2025
Next Post
I tried Denmark’s No. 1 secret to happiness for a year—it made me happier and more confident

I tried Denmark's No. 1 secret to happiness for a year—it made me happier and more confident

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

What's New Here!

David Bakhtiari shades Aaron Rodgers with Jordan Love wedding photo

David Bakhtiari shades Aaron Rodgers with Jordan Love wedding photo

July 1, 2025
It’s time for U.S. to treat rare earths as power. China already does

It’s time for U.S. to treat rare earths as power. China already does

June 29, 2025
Pocket Boss turns corporate data manipulation into a puzzle game

Pocket Boss turns corporate data manipulation into a puzzle game

June 7, 2025
Tesla first driverless delivery new car to customer

Tesla first driverless delivery new car to customer

June 29, 2025
Peak Design’s new tripods take aim at the professional set

Peak Design’s new tripods take aim at the professional set

June 17, 2025
Consumer spending pulled back in May as inflation heated up—a double whammy of bad news

Consumer spending pulled back in May as inflation heated up—a double whammy of bad news

June 28, 2025
The two Luis Ortiz pitches that led to MLB’s gambling investigation

The two Luis Ortiz pitches that led to MLB’s gambling investigation

July 4, 2025

About

World Tribune is an online news portal that shares the latest news on world, business, health, tech, sports, and related topics.

Follow us

Recent Posts

  • Prime Day deals include the Ring Pan-Tilt Indoor Cam for only $40
  • Claim $150 bonus or $1K first bet safety net for Wimbledon
  • 4 key trends dominating office design and planning: ABM CEO Scott Salmirs
  • Trade deadlines and oil drama set the stage for a crunch week in global markets

Newslatter

Loading
  • Submit Your Content
  • Contact Us
  • Privacy Policy
  • Terms of Use
  • DMCA

© 2024 World Tribune - All Rights Reserved!

No Result
View All Result
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food

© 2024 World Tribune - All Rights Reserved!

Welcome Back!

Login to your account below

Forgotten Password? Sign Up

Create New Account!

Fill the forms below to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In