DebbieFL said:
Is my neighbor right that I'd lose money permanently?
No, your neighbor is wrong on the part that scared you most, and Patty is right. Let me lay out the general rules, because this is one of the most misunderstood corners of Social Security. Education, not advice for your specific numbers.
Take the job question first. Because you claimed before full retirement age and you're still under it, the retirement earnings test applies. In 2025 the annual limit was around $23,400, and it rises a little most years, so check the current figure at SSA.gov before you plan around it. For every $2 you earn above that limit, Social Security withholds $1 of benefits. So at 20 hours a week you could easily cross it, and some benefit would be withheld.
Here's the part your neighbor missed: that money is not lost. When you reach full retirement age, Social Security recalculates your benefit and credits you back for the months that were withheld, in the form of a permanently higher monthly check from then on. So it's a delay, not a forfeiture. Over a normal lifespan most people get all of it back and then some.
Now the three sub-questions floating in the thread. First, what counts toward the limit: only earned income, meaning wages and net self-employment. Gary has it exactly right, your IRA withdrawals, pensions, dividends, interest, and capital gains do NOT count, so drawing down that IRA has zero effect on the earnings test. Second, it changes in the year you actually reach full retirement age: the limit jumps much higher (around $62,000 in 2025), the withholding softens to $1 for every $3 over, and only the months before your birthday month count. Third, and this is the relief, once you hit full retirement age the earnings test disappears entirely. From 67 on you can earn a million dollars a year and Social Security won't touch your benefit.
Two footnotes worth knowing. Going back to work can slightly raise your future benefit if your new earnings replace a lower-earning year in your record, and there's a separate question of how the extra income affects your taxes, which is a different subject from the earnings test. The site's guide to working in retirement covers the tax side, and when to claim Social Security has the earnings test with the current numbers. What I can't tell you is whether the job is worth it for your household; a fee-only advisor can run the withholding against the take-home in an afternoon, and that combination of your real offer and your real benefit is exactly what they're for.